2023-02-12 23:02:55,559 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-12 23:02:55,606 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=247, ProcessCount=165, AvailableMemoryMB=5327 2023-02-12 23:02:55,900 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77 2023-02-12 23:02:55,911 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 23:02:55,912 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/cluster_74a21e0e-05c0-1741-5c23-b26ea8e7d86f, deleteOnExit=true 2023-02-12 23:02:55,912 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 23:02:55,913 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/test.cache.data in system properties and HBase conf 2023-02-12 23:02:55,913 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 23:02:55,914 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/hadoop.log.dir in system properties and HBase conf 2023-02-12 23:02:55,915 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 23:02:55,915 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 23:02:55,916 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 23:02:56,028 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-12 23:02:56,416 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 23:02:56,421 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 23:02:56,421 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 23:02:56,422 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 23:02:56,422 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 23:02:56,422 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 23:02:56,423 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 23:02:56,423 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 23:02:56,423 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 23:02:56,424 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 23:02:56,424 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/nfs.dump.dir in system properties and HBase conf 2023-02-12 23:02:56,425 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/java.io.tmpdir in system properties and HBase conf 2023-02-12 23:02:56,425 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 23:02:56,426 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 23:02:56,426 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 23:02:56,909 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 23:02:56,913 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 23:02:57,212 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-12 23:02:57,373 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-12 23:02:57,389 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:02:57,437 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:02:57,483 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/java.io.tmpdir/Jetty_localhost_41499_hdfs____.fb23rz/webapp 2023-02-12 23:02:57,634 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41499 2023-02-12 23:02:57,647 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 23:02:57,647 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 23:02:58,221 WARN [Listener at localhost/38615] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:02:58,327 WARN [Listener at localhost/38615] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 23:02:58,353 WARN [Listener at localhost/38615] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:02:58,361 INFO [Listener at localhost/38615] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:02:58,368 INFO [Listener at localhost/38615] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/java.io.tmpdir/Jetty_localhost_40891_datanode____.9ke56t/webapp 2023-02-12 23:02:58,505 INFO [Listener at localhost/38615] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40891 2023-02-12 23:02:58,921 WARN [Listener at localhost/36387] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:02:58,955 WARN [Listener at localhost/36387] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 23:02:58,960 WARN [Listener at localhost/36387] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:02:58,962 INFO [Listener at localhost/36387] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:02:58,978 INFO [Listener at localhost/36387] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/java.io.tmpdir/Jetty_localhost_46209_datanode____.vbrtsw/webapp 2023-02-12 23:02:59,115 INFO [Listener at localhost/36387] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46209 2023-02-12 23:02:59,140 WARN [Listener at localhost/35801] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:02:59,466 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x110940f6aaab25b: Processing first storage report for DS-809e1904-7144-45af-9474-04528e6d7c53 from datanode a9a39106-14f3-4441-864f-e355bf474f80 2023-02-12 23:02:59,468 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x110940f6aaab25b: from storage DS-809e1904-7144-45af-9474-04528e6d7c53 node DatanodeRegistration(127.0.0.1:38801, datanodeUuid=a9a39106-14f3-4441-864f-e355bf474f80, infoPort=44465, infoSecurePort=0, ipcPort=36387, storageInfo=lv=-57;cid=testClusterID;nsid=218209678;c=1676242976981), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-12 23:02:59,468 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbd194a17c6fca90d: Processing first storage report for DS-85d714a9-7694-4f6a-bae2-3c57ce021044 from datanode 519d374f-d769-4e85-96f8-7ba7b3715c4e 2023-02-12 23:02:59,468 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbd194a17c6fca90d: from storage DS-85d714a9-7694-4f6a-bae2-3c57ce021044 node DatanodeRegistration(127.0.0.1:36781, datanodeUuid=519d374f-d769-4e85-96f8-7ba7b3715c4e, infoPort=40165, infoSecurePort=0, ipcPort=35801, storageInfo=lv=-57;cid=testClusterID;nsid=218209678;c=1676242976981), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:02:59,469 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x110940f6aaab25b: Processing first storage report for DS-13c07f5a-d245-4853-ad69-79076627a57a from datanode a9a39106-14f3-4441-864f-e355bf474f80 2023-02-12 23:02:59,469 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x110940f6aaab25b: from storage DS-13c07f5a-d245-4853-ad69-79076627a57a node DatanodeRegistration(127.0.0.1:38801, datanodeUuid=a9a39106-14f3-4441-864f-e355bf474f80, infoPort=44465, infoSecurePort=0, ipcPort=36387, storageInfo=lv=-57;cid=testClusterID;nsid=218209678;c=1676242976981), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-12 23:02:59,469 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbd194a17c6fca90d: Processing first storage report for DS-27aa8807-1a80-4258-995d-d7b4dbc2e850 from datanode 519d374f-d769-4e85-96f8-7ba7b3715c4e 2023-02-12 23:02:59,469 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbd194a17c6fca90d: from storage DS-27aa8807-1a80-4258-995d-d7b4dbc2e850 node DatanodeRegistration(127.0.0.1:36781, datanodeUuid=519d374f-d769-4e85-96f8-7ba7b3715c4e, infoPort=40165, infoSecurePort=0, ipcPort=35801, storageInfo=lv=-57;cid=testClusterID;nsid=218209678;c=1676242976981), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:02:59,562 DEBUG [Listener at localhost/35801] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77 2023-02-12 23:02:59,650 INFO [Listener at localhost/35801] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/cluster_74a21e0e-05c0-1741-5c23-b26ea8e7d86f/zookeeper_0, clientPort=56729, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/cluster_74a21e0e-05c0-1741-5c23-b26ea8e7d86f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/cluster_74a21e0e-05c0-1741-5c23-b26ea8e7d86f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 23:02:59,667 INFO [Listener at localhost/35801] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56729 2023-02-12 23:02:59,677 INFO [Listener at localhost/35801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:02:59,679 INFO [Listener at localhost/35801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:00,372 INFO [Listener at localhost/35801] util.FSUtils(479): Created version file at hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d with version=8 2023-02-12 23:03:00,372 INFO [Listener at localhost/35801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:00,375 INFO [Listener at localhost/35801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:00,379 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/hbase-staging 2023-02-12 23:03:00,725 INFO [Listener at localhost/35801] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-12 23:03:01,188 INFO [Listener at localhost/35801] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:01,221 INFO [Listener at localhost/35801] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:01,222 INFO [Listener at localhost/35801] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:01,222 INFO [Listener at localhost/35801] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:01,222 INFO [Listener at localhost/35801] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:01,222 INFO [Listener at localhost/35801] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:01,365 INFO [Listener at localhost/35801] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:01,436 DEBUG [Listener at localhost/35801] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-12 23:03:01,529 INFO [Listener at localhost/35801] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37697 2023-02-12 23:03:01,539 INFO [Listener at localhost/35801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:01,541 INFO [Listener at localhost/35801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:01,563 INFO [Listener at localhost/35801] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37697 connecting to ZooKeeper ensemble=127.0.0.1:56729 2023-02-12 23:03:01,611 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:376970x0, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:01,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37697-0x1004ac5f4f20000 connected 2023-02-12 23:03:01,643 DEBUG [Listener at localhost/35801] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:01,644 DEBUG [Listener at localhost/35801] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:01,648 DEBUG [Listener at localhost/35801] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:01,655 DEBUG [Listener at localhost/35801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37697 2023-02-12 23:03:01,656 DEBUG [Listener at localhost/35801] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37697 2023-02-12 23:03:01,656 DEBUG [Listener at localhost/35801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37697 2023-02-12 23:03:01,657 DEBUG [Listener at localhost/35801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37697 2023-02-12 23:03:01,660 DEBUG [Listener at localhost/35801] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37697 2023-02-12 23:03:01,666 INFO [Listener at localhost/35801] master.HMaster(439): hbase.rootdir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d, hbase.cluster.distributed=false 2023-02-12 23:03:01,734 INFO [Listener at localhost/35801] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:01,735 INFO [Listener at localhost/35801] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:01,735 INFO [Listener at localhost/35801] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:01,735 INFO [Listener at localhost/35801] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:01,735 INFO [Listener at localhost/35801] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:01,735 INFO [Listener at localhost/35801] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:01,740 INFO [Listener at localhost/35801] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:01,743 INFO [Listener at localhost/35801] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37521 2023-02-12 23:03:01,745 INFO [Listener at localhost/35801] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 23:03:01,752 DEBUG [Listener at localhost/35801] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:01,753 INFO [Listener at localhost/35801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:01,755 INFO [Listener at localhost/35801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:01,757 INFO [Listener at localhost/35801] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37521 connecting to ZooKeeper ensemble=127.0.0.1:56729 2023-02-12 23:03:01,761 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:375210x0, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:01,762 DEBUG [Listener at localhost/35801] zookeeper.ZKUtil(164): regionserver:375210x0, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:01,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37521-0x1004ac5f4f20001 connected 2023-02-12 23:03:01,764 DEBUG [Listener at localhost/35801] zookeeper.ZKUtil(164): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:01,765 DEBUG [Listener at localhost/35801] zookeeper.ZKUtil(164): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:01,765 DEBUG [Listener at localhost/35801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37521 2023-02-12 23:03:01,768 DEBUG [Listener at localhost/35801] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37521 2023-02-12 23:03:01,768 DEBUG [Listener at localhost/35801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37521 2023-02-12 23:03:01,769 DEBUG [Listener at localhost/35801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37521 2023-02-12 23:03:01,769 DEBUG [Listener at localhost/35801] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37521 2023-02-12 23:03:01,782 INFO [Listener at localhost/35801] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:01,782 INFO [Listener at localhost/35801] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:01,782 INFO [Listener at localhost/35801] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:01,783 INFO [Listener at localhost/35801] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:01,783 INFO [Listener at localhost/35801] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:01,783 INFO [Listener at localhost/35801] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:01,783 INFO [Listener at localhost/35801] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:01,785 INFO [Listener at localhost/35801] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43299 2023-02-12 23:03:01,786 INFO [Listener at localhost/35801] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 23:03:01,787 DEBUG [Listener at localhost/35801] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:01,788 INFO [Listener at localhost/35801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:01,790 INFO [Listener at localhost/35801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:01,792 INFO [Listener at localhost/35801] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43299 connecting to ZooKeeper ensemble=127.0.0.1:56729 2023-02-12 23:03:01,799 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:432990x0, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:01,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43299-0x1004ac5f4f20002 connected 2023-02-12 23:03:01,800 DEBUG [Listener at localhost/35801] zookeeper.ZKUtil(164): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:01,801 DEBUG [Listener at localhost/35801] zookeeper.ZKUtil(164): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:01,802 DEBUG [Listener at localhost/35801] zookeeper.ZKUtil(164): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:01,804 DEBUG [Listener at localhost/35801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43299 2023-02-12 23:03:01,804 DEBUG [Listener at localhost/35801] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43299 2023-02-12 23:03:01,805 DEBUG [Listener at localhost/35801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43299 2023-02-12 23:03:01,805 DEBUG [Listener at localhost/35801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43299 2023-02-12 23:03:01,806 DEBUG [Listener at localhost/35801] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43299 2023-02-12 23:03:01,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37697,1676242980558 2023-02-12 23:03:01,818 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 23:03:01,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37697,1676242980558 2023-02-12 23:03:01,839 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:01,839 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:01,839 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:01,839 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:01,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 23:03:01,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37697,1676242980558 from backup master directory 2023-02-12 23:03:01,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 23:03:01,845 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37697,1676242980558 2023-02-12 23:03:01,846 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 23:03:01,846 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:01,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,37697,1676242980558 2023-02-12 23:03:01,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-12 23:03:01,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-12 23:03:01,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/hbase.id with ID: 550b9b39-95e0-4b39-be40-da425ac4e87d 2023-02-12 23:03:01,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:01,994 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:02,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x21ac6e48 to 127.0.0.1:56729 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:02,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a9e404f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:02,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:02,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 23:03:02,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-12 23:03:02,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-12 23:03:02,129 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-12 23:03:02,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-12 23:03:02,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:02,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/MasterData/data/master/store-tmp 2023-02-12 23:03:02,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:02,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 23:03:02,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:02,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:02,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 23:03:02,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:02,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:02,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676242982205Disabling compacts and flushes for region at 1676242982206 (+1 ms)Disabling writes for close at 1676242982206Writing region close event to WAL at 1676242982206Closed at 1676242982206 2023-02-12 23:03:02,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/MasterData/WALs/jenkins-hbase4.apache.org,37697,1676242980558 2023-02-12 23:03:02,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37697%2C1676242980558, suffix=, logDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/MasterData/WALs/jenkins-hbase4.apache.org,37697,1676242980558, archiveDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/MasterData/oldWALs, maxLogs=10 2023-02-12 23:03:02,293 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38801,DS-809e1904-7144-45af-9474-04528e6d7c53,DISK] 2023-02-12 23:03:02,293 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36781,DS-85d714a9-7694-4f6a-bae2-3c57ce021044,DISK] 2023-02-12 23:03:02,301 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-12 23:03:02,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/MasterData/WALs/jenkins-hbase4.apache.org,37697,1676242980558/jenkins-hbase4.apache.org%2C37697%2C1676242980558.1676242982248 2023-02-12 23:03:02,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38801,DS-809e1904-7144-45af-9474-04528e6d7c53,DISK], DatanodeInfoWithStorage[127.0.0.1:36781,DS-85d714a9-7694-4f6a-bae2-3c57ce021044,DISK]] 2023-02-12 23:03:02,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:02,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:02,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:02,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:02,438 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:02,446 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 23:03:02,484 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 23:03:02,498 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:02,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:02,505 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:02,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:02,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:02,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64531740, jitterRate=-0.03840214014053345}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 23:03:02,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676242982404Initializing all the Stores at 1676242982406 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242982407 (+1 ms)Cleaning up temporary data from old regions at 1676242982512 (+105 ms)Cleaning up detritus from prior splits at 1676242982513 (+1 ms)Region opened successfully at 1676242982527 (+14 ms) 2023-02-12 23:03:02,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 23:03:02,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 23:03:02,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 23:03:02,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 23:03:02,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-12 23:03:02,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 36 msec 2023-02-12 23:03:02,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 23:03:02,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 23:03:02,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 23:03:02,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 23:03:02,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 23:03:02,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 23:03:02,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 23:03:02,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 23:03:02,702 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:02,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 23:03:02,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 23:03:02,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 23:03:02,726 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:02,726 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:02,726 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:02,726 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:02,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,37697,1676242980558, sessionid=0x1004ac5f4f20000, setting cluster-up flag (Was=false) 2023-02-12 23:03:02,748 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:02,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 23:03:02,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37697,1676242980558 2023-02-12 23:03:02,767 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:02,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 23:03:02,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37697,1676242980558 2023-02-12 23:03:02,777 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.hbase-snapshot/.tmp 2023-02-12 23:03:02,811 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(952): ClusterId : 550b9b39-95e0-4b39-be40-da425ac4e87d 2023-02-12 23:03:02,811 INFO [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(952): ClusterId : 550b9b39-95e0-4b39-be40-da425ac4e87d 2023-02-12 23:03:02,818 DEBUG [RS:0;jenkins-hbase4:37521] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 23:03:02,818 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 23:03:02,826 DEBUG [RS:0;jenkins-hbase4:37521] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 23:03:02,826 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 23:03:02,826 DEBUG [RS:0;jenkins-hbase4:37521] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 23:03:02,826 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 23:03:02,830 DEBUG [RS:0;jenkins-hbase4:37521] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 23:03:02,830 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 23:03:02,831 DEBUG [RS:1;jenkins-hbase4:43299] zookeeper.ReadOnlyZKClient(139): Connect 0x64674c53 to 127.0.0.1:56729 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:02,831 DEBUG [RS:0;jenkins-hbase4:37521] zookeeper.ReadOnlyZKClient(139): Connect 0x216ef8e8 to 127.0.0.1:56729 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:02,841 DEBUG [RS:0;jenkins-hbase4:37521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fe1c181, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:02,841 DEBUG [RS:1;jenkins-hbase4:43299] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3460d7b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:02,841 DEBUG [RS:0;jenkins-hbase4:37521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5eeef782, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:02,842 DEBUG [RS:1;jenkins-hbase4:43299] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c4257d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:02,864 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43299 2023-02-12 23:03:02,864 DEBUG [RS:0;jenkins-hbase4:37521] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37521 2023-02-12 23:03:02,869 INFO [RS:0;jenkins-hbase4:37521] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 23:03:02,869 INFO [RS:1;jenkins-hbase4:43299] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 23:03:02,869 INFO [RS:1;jenkins-hbase4:43299] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 23:03:02,869 INFO [RS:0;jenkins-hbase4:37521] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 23:03:02,869 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 23:03:02,869 DEBUG [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 23:03:02,872 INFO [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37697,1676242980558 with isa=jenkins-hbase4.apache.org/172.31.14.131:37521, startcode=1676242981734 2023-02-12 23:03:02,872 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37697,1676242980558 with isa=jenkins-hbase4.apache.org/172.31.14.131:43299, startcode=1676242981781 2023-02-12 23:03:02,891 DEBUG [RS:1;jenkins-hbase4:43299] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 23:03:02,891 DEBUG [RS:0;jenkins-hbase4:37521] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 23:03:02,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:02,953 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47957, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 23:03:02,953 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34051, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 23:03:02,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:02,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:02,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:02,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:02,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 23:03:02,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:02,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:02,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:02,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 23:03:02,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37697] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 23:03:02,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676243012972 2023-02-12 23:03:02,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 23:03:02,981 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:02,982 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 23:03:02,988 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:02,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 23:03:02,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 23:03:02,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 23:03:02,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 23:03:02,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 23:03:03,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:03,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 23:03:03,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 23:03:03,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 23:03:03,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 23:03:03,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 23:03:03,014 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(2829): Master is not running yet 2023-02-12 23:03:03,014 DEBUG [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(2829): Master is not running yet 2023-02-12 23:03:03,015 WARN [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-12 23:03:03,015 WARN [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-12 23:03:03,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676242983015,5,FailOnTimeoutGroup] 2023-02-12 23:03:03,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676242983015,5,FailOnTimeoutGroup] 2023-02-12 23:03:03,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:03,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 23:03:03,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:03,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:03,036 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:03,038 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:03,038 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d 2023-02-12 23:03:03,056 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:03,059 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 23:03:03,062 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/info 2023-02-12 23:03:03,063 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 23:03:03,064 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:03,065 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 23:03:03,067 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:03,067 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 23:03:03,068 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:03,069 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 23:03:03,071 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/table 2023-02-12 23:03:03,071 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 23:03:03,072 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:03,073 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740 2023-02-12 23:03:03,074 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740 2023-02-12 23:03:03,078 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 23:03:03,080 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 23:03:03,084 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:03,085 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62979630, jitterRate=-0.06153038144111633}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 23:03:03,085 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676242983056Initializing all the Stores at 1676242983057 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676242983058 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242983058Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676242983059 (+1 ms)Cleaning up temporary data from old regions at 1676242983076 (+17 ms)Cleaning up detritus from prior splits at 1676242983077 (+1 ms)Region opened successfully at 1676242983085 (+8 ms) 2023-02-12 23:03:03,085 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 23:03:03,085 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 23:03:03,085 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 23:03:03,085 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 23:03:03,085 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 23:03:03,086 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:03,086 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676242983085Disabling compacts and flushes for region at 1676242983085Disabling writes for close at 1676242983085Writing region close event to WAL at 1676242983086 (+1 ms)Closed at 1676242983086 2023-02-12 23:03:03,091 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:03,091 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 23:03:03,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 23:03:03,112 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 23:03:03,115 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 23:03:03,265 WARN [jenkins-hbase4:37697] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-12 23:03:04,016 INFO [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37697,1676242980558 with isa=jenkins-hbase4.apache.org/172.31.14.131:37521, startcode=1676242981734 2023-02-12 23:03:04,016 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37697,1676242980558 with isa=jenkins-hbase4.apache.org/172.31.14.131:43299, startcode=1676242981781 2023-02-12 23:03:04,023 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37697] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:04,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:04,030 DEBUG [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d 2023-02-12 23:03:04,030 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d 2023-02-12 23:03:04,030 DEBUG [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38615 2023-02-12 23:03:04,030 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38615 2023-02-12 23:03:04,030 DEBUG [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 23:03:04,030 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 23:03:04,045 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:04,045 DEBUG [RS:0;jenkins-hbase4:37521] zookeeper.ZKUtil(162): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:04,045 DEBUG [RS:1;jenkins-hbase4:43299] zookeeper.ZKUtil(162): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:04,045 WARN [RS:0;jenkins-hbase4:37521] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:04,045 WARN [RS:1;jenkins-hbase4:43299] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:04,046 INFO [RS:0;jenkins-hbase4:37521] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:04,046 INFO [RS:1;jenkins-hbase4:43299] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:04,047 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/WALs/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:04,047 DEBUG [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/WALs/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:04,047 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43299,1676242981781] 2023-02-12 23:03:04,047 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37521,1676242981734] 2023-02-12 23:03:04,058 DEBUG [RS:0;jenkins-hbase4:37521] zookeeper.ZKUtil(162): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:04,058 DEBUG [RS:1;jenkins-hbase4:43299] zookeeper.ZKUtil(162): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:04,059 DEBUG [RS:0;jenkins-hbase4:37521] zookeeper.ZKUtil(162): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:04,059 DEBUG [RS:1;jenkins-hbase4:43299] zookeeper.ZKUtil(162): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:04,071 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 23:03:04,071 DEBUG [RS:0;jenkins-hbase4:37521] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 23:03:04,082 INFO [RS:0;jenkins-hbase4:37521] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 23:03:04,082 INFO [RS:1;jenkins-hbase4:43299] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 23:03:04,104 INFO [RS:1;jenkins-hbase4:43299] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 23:03:04,104 INFO [RS:0;jenkins-hbase4:37521] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 23:03:04,109 INFO [RS:1;jenkins-hbase4:43299] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 23:03:04,109 INFO [RS:0;jenkins-hbase4:37521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 23:03:04,110 INFO [RS:1;jenkins-hbase4:43299] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,110 INFO [RS:0;jenkins-hbase4:37521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,111 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 23:03:04,111 INFO [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 23:03:04,120 INFO [RS:0;jenkins-hbase4:37521] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,120 INFO [RS:1;jenkins-hbase4:43299] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,120 DEBUG [RS:0;jenkins-hbase4:37521] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,120 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,121 DEBUG [RS:0;jenkins-hbase4:37521] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,121 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,121 DEBUG [RS:0;jenkins-hbase4:37521] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,121 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,121 DEBUG [RS:0;jenkins-hbase4:37521] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,121 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,121 DEBUG [RS:0;jenkins-hbase4:37521] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,121 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,121 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:04,121 DEBUG [RS:0;jenkins-hbase4:37521] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:04,122 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,122 DEBUG [RS:0;jenkins-hbase4:37521] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,122 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,122 DEBUG [RS:0;jenkins-hbase4:37521] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,122 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,122 DEBUG [RS:0;jenkins-hbase4:37521] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,122 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,122 DEBUG [RS:0;jenkins-hbase4:37521] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:04,126 INFO [RS:1;jenkins-hbase4:43299] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,126 INFO [RS:1;jenkins-hbase4:43299] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,126 INFO [RS:0;jenkins-hbase4:37521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,126 INFO [RS:1;jenkins-hbase4:43299] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,126 INFO [RS:0;jenkins-hbase4:37521] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,126 INFO [RS:0;jenkins-hbase4:37521] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,148 INFO [RS:1;jenkins-hbase4:43299] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 23:03:04,148 INFO [RS:0;jenkins-hbase4:37521] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 23:03:04,152 INFO [RS:1;jenkins-hbase4:43299] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43299,1676242981781-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,152 INFO [RS:0;jenkins-hbase4:37521] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37521,1676242981734-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,171 INFO [RS:0;jenkins-hbase4:37521] regionserver.Replication(203): jenkins-hbase4.apache.org,37521,1676242981734 started 2023-02-12 23:03:04,171 INFO [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37521,1676242981734, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37521, sessionid=0x1004ac5f4f20001 2023-02-12 23:03:04,172 DEBUG [RS:0;jenkins-hbase4:37521] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 23:03:04,172 DEBUG [RS:0;jenkins-hbase4:37521] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:04,172 DEBUG [RS:0;jenkins-hbase4:37521] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37521,1676242981734' 2023-02-12 23:03:04,172 DEBUG [RS:0;jenkins-hbase4:37521] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:04,172 INFO [RS:1;jenkins-hbase4:43299] regionserver.Replication(203): jenkins-hbase4.apache.org,43299,1676242981781 started 2023-02-12 23:03:04,173 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43299,1676242981781, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43299, sessionid=0x1004ac5f4f20002 2023-02-12 23:03:04,173 DEBUG [RS:0;jenkins-hbase4:37521] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:04,173 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 23:03:04,173 DEBUG [RS:1;jenkins-hbase4:43299] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:04,173 DEBUG [RS:1;jenkins-hbase4:43299] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43299,1676242981781' 2023-02-12 23:03:04,174 DEBUG [RS:1;jenkins-hbase4:43299] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:04,174 DEBUG [RS:0;jenkins-hbase4:37521] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 23:03:04,174 DEBUG [RS:0;jenkins-hbase4:37521] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 23:03:04,174 DEBUG [RS:1;jenkins-hbase4:43299] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:04,174 DEBUG [RS:0;jenkins-hbase4:37521] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:04,175 DEBUG [RS:0;jenkins-hbase4:37521] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37521,1676242981734' 2023-02-12 23:03:04,175 DEBUG [RS:0;jenkins-hbase4:37521] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:04,175 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 23:03:04,175 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 23:03:04,175 DEBUG [RS:1;jenkins-hbase4:43299] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:04,175 DEBUG [RS:1;jenkins-hbase4:43299] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43299,1676242981781' 2023-02-12 23:03:04,175 DEBUG [RS:0;jenkins-hbase4:37521] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:04,175 DEBUG [RS:1;jenkins-hbase4:43299] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:04,176 DEBUG [RS:0;jenkins-hbase4:37521] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 23:03:04,176 DEBUG [RS:1;jenkins-hbase4:43299] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:04,176 INFO [RS:0;jenkins-hbase4:37521] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 23:03:04,176 INFO [RS:0;jenkins-hbase4:37521] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 23:03:04,177 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 23:03:04,177 INFO [RS:1;jenkins-hbase4:43299] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 23:03:04,177 INFO [RS:1;jenkins-hbase4:43299] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 23:03:04,267 DEBUG [jenkins-hbase4:37697] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 23:03:04,272 DEBUG [jenkins-hbase4:37697] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:04,278 DEBUG [jenkins-hbase4:37697] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:04,278 DEBUG [jenkins-hbase4:37697] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:04,278 DEBUG [jenkins-hbase4:37697] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:04,281 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43299,1676242981781, state=OPENING 2023-02-12 23:03:04,289 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 23:03:04,290 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:04,291 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 23:03:04,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43299,1676242981781}] 2023-02-12 23:03:04,481 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:04,483 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 23:03:04,487 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59964, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 23:03:04,499 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 23:03:04,499 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:04,502 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43299%2C1676242981781.meta, suffix=.meta, logDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/WALs/jenkins-hbase4.apache.org,43299,1676242981781, archiveDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/oldWALs, maxLogs=32 2023-02-12 23:03:04,522 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38801,DS-809e1904-7144-45af-9474-04528e6d7c53,DISK] 2023-02-12 23:03:04,522 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36781,DS-85d714a9-7694-4f6a-bae2-3c57ce021044,DISK] 2023-02-12 23:03:04,526 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/WALs/jenkins-hbase4.apache.org,43299,1676242981781/jenkins-hbase4.apache.org%2C43299%2C1676242981781.meta.1676242984505.meta 2023-02-12 23:03:04,526 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38801,DS-809e1904-7144-45af-9474-04528e6d7c53,DISK], DatanodeInfoWithStorage[127.0.0.1:36781,DS-85d714a9-7694-4f6a-bae2-3c57ce021044,DISK]] 2023-02-12 23:03:04,527 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:04,528 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 23:03:04,545 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 23:03:04,550 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 23:03:04,556 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 23:03:04,556 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:04,556 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 23:03:04,556 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 23:03:04,559 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 23:03:04,561 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/info 2023-02-12 23:03:04,561 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/info 2023-02-12 23:03:04,561 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 23:03:04,563 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:04,563 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 23:03:04,565 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:04,565 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:04,565 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 23:03:04,566 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:04,566 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 23:03:04,568 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/table 2023-02-12 23:03:04,568 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/table 2023-02-12 23:03:04,568 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 23:03:04,569 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:04,571 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740 2023-02-12 23:03:04,575 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740 2023-02-12 23:03:04,579 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 23:03:04,582 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 23:03:04,584 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59904529, jitterRate=-0.10735295712947845}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 23:03:04,584 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676242984557Writing region info on filesystem at 1676242984557Initializing all the Stores at 1676242984558 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676242984559 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242984559Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676242984559Cleaning up temporary data from old regions at 1676242984577 (+18 ms)Cleaning up detritus from prior splits at 1676242984578 (+1 ms)Running coprocessor post-open hooks at 1676242984584 (+6 ms)Region opened successfully at 1676242984584 2023-02-12 23:03:04,595 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676242984472 2023-02-12 23:03:04,614 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 23:03:04,615 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 23:03:04,615 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43299,1676242981781, state=OPEN 2023-02-12 23:03:04,619 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 23:03:04,619 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 23:03:04,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 23:03:04,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43299,1676242981781 in 325 msec 2023-02-12 23:03:04,629 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 23:03:04,630 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.5250 sec 2023-02-12 23:03:04,635 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.7730 sec 2023-02-12 23:03:04,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676242981834, completionTime=-1 2023-02-12 23:03:04,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 23:03:04,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 23:03:04,703 DEBUG [hconnection-0x501bb48f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:04,706 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59968, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:04,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 23:03:04,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676243044728 2023-02-12 23:03:04,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676243104728 2023-02-12 23:03:04,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 92 msec 2023-02-12 23:03:04,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37697,1676242980558-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37697,1676242980558-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37697,1676242980558-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37697, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:04,762 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 23:03:04,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 23:03:04,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:04,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 23:03:04,785 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 23:03:04,787 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 23:03:04,808 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/hbase/namespace/6b22c2b1305adca8d3f7f5b72815c88a 2023-02-12 23:03:04,811 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/hbase/namespace/6b22c2b1305adca8d3f7f5b72815c88a empty. 2023-02-12 23:03:04,812 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/hbase/namespace/6b22c2b1305adca8d3f7f5b72815c88a 2023-02-12 23:03:04,812 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 23:03:04,839 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:04,842 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6b22c2b1305adca8d3f7f5b72815c88a, NAME => 'hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp 2023-02-12 23:03:04,859 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:04,859 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 6b22c2b1305adca8d3f7f5b72815c88a, disabling compactions & flushes 2023-02-12 23:03:04,859 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a. 2023-02-12 23:03:04,859 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a. 2023-02-12 23:03:04,859 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a. after waiting 0 ms 2023-02-12 23:03:04,859 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a. 2023-02-12 23:03:04,859 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a. 2023-02-12 23:03:04,860 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 6b22c2b1305adca8d3f7f5b72815c88a: Waiting for close lock at 1676242984859Disabling compacts and flushes for region at 1676242984859Disabling writes for close at 1676242984859Writing region close event to WAL at 1676242984859Closed at 1676242984859 2023-02-12 23:03:04,864 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 23:03:04,879 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676242984867"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242984867"}]},"ts":"1676242984867"} 2023-02-12 23:03:04,908 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 23:03:04,910 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 23:03:04,915 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676242984910"}]},"ts":"1676242984910"} 2023-02-12 23:03:04,919 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 23:03:04,923 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:04,924 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:04,924 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:04,924 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:04,927 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6b22c2b1305adca8d3f7f5b72815c88a, ASSIGN}] 2023-02-12 23:03:04,930 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6b22c2b1305adca8d3f7f5b72815c88a, ASSIGN 2023-02-12 23:03:04,931 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6b22c2b1305adca8d3f7f5b72815c88a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37521,1676242981734; forceNewPlan=false, retain=false 2023-02-12 23:03:05,084 INFO [jenkins-hbase4:37697] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 23:03:05,085 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6b22c2b1305adca8d3f7f5b72815c88a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:05,085 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676242985085"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242985085"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242985085"}]},"ts":"1676242985085"} 2023-02-12 23:03:05,090 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6b22c2b1305adca8d3f7f5b72815c88a, server=jenkins-hbase4.apache.org,37521,1676242981734}] 2023-02-12 23:03:05,192 INFO [RS:1;jenkins-hbase4:43299] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43299%2C1676242981781, suffix=, logDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/WALs/jenkins-hbase4.apache.org,43299,1676242981781, archiveDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/oldWALs, maxLogs=32 2023-02-12 23:03:05,201 INFO [RS:0;jenkins-hbase4:37521] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37521%2C1676242981734, suffix=, logDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/WALs/jenkins-hbase4.apache.org,37521,1676242981734, archiveDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/oldWALs, maxLogs=32 2023-02-12 23:03:05,213 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36781,DS-85d714a9-7694-4f6a-bae2-3c57ce021044,DISK] 2023-02-12 23:03:05,214 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38801,DS-809e1904-7144-45af-9474-04528e6d7c53,DISK] 2023-02-12 23:03:05,218 INFO [RS:1;jenkins-hbase4:43299] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/WALs/jenkins-hbase4.apache.org,43299,1676242981781/jenkins-hbase4.apache.org%2C43299%2C1676242981781.1676242985194 2023-02-12 23:03:05,219 DEBUG [RS:1;jenkins-hbase4:43299] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36781,DS-85d714a9-7694-4f6a-bae2-3c57ce021044,DISK], DatanodeInfoWithStorage[127.0.0.1:38801,DS-809e1904-7144-45af-9474-04528e6d7c53,DISK]] 2023-02-12 23:03:05,228 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36781,DS-85d714a9-7694-4f6a-bae2-3c57ce021044,DISK] 2023-02-12 23:03:05,229 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38801,DS-809e1904-7144-45af-9474-04528e6d7c53,DISK] 2023-02-12 23:03:05,237 INFO [RS:0;jenkins-hbase4:37521] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/WALs/jenkins-hbase4.apache.org,37521,1676242981734/jenkins-hbase4.apache.org%2C37521%2C1676242981734.1676242985203 2023-02-12 23:03:05,237 DEBUG [RS:0;jenkins-hbase4:37521] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36781,DS-85d714a9-7694-4f6a-bae2-3c57ce021044,DISK], DatanodeInfoWithStorage[127.0.0.1:38801,DS-809e1904-7144-45af-9474-04528e6d7c53,DISK]] 2023-02-12 23:03:05,244 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:05,244 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 23:03:05,247 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49300, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 23:03:05,256 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a. 2023-02-12 23:03:05,257 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6b22c2b1305adca8d3f7f5b72815c88a, NAME => 'hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:05,258 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6b22c2b1305adca8d3f7f5b72815c88a 2023-02-12 23:03:05,258 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:05,258 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6b22c2b1305adca8d3f7f5b72815c88a 2023-02-12 23:03:05,259 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6b22c2b1305adca8d3f7f5b72815c88a 2023-02-12 23:03:05,261 INFO [StoreOpener-6b22c2b1305adca8d3f7f5b72815c88a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6b22c2b1305adca8d3f7f5b72815c88a 2023-02-12 23:03:05,263 DEBUG [StoreOpener-6b22c2b1305adca8d3f7f5b72815c88a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/namespace/6b22c2b1305adca8d3f7f5b72815c88a/info 2023-02-12 23:03:05,264 DEBUG [StoreOpener-6b22c2b1305adca8d3f7f5b72815c88a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/namespace/6b22c2b1305adca8d3f7f5b72815c88a/info 2023-02-12 23:03:05,264 INFO [StoreOpener-6b22c2b1305adca8d3f7f5b72815c88a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b22c2b1305adca8d3f7f5b72815c88a columnFamilyName info 2023-02-12 23:03:05,265 INFO [StoreOpener-6b22c2b1305adca8d3f7f5b72815c88a-1] regionserver.HStore(310): Store=6b22c2b1305adca8d3f7f5b72815c88a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:05,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/namespace/6b22c2b1305adca8d3f7f5b72815c88a 2023-02-12 23:03:05,269 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/namespace/6b22c2b1305adca8d3f7f5b72815c88a 2023-02-12 23:03:05,277 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6b22c2b1305adca8d3f7f5b72815c88a 2023-02-12 23:03:05,281 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/namespace/6b22c2b1305adca8d3f7f5b72815c88a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:05,282 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6b22c2b1305adca8d3f7f5b72815c88a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66750744, jitterRate=-0.005336403846740723}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 23:03:05,282 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6b22c2b1305adca8d3f7f5b72815c88a: Running coprocessor pre-open hook at 1676242985259Writing region info on filesystem at 1676242985259Initializing all the Stores at 1676242985260 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676242985260Cleaning up temporary data from old regions at 1676242985269 (+9 ms)Cleaning up detritus from prior splits at 1676242985270 (+1 ms)Running coprocessor post-open hooks at 1676242985282 (+12 ms)Region opened successfully at 1676242985282 2023-02-12 23:03:05,284 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a., pid=6, masterSystemTime=1676242985244 2023-02-12 23:03:05,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a. 2023-02-12 23:03:05,291 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a. 2023-02-12 23:03:05,292 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6b22c2b1305adca8d3f7f5b72815c88a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:05,293 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676242985292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676242985292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676242985292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676242985292"}]},"ts":"1676242985292"} 2023-02-12 23:03:05,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 23:03:05,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6b22c2b1305adca8d3f7f5b72815c88a, server=jenkins-hbase4.apache.org,37521,1676242981734 in 207 msec 2023-02-12 23:03:05,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 23:03:05,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6b22c2b1305adca8d3f7f5b72815c88a, ASSIGN in 374 msec 2023-02-12 23:03:05,306 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 23:03:05,307 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676242985307"}]},"ts":"1676242985307"} 2023-02-12 23:03:05,310 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 23:03:05,314 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 23:03:05,317 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 540 msec 2023-02-12 23:03:05,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 23:03:05,387 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:05,387 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:05,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:05,416 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49314, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:05,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 23:03:05,467 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:05,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 49 msec 2023-02-12 23:03:05,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 23:03:05,502 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:05,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 22 msec 2023-02-12 23:03:05,522 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 23:03:05,525 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 23:03:05,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.681sec 2023-02-12 23:03:05,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 23:03:05,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 23:03:05,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 23:03:05,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37697,1676242980558-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 23:03:05,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37697,1676242980558-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 23:03:05,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 23:03:05,618 DEBUG [Listener at localhost/35801] zookeeper.ReadOnlyZKClient(139): Connect 0x3b8ae91a to 127.0.0.1:56729 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:05,623 DEBUG [Listener at localhost/35801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b8795d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:05,684 DEBUG [hconnection-0x254e1275-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:05,698 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:05,708 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37697,1676242980558 2023-02-12 23:03:05,709 DEBUG [Listener at localhost/35801] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 23:03:05,718 DEBUG [Listener at localhost/35801] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 23:03:05,720 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35222, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 23:03:05,725 INFO [Listener at localhost/35801] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 23:03:05,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-12 23:03:05,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 23:03:05,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:35222 deadline: 1676243045728, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-12 23:03:05,731 INFO [Listener at localhost/35801] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-12 23:03:05,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:05,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-12 23:03:05,747 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 23:03:05,749 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 23:03:05,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-12 23:03:05,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:05,771 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:05,771 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:05,771 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:05,771 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:05,772 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:05,772 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:05,772 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:05,772 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:05,772 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12 empty. 2023-02-12 23:03:05,772 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5 empty. 2023-02-12 23:03:05,773 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1 empty. 2023-02-12 23:03:05,773 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717 empty. 2023-02-12 23:03:05,773 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8 empty. 2023-02-12 23:03:05,773 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:05,774 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03 empty. 2023-02-12 23:03:05,784 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:05,784 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:05,784 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:05,774 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:05,784 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:05,784 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:05,785 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:05,784 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab empty. 2023-02-12 23:03:05,785 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7 empty. 2023-02-12 23:03:05,784 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3 empty. 2023-02-12 23:03:05,784 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b empty. 2023-02-12 23:03:05,786 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:05,786 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:05,786 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:05,786 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:05,786 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 23:03:05,809 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:05,811 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 54b311bf6f51ce93e536f6a73aa344d5, NAME => 'testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp 2023-02-12 23:03:05,811 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 62973a244615f8a20fc71cb2630dab12, NAME => 'testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp 2023-02-12 23:03:05,812 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 54ca3cdd0d82711860e6a784b596d4ab, NAME => 'testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp 2023-02-12 23:03:05,859 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:05,860 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:05,861 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 54ca3cdd0d82711860e6a784b596d4ab, disabling compactions & flushes 2023-02-12 23:03:05,861 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 62973a244615f8a20fc71cb2630dab12, disabling compactions & flushes 2023-02-12 23:03:05,861 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:05,861 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:05,861 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. after waiting 0 ms 2023-02-12 23:03:05,861 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:05,861 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:05,861 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 54ca3cdd0d82711860e6a784b596d4ab: Waiting for close lock at 1676242985861Disabling compacts and flushes for region at 1676242985861Disabling writes for close at 1676242985861Writing region close event to WAL at 1676242985861Closed at 1676242985861 2023-02-12 23:03:05,861 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:05,862 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 54b311bf6f51ce93e536f6a73aa344d5, disabling compactions & flushes 2023-02-12 23:03:05,862 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 514afecf3a82c32469d46e77b9303717, NAME => 'testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp 2023-02-12 23:03:05,861 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:05,862 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:05,862 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:05,863 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:05,863 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. after waiting 0 ms 2023-02-12 23:03:05,863 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. after waiting 0 ms 2023-02-12 23:03:05,863 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:05,863 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:05,863 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:05,863 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:05,863 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 62973a244615f8a20fc71cb2630dab12: Waiting for close lock at 1676242985861Disabling compacts and flushes for region at 1676242985861Disabling writes for close at 1676242985863 (+2 ms)Writing region close event to WAL at 1676242985863Closed at 1676242985863 2023-02-12 23:03:05,863 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 54b311bf6f51ce93e536f6a73aa344d5: Waiting for close lock at 1676242985862Disabling compacts and flushes for region at 1676242985862Disabling writes for close at 1676242985863 (+1 ms)Writing region close event to WAL at 1676242985863Closed at 1676242985863 2023-02-12 23:03:05,864 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9b749c60a6e32651a314656be4e49b03, NAME => 'testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp 2023-02-12 23:03:05,864 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2973c004b4284eb5f5a933a977f9b8b1, NAME => 'testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp 2023-02-12 23:03:05,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:05,895 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:05,897 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:05,898 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 2973c004b4284eb5f5a933a977f9b8b1, disabling compactions & flushes 2023-02-12 23:03:05,898 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 514afecf3a82c32469d46e77b9303717, disabling compactions & flushes 2023-02-12 23:03:05,898 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:05,898 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:05,898 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:05,898 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:05,898 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. after waiting 0 ms 2023-02-12 23:03:05,898 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. after waiting 0 ms 2023-02-12 23:03:05,898 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:05,898 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:05,898 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:05,898 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:05,898 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 2973c004b4284eb5f5a933a977f9b8b1: Waiting for close lock at 1676242985897Disabling compacts and flushes for region at 1676242985897Disabling writes for close at 1676242985898 (+1 ms)Writing region close event to WAL at 1676242985898Closed at 1676242985898 2023-02-12 23:03:05,898 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 514afecf3a82c32469d46e77b9303717: Waiting for close lock at 1676242985898Disabling compacts and flushes for region at 1676242985898Disabling writes for close at 1676242985898Writing region close event to WAL at 1676242985898Closed at 1676242985898 2023-02-12 23:03:05,900 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 469c8d8500abd7ead7bb9f7741b8add8, NAME => 'testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp 2023-02-12 23:03:05,900 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 63f710c49b8d97bffccc8db53e57829b, NAME => 'testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp 2023-02-12 23:03:05,929 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:05,929 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 469c8d8500abd7ead7bb9f7741b8add8, disabling compactions & flushes 2023-02-12 23:03:05,929 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:05,929 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:05,930 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. after waiting 0 ms 2023-02-12 23:03:05,930 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:05,930 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:05,930 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:05,930 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 469c8d8500abd7ead7bb9f7741b8add8: Waiting for close lock at 1676242985929Disabling compacts and flushes for region at 1676242985929Disabling writes for close at 1676242985930 (+1 ms)Writing region close event to WAL at 1676242985930Closed at 1676242985930 2023-02-12 23:03:05,930 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 63f710c49b8d97bffccc8db53e57829b, disabling compactions & flushes 2023-02-12 23:03:05,931 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:05,931 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:05,931 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. after waiting 0 ms 2023-02-12 23:03:05,931 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => c7a8820caf3f3a0e38f5db61bfdd43a7, NAME => 'testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp 2023-02-12 23:03:05,931 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:05,931 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:05,931 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 63f710c49b8d97bffccc8db53e57829b: Waiting for close lock at 1676242985930Disabling compacts and flushes for region at 1676242985930Disabling writes for close at 1676242985931 (+1 ms)Writing region close event to WAL at 1676242985931Closed at 1676242985931 2023-02-12 23:03:05,931 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 804d2c90c6989424a49411184f0845d3, NAME => 'testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp 2023-02-12 23:03:05,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:05,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 804d2c90c6989424a49411184f0845d3, disabling compactions & flushes 2023-02-12 23:03:05,964 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:05,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:05,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. after waiting 0 ms 2023-02-12 23:03:05,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:05,964 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:05,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 804d2c90c6989424a49411184f0845d3: Waiting for close lock at 1676242985963Disabling compacts and flushes for region at 1676242985963Disabling writes for close at 1676242985964 (+1 ms)Writing region close event to WAL at 1676242985964Closed at 1676242985964 2023-02-12 23:03:05,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:05,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing c7a8820caf3f3a0e38f5db61bfdd43a7, disabling compactions & flushes 2023-02-12 23:03:05,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:05,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:05,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. after waiting 0 ms 2023-02-12 23:03:05,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:05,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:05,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for c7a8820caf3f3a0e38f5db61bfdd43a7: Waiting for close lock at 1676242985964Disabling compacts and flushes for region at 1676242985964Disabling writes for close at 1676242985965 (+1 ms)Writing region close event to WAL at 1676242985965Closed at 1676242985965 2023-02-12 23:03:06,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:06,297 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:06,298 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 9b749c60a6e32651a314656be4e49b03, disabling compactions & flushes 2023-02-12 23:03:06,298 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:06,298 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:06,298 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. after waiting 0 ms 2023-02-12 23:03:06,298 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:06,298 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:06,298 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 9b749c60a6e32651a314656be4e49b03: Waiting for close lock at 1676242986298Disabling compacts and flushes for region at 1676242986298Disabling writes for close at 1676242986298Writing region close event to WAL at 1676242986298Closed at 1676242986298 2023-02-12 23:03:06,304 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 23:03:06,305 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242986305"}]},"ts":"1676242986305"} 2023-02-12 23:03:06,306 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676242985738.62973a244615f8a20fc71cb2630dab12.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242986305"}]},"ts":"1676242986305"} 2023-02-12 23:03:06,306 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676242986305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242986305"}]},"ts":"1676242986305"} 2023-02-12 23:03:06,306 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242986305"}]},"ts":"1676242986305"} 2023-02-12 23:03:06,306 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676242985738.514afecf3a82c32469d46e77b9303717.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242986305"}]},"ts":"1676242986305"} 2023-02-12 23:03:06,306 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242986305"}]},"ts":"1676242986305"} 2023-02-12 23:03:06,307 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242986305"}]},"ts":"1676242986305"} 2023-02-12 23:03:06,307 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676242986305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242986305"}]},"ts":"1676242986305"} 2023-02-12 23:03:06,307 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242986305"}]},"ts":"1676242986305"} 2023-02-12 23:03:06,307 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242986305"}]},"ts":"1676242986305"} 2023-02-12 23:03:06,359 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-12 23:03:06,361 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 23:03:06,361 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676242986361"}]},"ts":"1676242986361"} 2023-02-12 23:03:06,364 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-12 23:03:06,369 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:06,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:06,384 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:06,384 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:06,384 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:06,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=54b311bf6f51ce93e536f6a73aa344d5, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=54ca3cdd0d82711860e6a784b596d4ab, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=62973a244615f8a20fc71cb2630dab12, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=514afecf3a82c32469d46e77b9303717, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9b749c60a6e32651a314656be4e49b03, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2973c004b4284eb5f5a933a977f9b8b1, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=63f710c49b8d97bffccc8db53e57829b, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=469c8d8500abd7ead7bb9f7741b8add8, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c7a8820caf3f3a0e38f5db61bfdd43a7, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=804d2c90c6989424a49411184f0845d3, ASSIGN}] 2023-02-12 23:03:06,390 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=54b311bf6f51ce93e536f6a73aa344d5, ASSIGN 2023-02-12 23:03:06,390 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=54ca3cdd0d82711860e6a784b596d4ab, ASSIGN 2023-02-12 23:03:06,391 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=62973a244615f8a20fc71cb2630dab12, ASSIGN 2023-02-12 23:03:06,391 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=514afecf3a82c32469d46e77b9303717, ASSIGN 2023-02-12 23:03:06,393 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=54ca3cdd0d82711860e6a784b596d4ab, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43299,1676242981781; forceNewPlan=false, retain=false 2023-02-12 23:03:06,393 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=54b311bf6f51ce93e536f6a73aa344d5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43299,1676242981781; forceNewPlan=false, retain=false 2023-02-12 23:03:06,393 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=62973a244615f8a20fc71cb2630dab12, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37521,1676242981734; forceNewPlan=false, retain=false 2023-02-12 23:03:06,393 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=514afecf3a82c32469d46e77b9303717, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43299,1676242981781; forceNewPlan=false, retain=false 2023-02-12 23:03:06,394 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=804d2c90c6989424a49411184f0845d3, ASSIGN 2023-02-12 23:03:06,395 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c7a8820caf3f3a0e38f5db61bfdd43a7, ASSIGN 2023-02-12 23:03:06,395 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=469c8d8500abd7ead7bb9f7741b8add8, ASSIGN 2023-02-12 23:03:06,396 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=804d2c90c6989424a49411184f0845d3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37521,1676242981734; forceNewPlan=false, retain=false 2023-02-12 23:03:06,397 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=63f710c49b8d97bffccc8db53e57829b, ASSIGN 2023-02-12 23:03:06,397 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2973c004b4284eb5f5a933a977f9b8b1, ASSIGN 2023-02-12 23:03:06,397 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c7a8820caf3f3a0e38f5db61bfdd43a7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43299,1676242981781; forceNewPlan=false, retain=false 2023-02-12 23:03:06,397 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=469c8d8500abd7ead7bb9f7741b8add8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37521,1676242981734; forceNewPlan=false, retain=false 2023-02-12 23:03:06,398 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9b749c60a6e32651a314656be4e49b03, ASSIGN 2023-02-12 23:03:06,399 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=63f710c49b8d97bffccc8db53e57829b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43299,1676242981781; forceNewPlan=false, retain=false 2023-02-12 23:03:06,399 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2973c004b4284eb5f5a933a977f9b8b1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37521,1676242981734; forceNewPlan=false, retain=false 2023-02-12 23:03:06,417 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9b749c60a6e32651a314656be4e49b03, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37521,1676242981734; forceNewPlan=false, retain=false 2023-02-12 23:03:06,544 INFO [jenkins-hbase4:37697] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-12 23:03:06,547 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=c7a8820caf3f3a0e38f5db61bfdd43a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:06,547 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=514afecf3a82c32469d46e77b9303717, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:06,547 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=54ca3cdd0d82711860e6a784b596d4ab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:06,547 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=63f710c49b8d97bffccc8db53e57829b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:06,547 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=54b311bf6f51ce93e536f6a73aa344d5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:06,548 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676242985738.514afecf3a82c32469d46e77b9303717.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986547"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242986547"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242986547"}]},"ts":"1676242986547"} 2023-02-12 23:03:06,548 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986547"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242986547"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242986547"}]},"ts":"1676242986547"} 2023-02-12 23:03:06,548 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676242986547"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242986547"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242986547"}]},"ts":"1676242986547"} 2023-02-12 23:03:06,548 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986547"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242986547"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242986547"}]},"ts":"1676242986547"} 2023-02-12 23:03:06,548 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986547"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242986547"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242986547"}]},"ts":"1676242986547"} 2023-02-12 23:03:06,551 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure 514afecf3a82c32469d46e77b9303717, server=jenkins-hbase4.apache.org,43299,1676242981781}] 2023-02-12 23:03:06,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE; OpenRegionProcedure c7a8820caf3f3a0e38f5db61bfdd43a7, server=jenkins-hbase4.apache.org,43299,1676242981781}] 2023-02-12 23:03:06,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure 54b311bf6f51ce93e536f6a73aa344d5, server=jenkins-hbase4.apache.org,43299,1676242981781}] 2023-02-12 23:03:06,556 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=17, state=RUNNABLE; OpenRegionProcedure 63f710c49b8d97bffccc8db53e57829b, server=jenkins-hbase4.apache.org,43299,1676242981781}] 2023-02-12 23:03:06,558 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2973c004b4284eb5f5a933a977f9b8b1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:06,558 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986558"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242986558"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242986558"}]},"ts":"1676242986558"} 2023-02-12 23:03:06,559 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=12, state=RUNNABLE; OpenRegionProcedure 54ca3cdd0d82711860e6a784b596d4ab, server=jenkins-hbase4.apache.org,43299,1676242981781}] 2023-02-12 23:03:06,563 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=9b749c60a6e32651a314656be4e49b03, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:06,563 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986563"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242986563"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242986563"}]},"ts":"1676242986563"} 2023-02-12 23:03:06,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=16, state=RUNNABLE; OpenRegionProcedure 2973c004b4284eb5f5a933a977f9b8b1, server=jenkins-hbase4.apache.org,37521,1676242981734}] 2023-02-12 23:03:06,567 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=62973a244615f8a20fc71cb2630dab12, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:06,567 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676242985738.62973a244615f8a20fc71cb2630dab12.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986567"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242986567"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242986567"}]},"ts":"1676242986567"} 2023-02-12 23:03:06,569 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=469c8d8500abd7ead7bb9f7741b8add8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:06,569 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=15, state=RUNNABLE; OpenRegionProcedure 9b749c60a6e32651a314656be4e49b03, server=jenkins-hbase4.apache.org,37521,1676242981734}] 2023-02-12 23:03:06,569 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986569"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242986569"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242986569"}]},"ts":"1676242986569"} 2023-02-12 23:03:06,571 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure 62973a244615f8a20fc71cb2630dab12, server=jenkins-hbase4.apache.org,37521,1676242981734}] 2023-02-12 23:03:06,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=18, state=RUNNABLE; OpenRegionProcedure 469c8d8500abd7ead7bb9f7741b8add8, server=jenkins-hbase4.apache.org,37521,1676242981734}] 2023-02-12 23:03:06,578 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=804d2c90c6989424a49411184f0845d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:06,579 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676242986578"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242986578"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242986578"}]},"ts":"1676242986578"} 2023-02-12 23:03:06,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=20, state=RUNNABLE; OpenRegionProcedure 804d2c90c6989424a49411184f0845d3, server=jenkins-hbase4.apache.org,37521,1676242981734}] 2023-02-12 23:03:06,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:06,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 54ca3cdd0d82711860e6a784b596d4ab, NAME => 'testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-12 23:03:06,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:06,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:06,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:06,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:06,715 INFO [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:06,724 DEBUG [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f1 2023-02-12 23:03:06,724 DEBUG [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f1 2023-02-12 23:03:06,724 INFO [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54ca3cdd0d82711860e6a784b596d4ab columnFamilyName f1 2023-02-12 23:03:06,725 INFO [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] regionserver.HStore(310): Store=54ca3cdd0d82711860e6a784b596d4ab/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,725 INFO [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:06,727 DEBUG [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f2 2023-02-12 23:03:06,727 DEBUG [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f2 2023-02-12 23:03:06,728 INFO [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54ca3cdd0d82711860e6a784b596d4ab columnFamilyName f2 2023-02-12 23:03:06,729 INFO [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] regionserver.HStore(310): Store=54ca3cdd0d82711860e6a784b596d4ab/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:06,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:06,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:06,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 469c8d8500abd7ead7bb9f7741b8add8, NAME => 'testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-12 23:03:06,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:06,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:06,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:06,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:06,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:06,740 INFO [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:06,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:06,742 DEBUG [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f1 2023-02-12 23:03:06,742 DEBUG [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f1 2023-02-12 23:03:06,742 INFO [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 469c8d8500abd7ead7bb9f7741b8add8 columnFamilyName f1 2023-02-12 23:03:06,743 INFO [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] regionserver.HStore(310): Store=469c8d8500abd7ead7bb9f7741b8add8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,743 INFO [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:06,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:06,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 54ca3cdd0d82711860e6a784b596d4ab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65241140, jitterRate=-0.02783125638961792}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:06,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 54ca3cdd0d82711860e6a784b596d4ab: Running coprocessor pre-open hook at 1676242986713Writing region info on filesystem at 1676242986713Initializing all the Stores at 1676242986715 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986715Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986715Cleaning up temporary data from old regions at 1676242986735 (+20 ms)Cleaning up detritus from prior splits at 1676242986737 (+2 ms)Running coprocessor post-open hooks at 1676242986745 (+8 ms)Region opened successfully at 1676242986745 2023-02-12 23:03:06,746 DEBUG [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f2 2023-02-12 23:03:06,746 DEBUG [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f2 2023-02-12 23:03:06,746 INFO [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 469c8d8500abd7ead7bb9f7741b8add8 columnFamilyName f2 2023-02-12 23:03:06,752 INFO [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] regionserver.HStore(310): Store=469c8d8500abd7ead7bb9f7741b8add8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab., pid=25, masterSystemTime=1676242986705 2023-02-12 23:03:06,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:06,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:06,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:06,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:06,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:06,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 63f710c49b8d97bffccc8db53e57829b, NAME => 'testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-12 23:03:06,758 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=54ca3cdd0d82711860e6a784b596d4ab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:06,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:06,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:06,758 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986758"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676242986758"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676242986758"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676242986758"}]},"ts":"1676242986758"} 2023-02-12 23:03:06,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:06,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:06,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:06,761 INFO [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:06,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:06,764 DEBUG [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f1 2023-02-12 23:03:06,764 DEBUG [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f1 2023-02-12 23:03:06,764 INFO [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63f710c49b8d97bffccc8db53e57829b columnFamilyName f1 2023-02-12 23:03:06,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=12 2023-02-12 23:03:06,765 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=12, state=SUCCESS; OpenRegionProcedure 54ca3cdd0d82711860e6a784b596d4ab, server=jenkins-hbase4.apache.org,43299,1676242981781 in 202 msec 2023-02-12 23:03:06,765 INFO [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] regionserver.HStore(310): Store=63f710c49b8d97bffccc8db53e57829b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=54ca3cdd0d82711860e6a784b596d4ab, ASSIGN in 380 msec 2023-02-12 23:03:06,772 INFO [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:06,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:06,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 469c8d8500abd7ead7bb9f7741b8add8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64658403, jitterRate=-0.03651471436023712}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:06,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 469c8d8500abd7ead7bb9f7741b8add8: Running coprocessor pre-open hook at 1676242986738Writing region info on filesystem at 1676242986738Initializing all the Stores at 1676242986739 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986739Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986739Cleaning up temporary data from old regions at 1676242986757 (+18 ms)Cleaning up detritus from prior splits at 1676242986757Running coprocessor post-open hooks at 1676242986774 (+17 ms)Region opened successfully at 1676242986774 2023-02-12 23:03:06,774 DEBUG [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f2 2023-02-12 23:03:06,775 DEBUG [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f2 2023-02-12 23:03:06,775 INFO [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63f710c49b8d97bffccc8db53e57829b columnFamilyName f2 2023-02-12 23:03:06,776 INFO [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] regionserver.HStore(310): Store=63f710c49b8d97bffccc8db53e57829b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8., pid=29, masterSystemTime=1676242986731 2023-02-12 23:03:06,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:06,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:06,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:06,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:06,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:06,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9b749c60a6e32651a314656be4e49b03, NAME => 'testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-12 23:03:06,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:06,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:06,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:06,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:06,784 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=469c8d8500abd7ead7bb9f7741b8add8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:06,785 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986784"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676242986784"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676242986784"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676242986784"}]},"ts":"1676242986784"} 2023-02-12 23:03:06,786 INFO [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:06,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:06,789 DEBUG [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f1 2023-02-12 23:03:06,789 DEBUG [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f1 2023-02-12 23:03:06,790 INFO [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b749c60a6e32651a314656be4e49b03 columnFamilyName f1 2023-02-12 23:03:06,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:06,790 INFO [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] regionserver.HStore(310): Store=9b749c60a6e32651a314656be4e49b03/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,791 INFO [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:06,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=18 2023-02-12 23:03:06,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=18, state=SUCCESS; OpenRegionProcedure 469c8d8500abd7ead7bb9f7741b8add8, server=jenkins-hbase4.apache.org,37521,1676242981734 in 215 msec 2023-02-12 23:03:06,794 DEBUG [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f2 2023-02-12 23:03:06,794 DEBUG [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f2 2023-02-12 23:03:06,795 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=469c8d8500abd7ead7bb9f7741b8add8, ASSIGN in 407 msec 2023-02-12 23:03:06,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:06,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 63f710c49b8d97bffccc8db53e57829b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73079952, jitterRate=0.08897614479064941}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:06,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 63f710c49b8d97bffccc8db53e57829b: Running coprocessor pre-open hook at 1676242986759Writing region info on filesystem at 1676242986759Initializing all the Stores at 1676242986761 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986761Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986761Cleaning up temporary data from old regions at 1676242986784 (+23 ms)Cleaning up detritus from prior splits at 1676242986785 (+1 ms)Running coprocessor post-open hooks at 1676242986796 (+11 ms)Region opened successfully at 1676242986796 2023-02-12 23:03:06,797 INFO [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b749c60a6e32651a314656be4e49b03 columnFamilyName f2 2023-02-12 23:03:06,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b., pid=24, masterSystemTime=1676242986705 2023-02-12 23:03:06,798 INFO [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] regionserver.HStore(310): Store=9b749c60a6e32651a314656be4e49b03/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:06,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:06,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:06,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:06,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:06,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 54b311bf6f51ce93e536f6a73aa344d5, NAME => 'testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-12 23:03:06,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:06,803 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=63f710c49b8d97bffccc8db53e57829b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:06,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:06,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:06,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:06,803 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986802"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676242986802"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676242986802"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676242986802"}]},"ts":"1676242986802"} 2023-02-12 23:03:06,807 INFO [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:06,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:06,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:06,813 DEBUG [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5/f1 2023-02-12 23:03:06,813 DEBUG [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5/f1 2023-02-12 23:03:06,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=17 2023-02-12 23:03:06,814 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=17, state=SUCCESS; OpenRegionProcedure 63f710c49b8d97bffccc8db53e57829b, server=jenkins-hbase4.apache.org,43299,1676242981781 in 251 msec 2023-02-12 23:03:06,814 INFO [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54b311bf6f51ce93e536f6a73aa344d5 columnFamilyName f1 2023-02-12 23:03:06,815 INFO [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] regionserver.HStore(310): Store=54b311bf6f51ce93e536f6a73aa344d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,815 INFO [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:06,816 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=63f710c49b8d97bffccc8db53e57829b, ASSIGN in 428 msec 2023-02-12 23:03:06,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:06,818 DEBUG [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5/f2 2023-02-12 23:03:06,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9b749c60a6e32651a314656be4e49b03; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73385735, jitterRate=0.09353266656398773}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:06,818 DEBUG [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5/f2 2023-02-12 23:03:06,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9b749c60a6e32651a314656be4e49b03: Running coprocessor pre-open hook at 1676242986784Writing region info on filesystem at 1676242986784Initializing all the Stores at 1676242986786 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986786Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986786Cleaning up temporary data from old regions at 1676242986804 (+18 ms)Cleaning up detritus from prior splits at 1676242986806 (+2 ms)Running coprocessor post-open hooks at 1676242986818 (+12 ms)Region opened successfully at 1676242986818 2023-02-12 23:03:06,818 INFO [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54b311bf6f51ce93e536f6a73aa344d5 columnFamilyName f2 2023-02-12 23:03:06,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03., pid=27, masterSystemTime=1676242986731 2023-02-12 23:03:06,820 INFO [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] regionserver.HStore(310): Store=54b311bf6f51ce93e536f6a73aa344d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:06,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:06,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:06,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:06,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:06,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 62973a244615f8a20fc71cb2630dab12, NAME => 'testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-12 23:03:06,825 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=9b749c60a6e32651a314656be4e49b03, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:06,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:06,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:06,825 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986825"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676242986825"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676242986825"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676242986825"}]},"ts":"1676242986825"} 2023-02-12 23:03:06,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:06,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:06,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:06,828 INFO [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:06,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:06,830 DEBUG [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f1 2023-02-12 23:03:06,831 DEBUG [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f1 2023-02-12 23:03:06,831 INFO [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62973a244615f8a20fc71cb2630dab12 columnFamilyName f1 2023-02-12 23:03:06,832 INFO [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] regionserver.HStore(310): Store=62973a244615f8a20fc71cb2630dab12/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,832 INFO [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:06,833 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=15 2023-02-12 23:03:06,833 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=15, state=SUCCESS; OpenRegionProcedure 9b749c60a6e32651a314656be4e49b03, server=jenkins-hbase4.apache.org,37521,1676242981734 in 261 msec 2023-02-12 23:03:06,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:06,835 DEBUG [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f2 2023-02-12 23:03:06,835 DEBUG [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f2 2023-02-12 23:03:06,836 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9b749c60a6e32651a314656be4e49b03, ASSIGN in 448 msec 2023-02-12 23:03:06,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 54b311bf6f51ce93e536f6a73aa344d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72434145, jitterRate=0.07935287058353424}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:06,836 INFO [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62973a244615f8a20fc71cb2630dab12 columnFamilyName f2 2023-02-12 23:03:06,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 54b311bf6f51ce93e536f6a73aa344d5: Running coprocessor pre-open hook at 1676242986803Writing region info on filesystem at 1676242986803Initializing all the Stores at 1676242986807 (+4 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986807Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986807Cleaning up temporary data from old regions at 1676242986824 (+17 ms)Cleaning up detritus from prior splits at 1676242986824Running coprocessor post-open hooks at 1676242986836 (+12 ms)Region opened successfully at 1676242986836 2023-02-12 23:03:06,837 INFO [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] regionserver.HStore(310): Store=62973a244615f8a20fc71cb2630dab12/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5., pid=23, masterSystemTime=1676242986705 2023-02-12 23:03:06,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:06,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:06,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:06,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:06,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:06,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c7a8820caf3f3a0e38f5db61bfdd43a7, NAME => 'testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-12 23:03:06,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:06,841 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=54b311bf6f51ce93e536f6a73aa344d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:06,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:06,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:06,841 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676242986841"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676242986841"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676242986841"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676242986841"}]},"ts":"1676242986841"} 2023-02-12 23:03:06,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:06,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:06,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:06,847 INFO [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:06,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-12 23:03:06,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure 54b311bf6f51ce93e536f6a73aa344d5, server=jenkins-hbase4.apache.org,43299,1676242981781 in 290 msec 2023-02-12 23:03:06,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=54b311bf6f51ce93e536f6a73aa344d5, ASSIGN in 463 msec 2023-02-12 23:03:06,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:06,850 DEBUG [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f1 2023-02-12 23:03:06,850 DEBUG [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f1 2023-02-12 23:03:06,851 INFO [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7a8820caf3f3a0e38f5db61bfdd43a7 columnFamilyName f1 2023-02-12 23:03:06,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 62973a244615f8a20fc71cb2630dab12; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65648444, jitterRate=-0.021761953830718994}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:06,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 62973a244615f8a20fc71cb2630dab12: Running coprocessor pre-open hook at 1676242986825Writing region info on filesystem at 1676242986825Initializing all the Stores at 1676242986828 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986828Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986828Cleaning up temporary data from old regions at 1676242986841 (+13 ms)Cleaning up detritus from prior splits at 1676242986842 (+1 ms)Running coprocessor post-open hooks at 1676242986852 (+10 ms)Region opened successfully at 1676242986852 2023-02-12 23:03:06,852 INFO [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] regionserver.HStore(310): Store=c7a8820caf3f3a0e38f5db61bfdd43a7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,852 INFO [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:06,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12., pid=28, masterSystemTime=1676242986731 2023-02-12 23:03:06,854 DEBUG [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f2 2023-02-12 23:03:06,854 DEBUG [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f2 2023-02-12 23:03:06,854 INFO [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7a8820caf3f3a0e38f5db61bfdd43a7 columnFamilyName f2 2023-02-12 23:03:06,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:06,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:06,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:06,855 INFO [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] regionserver.HStore(310): Store=c7a8820caf3f3a0e38f5db61bfdd43a7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 804d2c90c6989424a49411184f0845d3, NAME => 'testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-12 23:03:06,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:06,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:06,861 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=62973a244615f8a20fc71cb2630dab12, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:06,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:06,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:06,861 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676242985738.62973a244615f8a20fc71cb2630dab12.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986860"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676242986860"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676242986860"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676242986860"}]},"ts":"1676242986860"} 2023-02-12 23:03:06,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:06,864 INFO [StoreOpener-804d2c90c6989424a49411184f0845d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:06,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:06,867 DEBUG [StoreOpener-804d2c90c6989424a49411184f0845d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3/f1 2023-02-12 23:03:06,867 DEBUG [StoreOpener-804d2c90c6989424a49411184f0845d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3/f1 2023-02-12 23:03:06,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-12 23:03:06,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure 62973a244615f8a20fc71cb2630dab12, server=jenkins-hbase4.apache.org,37521,1676242981734 in 293 msec 2023-02-12 23:03:06,868 INFO [StoreOpener-804d2c90c6989424a49411184f0845d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 804d2c90c6989424a49411184f0845d3 columnFamilyName f1 2023-02-12 23:03:06,869 INFO [StoreOpener-804d2c90c6989424a49411184f0845d3-1] regionserver.HStore(310): Store=804d2c90c6989424a49411184f0845d3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,869 INFO [StoreOpener-804d2c90c6989424a49411184f0845d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:06,870 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=62973a244615f8a20fc71cb2630dab12, ASSIGN in 482 msec 2023-02-12 23:03:06,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:06,872 DEBUG [StoreOpener-804d2c90c6989424a49411184f0845d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3/f2 2023-02-12 23:03:06,872 DEBUG [StoreOpener-804d2c90c6989424a49411184f0845d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3/f2 2023-02-12 23:03:06,872 INFO [StoreOpener-804d2c90c6989424a49411184f0845d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 804d2c90c6989424a49411184f0845d3 columnFamilyName f2 2023-02-12 23:03:06,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:06,873 INFO [StoreOpener-804d2c90c6989424a49411184f0845d3-1] regionserver.HStore(310): Store=804d2c90c6989424a49411184f0845d3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:06,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:06,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:06,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c7a8820caf3f3a0e38f5db61bfdd43a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65940074, jitterRate=-0.017416328191757202}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:06,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c7a8820caf3f3a0e38f5db61bfdd43a7: Running coprocessor pre-open hook at 1676242986842Writing region info on filesystem at 1676242986842Initializing all the Stores at 1676242986843 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986843Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986846 (+3 ms)Cleaning up temporary data from old regions at 1676242986869 (+23 ms)Cleaning up detritus from prior splits at 1676242986870 (+1 ms)Running coprocessor post-open hooks at 1676242986878 (+8 ms)Region opened successfully at 1676242986878 2023-02-12 23:03:06,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:06,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7., pid=22, masterSystemTime=1676242986705 2023-02-12 23:03:06,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:06,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:06,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:06,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:06,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:06,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 514afecf3a82c32469d46e77b9303717, NAME => 'testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-12 23:03:06,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:06,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:06,884 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=c7a8820caf3f3a0e38f5db61bfdd43a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:06,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:06,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:06,884 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986883"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676242986883"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676242986883"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676242986883"}]},"ts":"1676242986883"} 2023-02-12 23:03:06,888 INFO [StoreOpener-514afecf3a82c32469d46e77b9303717-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:06,890 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=19 2023-02-12 23:03:06,890 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; OpenRegionProcedure c7a8820caf3f3a0e38f5db61bfdd43a7, server=jenkins-hbase4.apache.org,43299,1676242981781 in 334 msec 2023-02-12 23:03:06,891 DEBUG [StoreOpener-514afecf3a82c32469d46e77b9303717-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f1 2023-02-12 23:03:06,891 DEBUG [StoreOpener-514afecf3a82c32469d46e77b9303717-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f1 2023-02-12 23:03:06,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:06,891 INFO [StoreOpener-514afecf3a82c32469d46e77b9303717-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 514afecf3a82c32469d46e77b9303717 columnFamilyName f1 2023-02-12 23:03:06,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 804d2c90c6989424a49411184f0845d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74192963, jitterRate=0.10556130111217499}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:06,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c7a8820caf3f3a0e38f5db61bfdd43a7, ASSIGN in 505 msec 2023-02-12 23:03:06,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 804d2c90c6989424a49411184f0845d3: Running coprocessor pre-open hook at 1676242986861Writing region info on filesystem at 1676242986861Initializing all the Stores at 1676242986864 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986864Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986864Cleaning up temporary data from old regions at 1676242986877 (+13 ms)Cleaning up detritus from prior splits at 1676242986878 (+1 ms)Running coprocessor post-open hooks at 1676242986893 (+15 ms)Region opened successfully at 1676242986893 2023-02-12 23:03:06,893 INFO [StoreOpener-514afecf3a82c32469d46e77b9303717-1] regionserver.HStore(310): Store=514afecf3a82c32469d46e77b9303717/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,893 INFO [StoreOpener-514afecf3a82c32469d46e77b9303717-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:06,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3., pid=30, masterSystemTime=1676242986731 2023-02-12 23:03:06,896 DEBUG [StoreOpener-514afecf3a82c32469d46e77b9303717-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f2 2023-02-12 23:03:06,896 DEBUG [StoreOpener-514afecf3a82c32469d46e77b9303717-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f2 2023-02-12 23:03:06,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:06,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:06,896 INFO [StoreOpener-514afecf3a82c32469d46e77b9303717-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 514afecf3a82c32469d46e77b9303717 columnFamilyName f2 2023-02-12 23:03:06,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:06,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2973c004b4284eb5f5a933a977f9b8b1, NAME => 'testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-12 23:03:06,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:06,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:06,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:06,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:06,897 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=804d2c90c6989424a49411184f0845d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:06,898 INFO [StoreOpener-514afecf3a82c32469d46e77b9303717-1] regionserver.HStore(310): Store=514afecf3a82c32469d46e77b9303717/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,898 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676242986897"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676242986897"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676242986897"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676242986897"}]},"ts":"1676242986897"} 2023-02-12 23:03:06,900 INFO [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:06,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:06,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:06,903 DEBUG [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f1 2023-02-12 23:03:06,903 DEBUG [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f1 2023-02-12 23:03:06,904 INFO [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2973c004b4284eb5f5a933a977f9b8b1 columnFamilyName f1 2023-02-12 23:03:06,904 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=20 2023-02-12 23:03:06,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:06,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=20, state=SUCCESS; OpenRegionProcedure 804d2c90c6989424a49411184f0845d3, server=jenkins-hbase4.apache.org,37521,1676242981734 in 320 msec 2023-02-12 23:03:06,905 INFO [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] regionserver.HStore(310): Store=2973c004b4284eb5f5a933a977f9b8b1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,906 INFO [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:06,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:06,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=804d2c90c6989424a49411184f0845d3, ASSIGN in 520 msec 2023-02-12 23:03:06,910 DEBUG [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f2 2023-02-12 23:03:06,910 DEBUG [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f2 2023-02-12 23:03:06,910 INFO [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2973c004b4284eb5f5a933a977f9b8b1 columnFamilyName f2 2023-02-12 23:03:06,911 INFO [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] regionserver.HStore(310): Store=2973c004b4284eb5f5a933a977f9b8b1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:06,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:06,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:06,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:06,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 514afecf3a82c32469d46e77b9303717; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68670712, jitterRate=0.023273348808288574}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:06,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 514afecf3a82c32469d46e77b9303717: Running coprocessor pre-open hook at 1676242986884Writing region info on filesystem at 1676242986884Initializing all the Stores at 1676242986885 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986886 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986888 (+2 ms)Cleaning up temporary data from old regions at 1676242986902 (+14 ms)Cleaning up detritus from prior splits at 1676242986903 (+1 ms)Running coprocessor post-open hooks at 1676242986914 (+11 ms)Region opened successfully at 1676242986914 2023-02-12 23:03:06,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717., pid=21, masterSystemTime=1676242986705 2023-02-12 23:03:06,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:06,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:06,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:06,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:06,919 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=514afecf3a82c32469d46e77b9303717, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:06,919 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676242985738.514afecf3a82c32469d46e77b9303717.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986919"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676242986919"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676242986919"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676242986919"}]},"ts":"1676242986919"} 2023-02-12 23:03:06,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:06,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2973c004b4284eb5f5a933a977f9b8b1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68624356, jitterRate=0.022582590579986572}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:06,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2973c004b4284eb5f5a933a977f9b8b1: Running coprocessor pre-open hook at 1676242986897Writing region info on filesystem at 1676242986897Initializing all the Stores at 1676242986899 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986899Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242986900 (+1 ms)Cleaning up temporary data from old regions at 1676242986914 (+14 ms)Cleaning up detritus from prior splits at 1676242986915 (+1 ms)Running coprocessor post-open hooks at 1676242986923 (+8 ms)Region opened successfully at 1676242986923 2023-02-12 23:03:06,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1., pid=26, masterSystemTime=1676242986731 2023-02-12 23:03:06,925 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-12 23:03:06,925 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure 514afecf3a82c32469d46e77b9303717, server=jenkins-hbase4.apache.org,43299,1676242981781 in 370 msec 2023-02-12 23:03:06,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:06,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:06,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=514afecf3a82c32469d46e77b9303717, ASSIGN in 540 msec 2023-02-12 23:03:06,928 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2973c004b4284eb5f5a933a977f9b8b1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:06,928 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242986928"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676242986928"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676242986928"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676242986928"}]},"ts":"1676242986928"} 2023-02-12 23:03:06,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=16 2023-02-12 23:03:06,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=16, state=SUCCESS; OpenRegionProcedure 2973c004b4284eb5f5a933a977f9b8b1, server=jenkins-hbase4.apache.org,37521,1676242981734 in 365 msec 2023-02-12 23:03:06,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-12 23:03:06,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2973c004b4284eb5f5a933a977f9b8b1, ASSIGN in 548 msec 2023-02-12 23:03:06,937 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 23:03:06,937 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676242986937"}]},"ts":"1676242986937"} 2023-02-12 23:03:06,939 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-12 23:03:06,943 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 23:03:06,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.2000 sec 2023-02-12 23:03:07,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:07,886 INFO [Listener at localhost/35801] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-12 23:03:07,886 DEBUG [Listener at localhost/35801] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-12 23:03:07,888 INFO [Listener at localhost/35801] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 23:03:07,901 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-12 23:03:07,902 INFO [Listener at localhost/35801] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 23:03:07,902 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-12 23:03:07,902 INFO [Listener at localhost/35801] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 23:03:08,061 DEBUG [hconnection-0x254e1275-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:08,120 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49316, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:08,166 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37521] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:08,167 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:08,426 INFO [Listener at localhost/35801] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 23:03:08,429 INFO [Listener at localhost/35801] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 23:03:08,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 23:03:08,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676242988440 (current time:1676242988440). 2023-02-12 23:03:08,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 23:03:08,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] zookeeper.ReadOnlyZKClient(139): Connect 0x31135813 to 127.0.0.1:56729 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:08,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b3caef1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:08,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:08,452 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59986, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:08,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31135813 to 127.0.0.1:56729 2023-02-12 23:03:08,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:08,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 23:03:08,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 23:03:08,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 23:03:08,477 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 23:03:08,479 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676243588478 2023-02-12 23:03:08,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 23:03:08,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-12 23:03:08,481 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 23:03:08,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 23:03:08,486 DEBUG [Listener at localhost/35801] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 23:03:08,486 DEBUG [Listener at localhost/35801] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 23:03:08,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 12 msec 2023-02-12 23:03:08,487 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 23:03:08,488 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676243588488 2023-02-12 23:03:08,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-12 23:03:08,516 INFO [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-12 23:03:08,516 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:08,517 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-12 23:03:08,517 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-12 23:03:08,518 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 23:03:08,518 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 23:03:08,520 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:08,520 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:08,520 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:08,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:08,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:08,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:08,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:08,521 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:08,521 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:08,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 23:03:08,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 23:03:08,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 23:03:08,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 23:03:08,522 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:08,522 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 23:03:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-12 23:03:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-12 23:03:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 23:03:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 23:03:08,522 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 23:03:08,523 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 23:03:08,525 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-12 23:03:08,525 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-12 23:03:08,526 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-12 23:03:08,526 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:08,528 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 23:03:08,528 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-12 23:03:08,528 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-12 23:03:08,528 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:08,528 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37521,1676242981734' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-12 23:03:08,529 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 23:03:08,529 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-12 23:03:08,529 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43299,1676242981781' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-12 23:03:08,531 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 23:03:08,531 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:08,531 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:08,531 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 23:03:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:08,532 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 23:03:08,532 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 23:03:08,532 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:08,532 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:08,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:08,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 23:03:08,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:08,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43299,1676242981781' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-12 23:03:08,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1778f70f[Count = 1] remaining members to acquire global barrier 2023-02-12 23:03:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:08,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 23:03:08,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:08,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:08,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:08,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37521,1676242981734' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-12 23:03:08,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1778f70f[Count = 0] remaining members to acquire global barrier 2023-02-12 23:03:08,537 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-12 23:03:08,537 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 23:03:08,539 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 23:03:08,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 23:03:08,539 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 23:03:08,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 23:03:08,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 23:03:08,539 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 23:03:08,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 23:03:08,539 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 23:03:08,539 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:08,540 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:08,540 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 23:03:08,541 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:08,541 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:08,541 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:08,541 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:08,541 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. started... 2023-02-12 23:03:08,541 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. started... 2023-02-12 23:03:08,541 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. started... 2023-02-12 23:03:08,541 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. started... 2023-02-12 23:03:08,544 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 23:03:08,544 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 23:03:08,544 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 63f710c49b8d97bffccc8db53e57829b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:08,544 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c7a8820caf3f3a0e38f5db61bfdd43a7 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 23:03:08,544 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 62973a244615f8a20fc71cb2630dab12 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:08,544 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:08,545 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. started... 2023-02-12 23:03:08,545 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 23:03:08,545 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:08,544 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 23:03:08,544 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 469c8d8500abd7ead7bb9f7741b8add8 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:08,546 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. started... 2023-02-12 23:03:08,547 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 54ca3cdd0d82711860e6a784b596d4ab 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 23:03:08,547 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 804d2c90c6989424a49411184f0845d3: 2023-02-12 23:03:08,548 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:08,553 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:08,557 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 23:03:08,557 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 23:03:08,586 DEBUG [Listener at localhost/35801] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:08,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 23:03:08,591 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. completed. 2023-02-12 23:03:08,591 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:08,592 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:08,592 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 23:03:08,592 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. started... 2023-02-12 23:03:08,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 23:03:08,593 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 2973c004b4284eb5f5a933a977f9b8b1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:08,593 DEBUG [Listener at localhost/35801] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 23:03:08,752 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/.tmp/f1/9e69833931944e849f9b1f879aa51204 2023-02-12 23:03:08,753 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/.tmp/f1/c82ce22e2d774f1b861d5989b5b17f38 2023-02-12 23:03:08,758 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/.tmp/f1/e507719e896342dabae4d60b658b1b64 2023-02-12 23:03:08,759 WARN [DataStreamer for file /user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/.tmp/f1/a157af2f073f420a9f9d532fb70320f1] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-12 23:03:08,759 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/.tmp/f1/a157af2f073f420a9f9d532fb70320f1 2023-02-12 23:03:08,761 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/.tmp/f1/85952e18553c4fd2b63e577dc9645caf 2023-02-12 23:03:08,794 DEBUG [Listener at localhost/35801] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:08,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 23:03:08,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 23:03:08,796 DEBUG [Listener at localhost/35801] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 23:03:08,888 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/.tmp/f2/2884d202f88c4315b89593f89f06e71d 2023-02-12 23:03:08,901 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/.tmp/f2/14f4433d83a2460c91eb5da27d708a3e 2023-02-12 23:03:08,901 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/.tmp/f2/4bea40524ffc4b30a06e1655038df708 2023-02-12 23:03:08,911 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/.tmp/f1/e507719e896342dabae4d60b658b1b64 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f1/e507719e896342dabae4d60b658b1b64 2023-02-12 23:03:08,914 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/.tmp/f1/85952e18553c4fd2b63e577dc9645caf as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f1/85952e18553c4fd2b63e577dc9645caf 2023-02-12 23:03:08,915 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/.tmp/f1/9e69833931944e849f9b1f879aa51204 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f1/9e69833931944e849f9b1f879aa51204 2023-02-12 23:03:08,923 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f1/e507719e896342dabae4d60b658b1b64, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 23:03:08,924 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f1/85952e18553c4fd2b63e577dc9645caf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:08,927 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f1/9e69833931944e849f9b1f879aa51204, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 23:03:08,927 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/.tmp/f2/2884d202f88c4315b89593f89f06e71d as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f2/2884d202f88c4315b89593f89f06e71d 2023-02-12 23:03:08,928 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/.tmp/f2/4bea40524ffc4b30a06e1655038df708 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f2/4bea40524ffc4b30a06e1655038df708 2023-02-12 23:03:08,928 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/.tmp/f2/14f4433d83a2460c91eb5da27d708a3e as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f2/14f4433d83a2460c91eb5da27d708a3e 2023-02-12 23:03:08,938 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f2/4bea40524ffc4b30a06e1655038df708, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:08,939 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 62973a244615f8a20fc71cb2630dab12 in 395ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:08,942 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-12 23:03:08,943 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f2/2884d202f88c4315b89593f89f06e71d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 23:03:08,944 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 62973a244615f8a20fc71cb2630dab12: 2023-02-12 23:03:08,944 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:08,944 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:08,944 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f1/85952e18553c4fd2b63e577dc9645caf] hfiles 2023-02-12 23:03:08,944 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f1/85952e18553c4fd2b63e577dc9645caf for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:08,945 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 54ca3cdd0d82711860e6a784b596d4ab in 398ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:08,946 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 54ca3cdd0d82711860e6a784b596d4ab: 2023-02-12 23:03:08,946 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:08,946 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:08,946 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f1/e507719e896342dabae4d60b658b1b64] hfiles 2023-02-12 23:03:08,946 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f1/e507719e896342dabae4d60b658b1b64 for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:08,949 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f2/14f4433d83a2460c91eb5da27d708a3e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 23:03:08,950 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f2/2884d202f88c4315b89593f89f06e71d] hfiles 2023-02-12 23:03:08,950 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for c7a8820caf3f3a0e38f5db61bfdd43a7 in 406ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:08,950 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f2/4bea40524ffc4b30a06e1655038df708] hfiles 2023-02-12 23:03:08,950 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c7a8820caf3f3a0e38f5db61bfdd43a7: 2023-02-12 23:03:08,950 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f2/2884d202f88c4315b89593f89f06e71d for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:08,950 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f2/4bea40524ffc4b30a06e1655038df708 for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:08,951 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:08,951 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:08,951 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f1/9e69833931944e849f9b1f879aa51204] hfiles 2023-02-12 23:03:08,951 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f1/9e69833931944e849f9b1f879aa51204 for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:08,951 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f2/14f4433d83a2460c91eb5da27d708a3e] hfiles 2023-02-12 23:03:08,951 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f2/14f4433d83a2460c91eb5da27d708a3e for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:08,986 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. completed. 2023-02-12 23:03:08,986 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:08,986 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:08,986 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 23:03:08,987 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. completed. 2023-02-12 23:03:08,987 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:08,987 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:08,987 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. started... 2023-02-12 23:03:08,986 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. started... 2023-02-12 23:03:08,987 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 23:03:08,988 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 54b311bf6f51ce93e536f6a73aa344d5: 2023-02-12 23:03:08,989 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:08,988 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 9b749c60a6e32651a314656be4e49b03 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:08,989 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:08,989 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 23:03:08,989 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 23:03:09,009 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. completed. 2023-02-12 23:03:09,009 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:09,009 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:09,009 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 23:03:09,009 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. started... 2023-02-12 23:03:09,010 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 514afecf3a82c32469d46e77b9303717 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:09,012 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/.tmp/f1/380a44d1defe4b41a0122bdc9dedfa6a 2023-02-12 23:03:09,037 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/.tmp/f1/775e400f2b0048afb7b9b626e6477721 2023-02-12 23:03:09,053 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/.tmp/f2/9dfb191111cb44c399fc66732e0852fe 2023-02-12 23:03:09,063 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/.tmp/f2/caa3049ed9ed4390b1fa3fa199fc8dca 2023-02-12 23:03:09,064 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/.tmp/f1/380a44d1defe4b41a0122bdc9dedfa6a as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f1/380a44d1defe4b41a0122bdc9dedfa6a 2023-02-12 23:03:09,071 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f1/380a44d1defe4b41a0122bdc9dedfa6a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:09,072 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/.tmp/f1/775e400f2b0048afb7b9b626e6477721 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f1/775e400f2b0048afb7b9b626e6477721 2023-02-12 23:03:09,072 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/.tmp/f2/9dfb191111cb44c399fc66732e0852fe as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f2/9dfb191111cb44c399fc66732e0852fe 2023-02-12 23:03:09,081 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f2/9dfb191111cb44c399fc66732e0852fe, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:09,083 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f1/775e400f2b0048afb7b9b626e6477721, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:09,085 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/.tmp/f2/caa3049ed9ed4390b1fa3fa199fc8dca as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f2/caa3049ed9ed4390b1fa3fa199fc8dca 2023-02-12 23:03:09,085 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9b749c60a6e32651a314656be4e49b03 in 97ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:09,085 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 9b749c60a6e32651a314656be4e49b03: 2023-02-12 23:03:09,086 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:09,086 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:09,086 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f1/380a44d1defe4b41a0122bdc9dedfa6a] hfiles 2023-02-12 23:03:09,086 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f1/380a44d1defe4b41a0122bdc9dedfa6a for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:09,086 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f2/9dfb191111cb44c399fc66732e0852fe] hfiles 2023-02-12 23:03:09,086 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f2/9dfb191111cb44c399fc66732e0852fe for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:09,097 DEBUG [Listener at localhost/35801] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:09,097 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f2/caa3049ed9ed4390b1fa3fa199fc8dca, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:09,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 23:03:09,098 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 514afecf3a82c32469d46e77b9303717 in 88ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:09,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 23:03:09,099 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 514afecf3a82c32469d46e77b9303717: 2023-02-12 23:03:09,099 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:09,099 DEBUG [Listener at localhost/35801] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 23:03:09,099 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:09,099 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f1/775e400f2b0048afb7b9b626e6477721] hfiles 2023-02-12 23:03:09,099 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f1/775e400f2b0048afb7b9b626e6477721 for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:09,099 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f2/caa3049ed9ed4390b1fa3fa199fc8dca] hfiles 2023-02-12 23:03:09,099 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f2/caa3049ed9ed4390b1fa3fa199fc8dca for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:09,116 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. completed. 2023-02-12 23:03:09,116 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:09,116 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 23:03:09,127 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. completed. 2023-02-12 23:03:09,127 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:09,127 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 23:03:09,152 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/.tmp/f1/7898be7957364556abe9dea7fa31eee2 2023-02-12 23:03:09,176 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/.tmp/f2/d130866abfed4d579bf75a832b924420 2023-02-12 23:03:09,184 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/.tmp/f1/7898be7957364556abe9dea7fa31eee2 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f1/7898be7957364556abe9dea7fa31eee2 2023-02-12 23:03:09,191 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f1/7898be7957364556abe9dea7fa31eee2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:09,193 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/.tmp/f2/d130866abfed4d579bf75a832b924420 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f2/d130866abfed4d579bf75a832b924420 2023-02-12 23:03:09,200 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f2/d130866abfed4d579bf75a832b924420, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:09,202 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 63f710c49b8d97bffccc8db53e57829b in 658ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:09,202 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 63f710c49b8d97bffccc8db53e57829b: 2023-02-12 23:03:09,202 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:09,202 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:09,202 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f1/7898be7957364556abe9dea7fa31eee2] hfiles 2023-02-12 23:03:09,202 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f1/7898be7957364556abe9dea7fa31eee2 for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:09,202 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f2/d130866abfed4d579bf75a832b924420] hfiles 2023-02-12 23:03:09,202 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f2/d130866abfed4d579bf75a832b924420 for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:09,218 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. completed. 2023-02-12 23:03:09,218 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:09,218 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 23:03:09,297 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/.tmp/f2/381da499ae9249d494d75edc3f72f95e 2023-02-12 23:03:09,299 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/.tmp/f2/b37580da29054810ad3d2c1613f6f947 2023-02-12 23:03:09,307 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/.tmp/f1/a157af2f073f420a9f9d532fb70320f1 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f1/a157af2f073f420a9f9d532fb70320f1 2023-02-12 23:03:09,308 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/.tmp/f1/c82ce22e2d774f1b861d5989b5b17f38 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f1/c82ce22e2d774f1b861d5989b5b17f38 2023-02-12 23:03:09,315 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f1/c82ce22e2d774f1b861d5989b5b17f38, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:09,316 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f1/a157af2f073f420a9f9d532fb70320f1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:09,316 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/.tmp/f2/b37580da29054810ad3d2c1613f6f947 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f2/b37580da29054810ad3d2c1613f6f947 2023-02-12 23:03:09,317 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/.tmp/f2/381da499ae9249d494d75edc3f72f95e as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f2/381da499ae9249d494d75edc3f72f95e 2023-02-12 23:03:09,324 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f2/b37580da29054810ad3d2c1613f6f947, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:09,324 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f2/381da499ae9249d494d75edc3f72f95e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:09,325 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2973c004b4284eb5f5a933a977f9b8b1 in 732ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:09,325 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 469c8d8500abd7ead7bb9f7741b8add8 in 781ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:09,325 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 2973c004b4284eb5f5a933a977f9b8b1: 2023-02-12 23:03:09,325 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 469c8d8500abd7ead7bb9f7741b8add8: 2023-02-12 23:03:09,326 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:09,326 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:09,326 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:09,326 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:09,326 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f1/c82ce22e2d774f1b861d5989b5b17f38] hfiles 2023-02-12 23:03:09,326 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f1/a157af2f073f420a9f9d532fb70320f1] hfiles 2023-02-12 23:03:09,326 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f1/c82ce22e2d774f1b861d5989b5b17f38 for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:09,326 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f1/a157af2f073f420a9f9d532fb70320f1 for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:09,326 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f2/b37580da29054810ad3d2c1613f6f947] hfiles 2023-02-12 23:03:09,326 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f2/381da499ae9249d494d75edc3f72f95e] hfiles 2023-02-12 23:03:09,326 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f2/b37580da29054810ad3d2c1613f6f947 for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:09,326 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f2/381da499ae9249d494d75edc3f72f95e for snapshot=testWithMapReduceMultiRegion 2023-02-12 23:03:09,343 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. completed. 2023-02-12 23:03:09,343 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:09,343 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 23:03:09,344 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. completed. 2023-02-12 23:03:09,344 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:09,344 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 23:03:09,344 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 23:03:09,344 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:09,345 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-12 23:03:09,345 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,37521,1676242981734' in zk 2023-02-12 23:03:09,348 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:09,348 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-12 23:03:09,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:09,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:09,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:09,348 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:09,349 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-12 23:03:09,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:09,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:09,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 23:03:09,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:09,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:09,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:09,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 23:03:09,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:09,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,37521,1676242981734': 2023-02-12 23:03:09,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37521,1676242981734' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 23:03:09,388 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. completed. 2023-02-12 23:03:09,388 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:09,388 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 23:03:09,388 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 23:03:09,389 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:09,389 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-12 23:03:09,389 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43299,1676242981781' in zk 2023-02-12 23:03:09,392 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-12 23:03:09,392 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:09,392 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:09,392 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-12 23:03:09,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:09,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:09,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:09,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:09,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:09,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 23:03:09,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:09,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:09,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:09,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 23:03:09,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:09,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:09,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43299,1676242981781': 2023-02-12 23:03:09,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43299,1676242981781' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 23:03:09,397 INFO [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-12 23:03:09,397 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 23:03:09,397 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 23:03:09,397 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-12 23:03:09,397 INFO [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 23:03:09,400 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 23:03:09,400 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 23:03:09,400 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 23:03:09,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 23:03:09,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 23:03:09,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:09,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 23:03:09,400 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:09,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 23:03:09,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 23:03:09,400 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:09,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:09,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:09,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:09,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:09,401 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:09,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:09,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:09,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 23:03:09,402 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:09,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 23:03:09,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 23:03:09,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:09,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 23:03:09,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:09,405 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:09,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:09,405 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:09,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:09,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 23:03:09,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:09,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:09,424 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:09,424 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:09,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:09,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:09,425 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:09,425 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:09,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:09,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:09,432 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:09,432 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 23:03:09,432 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:09,432 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 23:03:09,432 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:09,432 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:09,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:09,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:09,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:09,437 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-12 23:03:09,432 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 23:03:09,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:09,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-12 23:03:09,437 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:09,438 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 23:03:09,438 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 23:03:09,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-12 23:03:09,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-12 23:03:09,551 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-12 23:03:09,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-12 23:03:09,551 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-12 23:03:09,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676242988479Consolidate snapshot: testWithMapReduceMultiRegion at 1676242989438 (+959 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676242989438Writing data manifest for testWithMapReduceMultiRegion at 1676242989463 (+25 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676242989483 (+20 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676242989551 (+68 ms) 2023-02-12 23:03:09,553 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 23:03:09,555 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.0720 sec 2023-02-12 23:03:09,599 DEBUG [Listener at localhost/35801] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:09,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 23:03:09,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 23:03:09,602 INFO [Listener at localhost/35801] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 23:03:09,614 INFO [Listener at localhost/35801] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 23:03:09,626 INFO [Listener at localhost/35801] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 23:03:09,704 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37521] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:09,708 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:09,833 INFO [Listener at localhost/35801] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 23:03:09,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 23:03:09,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-12 23:03:09,857 INFO [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-12 23:03:09,857 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:09,858 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-12 23:03:09,858 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-12 23:03:09,859 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:09,859 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:09,861 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:09,861 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:09,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:09,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:09,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:09,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:09,861 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:09,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:09,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:09,862 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:09,862 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:09,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:09,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:09,862 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:09,863 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 23:03:09,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 23:03:09,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:09,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 23:03:09,863 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 23:03:09,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:09,863 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 23:03:09,864 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 23:03:09,864 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 23:03:09,865 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 23:03:09,865 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:09,869 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 23:03:09,869 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 23:03:09,869 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:09,869 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 23:03:09,870 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:09,870 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. started... 2023-02-12 23:03:09,870 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 63f710c49b8d97bffccc8db53e57829b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:09,871 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:09,871 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. started... 2023-02-12 23:03:09,871 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 469c8d8500abd7ead7bb9f7741b8add8 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:09,872 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:09,872 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. started... 2023-02-12 23:03:09,872 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c7a8820caf3f3a0e38f5db61bfdd43a7 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 23:03:09,874 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:09,874 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. started... 2023-02-12 23:03:09,874 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 62973a244615f8a20fc71cb2630dab12 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:09,876 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 23:03:09,876 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 23:03:09,876 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:09,876 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:09,876 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 23:03:09,876 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 23:03:09,876 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. started... 2023-02-12 23:03:09,876 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. started... 2023-02-12 23:03:09,876 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 54ca3cdd0d82711860e6a784b596d4ab 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 23:03:09,876 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 804d2c90c6989424a49411184f0845d3: 2023-02-12 23:03:09,876 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:09,877 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:09,877 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. started... 2023-02-12 23:03:09,877 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 23:03:09,877 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 2973c004b4284eb5f5a933a977f9b8b1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:09,976 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/.tmp/f1/0c538667139f452793c4bb2e2f09ba99 2023-02-12 23:03:09,982 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/.tmp/f1/cdd3358cf4f44d4fa4b47cd2b3e3c2d0 2023-02-12 23:03:09,982 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/.tmp/f1/eba2eb1e4dc34b60bebdf0c5360d2cc9 2023-02-12 23:03:09,982 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/.tmp/f1/a8017410de2843269089bfe29fa7baa7 2023-02-12 23:03:09,992 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/.tmp/f1/572f6d5935994b9383b829f1797c6641 2023-02-12 23:03:10,028 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/.tmp/f2/d15ef581514a413a844499a06d8201a2 2023-02-12 23:03:10,036 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/.tmp/f2/abe9d9f891a24f16a7f5daceb29cef55 2023-02-12 23:03:10,036 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/.tmp/f2/4b360e09e02b4a6f81b168f9cf8371df 2023-02-12 23:03:10,037 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/.tmp/f1/cdd3358cf4f44d4fa4b47cd2b3e3c2d0 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f1/cdd3358cf4f44d4fa4b47cd2b3e3c2d0 2023-02-12 23:03:10,044 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f1/cdd3358cf4f44d4fa4b47cd2b3e3c2d0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:10,045 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/.tmp/f1/a8017410de2843269089bfe29fa7baa7 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f1/a8017410de2843269089bfe29fa7baa7 2023-02-12 23:03:10,045 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/.tmp/f1/572f6d5935994b9383b829f1797c6641 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f1/572f6d5935994b9383b829f1797c6641 2023-02-12 23:03:10,046 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/.tmp/f2/d15ef581514a413a844499a06d8201a2 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f2/d15ef581514a413a844499a06d8201a2 2023-02-12 23:03:10,052 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f1/a8017410de2843269089bfe29fa7baa7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 23:03:10,052 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f1/572f6d5935994b9383b829f1797c6641, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:10,053 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/.tmp/f2/4b360e09e02b4a6f81b168f9cf8371df as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f2/4b360e09e02b4a6f81b168f9cf8371df 2023-02-12 23:03:10,054 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f2/d15ef581514a413a844499a06d8201a2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:10,054 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/.tmp/f2/abe9d9f891a24f16a7f5daceb29cef55 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f2/abe9d9f891a24f16a7f5daceb29cef55 2023-02-12 23:03:10,056 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 63f710c49b8d97bffccc8db53e57829b in 185ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:10,056 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 63f710c49b8d97bffccc8db53e57829b: 2023-02-12 23:03:10,056 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:10,057 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 23:03:10,057 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:10,057 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. started... 2023-02-12 23:03:10,057 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/.tmp/f2/37bf1b5da85d46ccb092d3488b08def0 2023-02-12 23:03:10,057 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 54b311bf6f51ce93e536f6a73aa344d5: 2023-02-12 23:03:10,057 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:10,057 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 23:03:10,057 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:10,057 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. started... 2023-02-12 23:03:10,060 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 514afecf3a82c32469d46e77b9303717 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:10,063 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/.tmp/f2/096ce9e4a76d4c048793866910ad6eea 2023-02-12 23:03:10,065 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f2/abe9d9f891a24f16a7f5daceb29cef55, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:10,067 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2973c004b4284eb5f5a933a977f9b8b1 in 190ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:10,067 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2973c004b4284eb5f5a933a977f9b8b1: 2023-02-12 23:03:10,067 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:10,067 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:10,067 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 23:03:10,067 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. started... 2023-02-12 23:03:10,067 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9b749c60a6e32651a314656be4e49b03 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:10,071 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f2/4b360e09e02b4a6f81b168f9cf8371df, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 23:03:10,072 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 54ca3cdd0d82711860e6a784b596d4ab in 196ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:10,072 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 54ca3cdd0d82711860e6a784b596d4ab: 2023-02-12 23:03:10,072 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:10,072 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 23:03:10,074 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/.tmp/f1/eba2eb1e4dc34b60bebdf0c5360d2cc9 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f1/eba2eb1e4dc34b60bebdf0c5360d2cc9 2023-02-12 23:03:10,081 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f1/eba2eb1e4dc34b60bebdf0c5360d2cc9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:10,082 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/.tmp/f2/37bf1b5da85d46ccb092d3488b08def0 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f2/37bf1b5da85d46ccb092d3488b08def0 2023-02-12 23:03:10,084 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/.tmp/f1/0c538667139f452793c4bb2e2f09ba99 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f1/0c538667139f452793c4bb2e2f09ba99 2023-02-12 23:03:10,089 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f2/37bf1b5da85d46ccb092d3488b08def0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:10,090 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 469c8d8500abd7ead7bb9f7741b8add8 in 219ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:10,091 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 469c8d8500abd7ead7bb9f7741b8add8: 2023-02-12 23:03:10,091 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:10,091 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 23:03:10,092 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f1/0c538667139f452793c4bb2e2f09ba99, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:10,093 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/.tmp/f2/096ce9e4a76d4c048793866910ad6eea as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f2/096ce9e4a76d4c048793866910ad6eea 2023-02-12 23:03:10,095 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 23:03:10,102 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f2/096ce9e4a76d4c048793866910ad6eea, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:10,103 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 62973a244615f8a20fc71cb2630dab12 in 229ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:10,103 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 62973a244615f8a20fc71cb2630dab12: 2023-02-12 23:03:10,103 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:10,103 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 23:03:10,112 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/.tmp/f1/bdb7ce3f5dc148f5995c6c4647eb4ba2 2023-02-12 23:03:10,125 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/.tmp/f1/ed55a216e54c47f780d7a442229f10f1 2023-02-12 23:03:10,154 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/.tmp/f2/7286c6da594a45cea02f64bbd8eca45c 2023-02-12 23:03:10,164 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/.tmp/f1/bdb7ce3f5dc148f5995c6c4647eb4ba2 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f1/bdb7ce3f5dc148f5995c6c4647eb4ba2 2023-02-12 23:03:10,165 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/.tmp/f2/4e1fc3cabe2243f49f72bf183e05beed 2023-02-12 23:03:10,174 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/.tmp/f1/ed55a216e54c47f780d7a442229f10f1 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f1/ed55a216e54c47f780d7a442229f10f1 2023-02-12 23:03:10,174 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f1/bdb7ce3f5dc148f5995c6c4647eb4ba2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:10,176 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/.tmp/f2/7286c6da594a45cea02f64bbd8eca45c as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f2/7286c6da594a45cea02f64bbd8eca45c 2023-02-12 23:03:10,183 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f1/ed55a216e54c47f780d7a442229f10f1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:10,184 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/.tmp/f2/4e1fc3cabe2243f49f72bf183e05beed as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f2/4e1fc3cabe2243f49f72bf183e05beed 2023-02-12 23:03:10,189 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-12 23:03:10,191 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f2/7286c6da594a45cea02f64bbd8eca45c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:10,191 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-12 23:03:10,192 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 514afecf3a82c32469d46e77b9303717 in 135ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:10,192 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 514afecf3a82c32469d46e77b9303717: 2023-02-12 23:03:10,192 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:10,192 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 23:03:10,193 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f2/4e1fc3cabe2243f49f72bf183e05beed, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:10,194 INFO [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9b749c60a6e32651a314656be4e49b03 in 127ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:10,194 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9b749c60a6e32651a314656be4e49b03: 2023-02-12 23:03:10,194 DEBUG [rs(jenkins-hbase4.apache.org,37521,1676242981734)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:10,194 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 23:03:10,194 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 23:03:10,194 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,195 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 23:03:10,195 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37521,1676242981734' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 23:03:10,197 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,197 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:10,198 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:10,198 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:10,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:10,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:10,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37521,1676242981734' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 23:03:10,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d0098d5[Count = 1] remaining members to acquire global barrier 2023-02-12 23:03:10,383 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/.tmp/f1/058ac748e9c343778f74488b11e06ccb 2023-02-12 23:03:10,402 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/.tmp/f2/e404ee9f5d2c4bb486dd94a0dfe32798 2023-02-12 23:03:10,408 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/.tmp/f1/058ac748e9c343778f74488b11e06ccb as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f1/058ac748e9c343778f74488b11e06ccb 2023-02-12 23:03:10,414 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f1/058ac748e9c343778f74488b11e06ccb, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 23:03:10,415 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/.tmp/f2/e404ee9f5d2c4bb486dd94a0dfe32798 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f2/e404ee9f5d2c4bb486dd94a0dfe32798 2023-02-12 23:03:10,421 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f2/e404ee9f5d2c4bb486dd94a0dfe32798, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 23:03:10,423 INFO [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for c7a8820caf3f3a0e38f5db61bfdd43a7 in 551ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:10,423 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c7a8820caf3f3a0e38f5db61bfdd43a7: 2023-02-12 23:03:10,423 DEBUG [rs(jenkins-hbase4.apache.org,43299,1676242981781)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 23:03:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 23:03:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 23:03:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43299,1676242981781' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 23:03:10,425 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,425 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:10,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:10,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:10,426 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:10,426 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:10,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:10,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:10,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:10,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:10,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43299,1676242981781' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 23:03:10,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d0098d5[Count = 0] remaining members to acquire global barrier 2023-02-12 23:03:10,428 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-12 23:03:10,428 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:10,430 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:10,430 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:10,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:10,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:10,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:10,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:10,431 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,431 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 23:03:10,431 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 23:03:10,431 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,43299,1676242981781' in zk 2023-02-12 23:03:10,431 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 23:03:10,431 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 23:03:10,431 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,37521,1676242981734' in zk 2023-02-12 23:03:10,431 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,431 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 23:03:10,434 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 23:03:10,434 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,434 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:10,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:10,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:10,434 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1676242981781' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 23:03:10,435 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,435 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 23:03:10,435 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:10,435 DEBUG [member: 'jenkins-hbase4.apache.org,37521,1676242981734' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 23:03:10,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:10,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:10,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:10,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:10,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:10,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,43299,1676242981781': 2023-02-12 23:03:10,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43299,1676242981781' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-12 23:03:10,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:10,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:10,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:10,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:10,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:10,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:10,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:10,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,37521,1676242981734': 2023-02-12 23:03:10,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37521,1676242981734' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-12 23:03:10,442 INFO [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-12 23:03:10,442 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 23:03:10,442 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 23:03:10,442 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-12 23:03:10,442 INFO [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 23:03:10,444 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:10,444 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:10,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:10,445 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:10,444 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:10,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:10,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:10,445 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:10,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:10,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:10,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:10,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:10,445 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:10,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:10,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:10,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:10,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:10,446 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:10,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:10,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:10,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:10,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:10,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,448 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,449 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:10,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:10,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,455 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,455 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:10,455 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:10,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:10,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:10,455 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:10,455 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:10,455 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:10,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-12 23:03:10,455 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:10,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:10,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMapReduce because node does not exist (not an error) 2023-02-12 23:03:10,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 23:03:10,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:10,455 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:10,455 DEBUG [(jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:10,456 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:10,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:10,457 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:10,457 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:10,457 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:10,457 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:10,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:10,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:10,459 DEBUG [Listener at localhost/35801] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-12 23:03:10,459 DEBUG [Listener at localhost/35801] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 23:03:10,559 DEBUG [Listener at localhost/35801] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 23:03:10,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 23:03:10,664 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/hadoop-6741105069265712580.jar 2023-02-12 23:03:10,686 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676242988440 type: FLUSH version: 2 ttl: 0 2023-02-12 23:03:10,687 DEBUG [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce 2023-02-12 23:03:10,688 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(239): region to add: 469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:10,688 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(239): region to add: 62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:10,688 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(239): region to add: 804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:10,688 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(239): region to add: 63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:10,688 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(239): region to add: 2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:10,688 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(239): region to add: c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:10,689 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(239): region to add: 9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:10,689 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(239): region to add: 514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:10,689 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(239): region to add: 54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:10,689 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(239): region to add: 54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:10,689 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(585): clone region=469c8d8500abd7ead7bb9f7741b8add8 as 469c8d8500abd7ead7bb9f7741b8add8 in snapshot testWithMapReduceMultiRegion 2023-02-12 23:03:10,689 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(585): clone region=62973a244615f8a20fc71cb2630dab12 as 62973a244615f8a20fc71cb2630dab12 in snapshot testWithMapReduceMultiRegion 2023-02-12 23:03:10,689 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(585): clone region=804d2c90c6989424a49411184f0845d3 as 804d2c90c6989424a49411184f0845d3 in snapshot testWithMapReduceMultiRegion 2023-02-12 23:03:10,689 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(585): clone region=63f710c49b8d97bffccc8db53e57829b as 63f710c49b8d97bffccc8db53e57829b in snapshot testWithMapReduceMultiRegion 2023-02-12 23:03:10,689 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(585): clone region=2973c004b4284eb5f5a933a977f9b8b1 as 2973c004b4284eb5f5a933a977f9b8b1 in snapshot testWithMapReduceMultiRegion 2023-02-12 23:03:10,689 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(585): clone region=c7a8820caf3f3a0e38f5db61bfdd43a7 as c7a8820caf3f3a0e38f5db61bfdd43a7 in snapshot testWithMapReduceMultiRegion 2023-02-12 23:03:10,689 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(585): clone region=9b749c60a6e32651a314656be4e49b03 as 9b749c60a6e32651a314656be4e49b03 in snapshot testWithMapReduceMultiRegion 2023-02-12 23:03:10,690 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(585): clone region=514afecf3a82c32469d46e77b9303717 as 514afecf3a82c32469d46e77b9303717 in snapshot testWithMapReduceMultiRegion 2023-02-12 23:03:10,690 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(585): clone region=54b311bf6f51ce93e536f6a73aa344d5 as 54b311bf6f51ce93e536f6a73aa344d5 in snapshot testWithMapReduceMultiRegion 2023-02-12 23:03:10,690 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(585): clone region=54ca3cdd0d82711860e6a784b596d4ab as 54ca3cdd0d82711860e6a784b596d4ab in snapshot testWithMapReduceMultiRegion 2023-02-12 23:03:10,693 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 63f710c49b8d97bffccc8db53e57829b, NAME => 'testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854 2023-02-12 23:03:10,694 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 804d2c90c6989424a49411184f0845d3, NAME => 'testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854 2023-02-12 23:03:10,694 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 62973a244615f8a20fc71cb2630dab12, NAME => 'testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854 2023-02-12 23:03:10,694 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 469c8d8500abd7ead7bb9f7741b8add8, NAME => 'testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854 2023-02-12 23:03:10,695 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => c7a8820caf3f3a0e38f5db61bfdd43a7, NAME => 'testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854 2023-02-12 23:03:10,696 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 2973c004b4284eb5f5a933a977f9b8b1, NAME => 'testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854 2023-02-12 23:03:10,700 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 9b749c60a6e32651a314656be4e49b03, NAME => 'testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854 2023-02-12 23:03:10,701 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 514afecf3a82c32469d46e77b9303717, NAME => 'testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854 2023-02-12 23:03:10,720 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 23:03:10,721 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-12 23:03:10,736 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:10,737 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 804d2c90c6989424a49411184f0845d3, disabling compactions & flushes 2023-02-12 23:03:10,737 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:10,737 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:10,737 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. after waiting 0 ms 2023-02-12 23:03:10,737 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:10,737 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:10,737 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 804d2c90c6989424a49411184f0845d3: Waiting for close lock at 1676242990737Disabling compacts and flushes for region at 1676242990737Disabling writes for close at 1676242990737Writing region close event to WAL at 1676242990737Closed at 1676242990737 2023-02-12 23:03:10,737 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 54b311bf6f51ce93e536f6a73aa344d5, NAME => 'testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854 2023-02-12 23:03:10,738 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:10,739 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7898be7957364556abe9dea7fa31eee2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,752 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d130866abfed4d579bf75a832b924420 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,759 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:10,759 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 775e400f2b0048afb7b9b626e6477721 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,771 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 63f710c49b8d97bffccc8db53e57829b, disabling compactions & flushes 2023-02-12 23:03:10,771 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:10,771 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:10,771 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. after waiting 0 ms 2023-02-12 23:03:10,771 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:10,771 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:10,771 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 63f710c49b8d97bffccc8db53e57829b: Waiting for close lock at 1676242990771Disabling compacts and flushes for region at 1676242990771Disabling writes for close at 1676242990771Writing region close event to WAL at 1676242990771Closed at 1676242990771 2023-02-12 23:03:10,772 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink caa3049ed9ed4390b1fa3fa199fc8dca from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,772 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 54ca3cdd0d82711860e6a784b596d4ab, NAME => 'testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854 2023-02-12 23:03:10,783 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:10,783 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 380a44d1defe4b41a0122bdc9dedfa6a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,784 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 514afecf3a82c32469d46e77b9303717, disabling compactions & flushes 2023-02-12 23:03:10,784 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:10,784 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:10,784 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. after waiting 0 ms 2023-02-12 23:03:10,784 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:10,784 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:10,784 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 514afecf3a82c32469d46e77b9303717: Waiting for close lock at 1676242990784Disabling compacts and flushes for region at 1676242990784Disabling writes for close at 1676242990784Writing region close event to WAL at 1676242990784Closed at 1676242990784 2023-02-12 23:03:10,799 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:10,799 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c82ce22e2d774f1b861d5989b5b17f38 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,800 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:10,800 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 85952e18553c4fd2b63e577dc9645caf from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,801 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:10,801 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9e69833931944e849f9b1f879aa51204 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,801 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9dfb191111cb44c399fc66732e0852fe from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,803 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:10,804 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a157af2f073f420a9f9d532fb70320f1 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,812 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:10,813 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 54b311bf6f51ce93e536f6a73aa344d5, disabling compactions & flushes 2023-02-12 23:03:10,813 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:10,813 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:10,813 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. after waiting 0 ms 2023-02-12 23:03:10,813 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:10,813 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:10,813 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 54b311bf6f51ce93e536f6a73aa344d5: Waiting for close lock at 1676242990813Disabling compacts and flushes for region at 1676242990813Disabling writes for close at 1676242990813Writing region close event to WAL at 1676242990813Closed at 1676242990813 2023-02-12 23:03:10,820 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 381da499ae9249d494d75edc3f72f95e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,820 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b37580da29054810ad3d2c1613f6f947 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,820 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 9b749c60a6e32651a314656be4e49b03, disabling compactions & flushes 2023-02-12 23:03:10,821 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:10,821 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:10,821 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. after waiting 0 ms 2023-02-12 23:03:10,821 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:10,821 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:10,821 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 9b749c60a6e32651a314656be4e49b03: Waiting for close lock at 1676242990820Disabling compacts and flushes for region at 1676242990820Disabling writes for close at 1676242990821 (+1 ms)Writing region close event to WAL at 1676242990821Closed at 1676242990821 2023-02-12 23:03:10,823 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4bea40524ffc4b30a06e1655038df708 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,828 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 14f4433d83a2460c91eb5da27d708a3e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,829 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 62973a244615f8a20fc71cb2630dab12, disabling compactions & flushes 2023-02-12 23:03:10,829 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:10,829 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:10,829 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. after waiting 0 ms 2023-02-12 23:03:10,829 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:10,829 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:10,829 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 62973a244615f8a20fc71cb2630dab12: Waiting for close lock at 1676242990829Disabling compacts and flushes for region at 1676242990829Disabling writes for close at 1676242990829Writing region close event to WAL at 1676242990829Closed at 1676242990829 2023-02-12 23:03:10,829 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 469c8d8500abd7ead7bb9f7741b8add8, disabling compactions & flushes 2023-02-12 23:03:10,829 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:10,830 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:10,830 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. after waiting 0 ms 2023-02-12 23:03:10,830 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:10,830 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:10,830 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 469c8d8500abd7ead7bb9f7741b8add8: Waiting for close lock at 1676242990829Disabling compacts and flushes for region at 1676242990829Disabling writes for close at 1676242990830 (+1 ms)Writing region close event to WAL at 1676242990830Closed at 1676242990830 2023-02-12 23:03:10,830 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 2973c004b4284eb5f5a933a977f9b8b1, disabling compactions & flushes 2023-02-12 23:03:10,830 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:10,830 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:10,830 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. after waiting 0 ms 2023-02-12 23:03:10,830 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:10,830 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:10,830 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 2973c004b4284eb5f5a933a977f9b8b1: Waiting for close lock at 1676242990830Disabling compacts and flushes for region at 1676242990830Disabling writes for close at 1676242990830Writing region close event to WAL at 1676242990830Closed at 1676242990830 2023-02-12 23:03:10,832 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:10,832 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e507719e896342dabae4d60b658b1b64 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,832 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing c7a8820caf3f3a0e38f5db61bfdd43a7, disabling compactions & flushes 2023-02-12 23:03:10,832 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:10,832 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:10,832 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. after waiting 0 ms 2023-02-12 23:03:10,832 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:10,832 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:10,832 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for c7a8820caf3f3a0e38f5db61bfdd43a7: Waiting for close lock at 1676242990832Disabling compacts and flushes for region at 1676242990832Disabling writes for close at 1676242990832Writing region close event to WAL at 1676242990832Closed at 1676242990832 2023-02-12 23:03:10,834 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2884d202f88c4315b89593f89f06e71d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 23:03:10,837 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 54ca3cdd0d82711860e6a784b596d4ab, disabling compactions & flushes 2023-02-12 23:03:10,837 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:10,837 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:10,837 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. after waiting 0 ms 2023-02-12 23:03:10,837 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:10,837 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:10,837 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 54ca3cdd0d82711860e6a784b596d4ab: Waiting for close lock at 1676242990837Disabling compacts and flushes for region at 1676242990837Disabling writes for close at 1676242990837Writing region close event to WAL at 1676242990837Closed at 1676242990837 2023-02-12 23:03:10,837 INFO [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676242988440 type: FLUSH version: 2 ttl: 0 2023-02-12 23:03:10,838 DEBUG [Listener at localhost/35801] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854 2023-02-12 23:03:10,838 DEBUG [Listener at localhost/35801] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854 2023-02-12 23:03:10,838 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-data/ 2023-02-12 23:03:10,839 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |----default/ 2023-02-12 23:03:10,839 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-12 23:03:10,840 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |----------2973c004b4284eb5f5a933a977f9b8b1/ 2023-02-12 23:03:10,841 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:10,841 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:10,841 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=2973c004b4284eb5f5a933a977f9b8b1-c82ce22e2d774f1b861d5989b5b17f38 2023-02-12 23:03:10,841 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:10,842 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=2973c004b4284eb5f5a933a977f9b8b1-b37580da29054810ad3d2c1613f6f947 2023-02-12 23:03:10,842 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |----------469c8d8500abd7ead7bb9f7741b8add8/ 2023-02-12 23:03:10,843 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:10,843 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:10,843 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=469c8d8500abd7ead7bb9f7741b8add8-a157af2f073f420a9f9d532fb70320f1 2023-02-12 23:03:10,843 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:10,844 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=469c8d8500abd7ead7bb9f7741b8add8-381da499ae9249d494d75edc3f72f95e 2023-02-12 23:03:10,844 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |----------514afecf3a82c32469d46e77b9303717/ 2023-02-12 23:03:10,845 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:10,845 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:10,845 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=514afecf3a82c32469d46e77b9303717-775e400f2b0048afb7b9b626e6477721 2023-02-12 23:03:10,846 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:10,846 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=514afecf3a82c32469d46e77b9303717-caa3049ed9ed4390b1fa3fa199fc8dca 2023-02-12 23:03:10,846 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |----------54b311bf6f51ce93e536f6a73aa344d5/ 2023-02-12 23:03:10,847 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:10,847 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |----------54ca3cdd0d82711860e6a784b596d4ab/ 2023-02-12 23:03:10,847 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:10,848 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:10,848 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=54ca3cdd0d82711860e6a784b596d4ab-e507719e896342dabae4d60b658b1b64 2023-02-12 23:03:10,848 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:10,849 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=54ca3cdd0d82711860e6a784b596d4ab-2884d202f88c4315b89593f89f06e71d 2023-02-12 23:03:10,849 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |----------62973a244615f8a20fc71cb2630dab12/ 2023-02-12 23:03:10,850 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:10,850 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:10,851 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=62973a244615f8a20fc71cb2630dab12-85952e18553c4fd2b63e577dc9645caf 2023-02-12 23:03:10,851 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:10,851 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=62973a244615f8a20fc71cb2630dab12-4bea40524ffc4b30a06e1655038df708 2023-02-12 23:03:10,851 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |----------63f710c49b8d97bffccc8db53e57829b/ 2023-02-12 23:03:10,852 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:10,852 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:10,852 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=63f710c49b8d97bffccc8db53e57829b-7898be7957364556abe9dea7fa31eee2 2023-02-12 23:03:10,853 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:10,853 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=63f710c49b8d97bffccc8db53e57829b-d130866abfed4d579bf75a832b924420 2023-02-12 23:03:10,853 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |----------804d2c90c6989424a49411184f0845d3/ 2023-02-12 23:03:10,854 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:10,854 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |----------9b749c60a6e32651a314656be4e49b03/ 2023-02-12 23:03:10,854 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:10,854 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:10,855 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=9b749c60a6e32651a314656be4e49b03-380a44d1defe4b41a0122bdc9dedfa6a 2023-02-12 23:03:10,855 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:10,856 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=9b749c60a6e32651a314656be4e49b03-9dfb191111cb44c399fc66732e0852fe 2023-02-12 23:03:10,856 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |----------c7a8820caf3f3a0e38f5db61bfdd43a7/ 2023-02-12 23:03:10,856 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:10,856 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:10,857 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=c7a8820caf3f3a0e38f5db61bfdd43a7-9e69833931944e849f9b1f879aa51204 2023-02-12 23:03:10,857 DEBUG [Listener at localhost/35801] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:10,858 DEBUG [Listener at localhost/35801] util.CommonFSUtils(702): |----------------testWithMapReduce=c7a8820caf3f3a0e38f5db61bfdd43a7-14f4433d83a2460c91eb5da27d708a3e 2023-02-12 23:03:10,868 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:10,869 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:10,870 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:10,870 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:10,871 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:10,871 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:10,872 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:10,959 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/hadoop-6160646798976586675.jar 2023-02-12 23:03:10,959 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:10,960 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:10,960 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:10,961 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:10,962 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:10,962 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:10,963 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-12 23:03:10,963 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-12 23:03:10,964 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-12 23:03:10,965 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-12 23:03:10,965 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-12 23:03:10,966 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-12 23:03:10,967 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-12 23:03:10,967 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-12 23:03:10,967 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-12 23:03:10,968 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-12 23:03:10,973 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:10,974 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 23:03:10,974 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 23:03:10,975 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 23:03:10,975 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 23:03:11,043 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/hadoop-4024701575524425360.jar 2023-02-12 23:03:11,044 DEBUG [Listener at localhost/35801] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 23:03:11,138 WARN [Listener at localhost/35801] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-12 23:03:11,193 INFO [Listener at localhost/35801] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 23:03:11,527 WARN [Listener at localhost/35801] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/mapreduce.cluster.local.dir/1676242991439/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-12 23:03:11,527 WARN [Listener at localhost/35801] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/mapreduce.cluster.local.dir/1676242991439/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-12 23:03:11,698 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:11,698 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:11,707 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:11,709 INFO [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:11,710 DEBUG [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f1 2023-02-12 23:03:11,711 INFO [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 469c8d8500abd7ead7bb9f7741b8add8 columnFamilyName f1 2023-02-12 23:03:11,722 DEBUG [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f1/testWithMapReduce=469c8d8500abd7ead7bb9f7741b8add8-a157af2f073f420a9f9d532fb70320f1 2023-02-12 23:03:11,722 INFO [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] regionserver.HStore(310): Store=469c8d8500abd7ead7bb9f7741b8add8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:11,723 INFO [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:11,725 DEBUG [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f2 2023-02-12 23:03:11,725 INFO [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 469c8d8500abd7ead7bb9f7741b8add8 columnFamilyName f2 2023-02-12 23:03:11,731 DEBUG [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f2/testWithMapReduce=469c8d8500abd7ead7bb9f7741b8add8-381da499ae9249d494d75edc3f72f95e 2023-02-12 23:03:11,732 INFO [StoreOpener-469c8d8500abd7ead7bb9f7741b8add8-1] regionserver.HStore(310): Store=469c8d8500abd7ead7bb9f7741b8add8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:11,732 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:11,732 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 469c8d8500abd7ead7bb9f7741b8add8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61224890, jitterRate=-0.08767804503440857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:11,732 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 469c8d8500abd7ead7bb9f7741b8add8: Writing region info on filesystem at 1676242991707Initializing all the Stores at 1676242991708 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242991708Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242991708Region opened successfully at 1676242991732 (+24 ms) 2023-02-12 23:03:11,880 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 469c8d8500abd7ead7bb9f7741b8add8, disabling compactions & flushes 2023-02-12 23:03:11,881 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:11,881 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:11,881 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. after waiting 0 ms 2023-02-12 23:03:11,881 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:11,890 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:11,890 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 469c8d8500abd7ead7bb9f7741b8add8: Waiting for close lock at 1676242991880Disabling compacts and flushes for region at 1676242991880Disabling writes for close at 1676242991881 (+1 ms)Writing region close event to WAL at 1676242991890 (+9 ms)Closed at 1676242991890 2023-02-12 23:03:11,904 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:11,904 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:11,908 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:11,921 INFO [StoreOpener-514afecf3a82c32469d46e77b9303717-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:11,922 DEBUG [StoreOpener-514afecf3a82c32469d46e77b9303717-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f1 2023-02-12 23:03:11,923 INFO [StoreOpener-514afecf3a82c32469d46e77b9303717-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 514afecf3a82c32469d46e77b9303717 columnFamilyName f1 2023-02-12 23:03:11,943 DEBUG [StoreOpener-514afecf3a82c32469d46e77b9303717-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f1/testWithMapReduce=514afecf3a82c32469d46e77b9303717-775e400f2b0048afb7b9b626e6477721 2023-02-12 23:03:11,944 INFO [StoreOpener-514afecf3a82c32469d46e77b9303717-1] regionserver.HStore(310): Store=514afecf3a82c32469d46e77b9303717/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:11,944 INFO [StoreOpener-514afecf3a82c32469d46e77b9303717-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:11,945 DEBUG [StoreOpener-514afecf3a82c32469d46e77b9303717-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f2 2023-02-12 23:03:11,946 INFO [StoreOpener-514afecf3a82c32469d46e77b9303717-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 514afecf3a82c32469d46e77b9303717 columnFamilyName f2 2023-02-12 23:03:11,953 DEBUG [StoreOpener-514afecf3a82c32469d46e77b9303717-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f2/testWithMapReduce=514afecf3a82c32469d46e77b9303717-caa3049ed9ed4390b1fa3fa199fc8dca 2023-02-12 23:03:11,953 INFO [StoreOpener-514afecf3a82c32469d46e77b9303717-1] regionserver.HStore(310): Store=514afecf3a82c32469d46e77b9303717/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:11,954 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:11,954 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 514afecf3a82c32469d46e77b9303717; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62987018, jitterRate=-0.061420291662216187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:11,954 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 514afecf3a82c32469d46e77b9303717: Writing region info on filesystem at 1676242991908Initializing all the Stores at 1676242991909 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242991909Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242991920 (+11 ms)Region opened successfully at 1676242991954 (+34 ms) 2023-02-12 23:03:12,024 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 514afecf3a82c32469d46e77b9303717, disabling compactions & flushes 2023-02-12 23:03:12,024 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:12,024 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:12,024 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. after waiting 0 ms 2023-02-12 23:03:12,024 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:12,028 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:12,028 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 514afecf3a82c32469d46e77b9303717: Waiting for close lock at 1676242992024Disabling compacts and flushes for region at 1676242992024Disabling writes for close at 1676242992024Writing region close event to WAL at 1676242992028 (+4 ms)Closed at 1676242992028 2023-02-12 23:03:12,033 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:12,033 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:12,041 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:12,046 INFO [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:12,048 DEBUG [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5/f1 2023-02-12 23:03:12,050 INFO [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54b311bf6f51ce93e536f6a73aa344d5 columnFamilyName f1 2023-02-12 23:03:12,051 INFO [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] regionserver.HStore(310): Store=54b311bf6f51ce93e536f6a73aa344d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,051 INFO [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:12,052 DEBUG [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5/f2 2023-02-12 23:03:12,053 INFO [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54b311bf6f51ce93e536f6a73aa344d5 columnFamilyName f2 2023-02-12 23:03:12,054 INFO [StoreOpener-54b311bf6f51ce93e536f6a73aa344d5-1] regionserver.HStore(310): Store=54b311bf6f51ce93e536f6a73aa344d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:12,054 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 54b311bf6f51ce93e536f6a73aa344d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73854391, jitterRate=0.1005161851644516}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:12,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 54b311bf6f51ce93e536f6a73aa344d5: Writing region info on filesystem at 1676242992041Initializing all the Stores at 1676242992042 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992042Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992045 (+3 ms)Region opened successfully at 1676242992054 (+9 ms) 2023-02-12 23:03:12,077 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 54b311bf6f51ce93e536f6a73aa344d5, disabling compactions & flushes 2023-02-12 23:03:12,077 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:12,077 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:12,077 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. after waiting 0 ms 2023-02-12 23:03:12,077 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:12,077 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:12,078 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 54b311bf6f51ce93e536f6a73aa344d5: Waiting for close lock at 1676242992077Disabling compacts and flushes for region at 1676242992077Disabling writes for close at 1676242992077Writing region close event to WAL at 1676242992077Closed at 1676242992077 2023-02-12 23:03:12,086 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:12,086 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:12,090 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:12,093 INFO [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:12,094 DEBUG [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f1 2023-02-12 23:03:12,094 INFO [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54ca3cdd0d82711860e6a784b596d4ab columnFamilyName f1 2023-02-12 23:03:12,106 DEBUG [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f1/testWithMapReduce=54ca3cdd0d82711860e6a784b596d4ab-e507719e896342dabae4d60b658b1b64 2023-02-12 23:03:12,106 INFO [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] regionserver.HStore(310): Store=54ca3cdd0d82711860e6a784b596d4ab/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,106 INFO [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:12,108 DEBUG [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f2 2023-02-12 23:03:12,108 INFO [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54ca3cdd0d82711860e6a784b596d4ab columnFamilyName f2 2023-02-12 23:03:12,115 DEBUG [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f2/testWithMapReduce=54ca3cdd0d82711860e6a784b596d4ab-2884d202f88c4315b89593f89f06e71d 2023-02-12 23:03:12,115 INFO [StoreOpener-54ca3cdd0d82711860e6a784b596d4ab-1] regionserver.HStore(310): Store=54ca3cdd0d82711860e6a784b596d4ab/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,116 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:12,116 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 54ca3cdd0d82711860e6a784b596d4ab; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74611896, jitterRate=0.11180388927459717}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:12,116 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 54ca3cdd0d82711860e6a784b596d4ab: Writing region info on filesystem at 1676242992090Initializing all the Stores at 1676242992092 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992092Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992092Region opened successfully at 1676242992116 (+24 ms) 2023-02-12 23:03:12,206 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 54ca3cdd0d82711860e6a784b596d4ab, disabling compactions & flushes 2023-02-12 23:03:12,207 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:12,207 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:12,207 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. after waiting 0 ms 2023-02-12 23:03:12,207 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:12,226 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:12,226 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 54ca3cdd0d82711860e6a784b596d4ab: Waiting for close lock at 1676242992206Disabling compacts and flushes for region at 1676242992206Disabling writes for close at 1676242992207 (+1 ms)Writing region close event to WAL at 1676242992226 (+19 ms)Closed at 1676242992226 2023-02-12 23:03:12,238 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:12,238 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:12,249 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:12,251 INFO [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:12,252 DEBUG [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f1 2023-02-12 23:03:12,253 INFO [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62973a244615f8a20fc71cb2630dab12 columnFamilyName f1 2023-02-12 23:03:12,261 DEBUG [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f1/testWithMapReduce=62973a244615f8a20fc71cb2630dab12-85952e18553c4fd2b63e577dc9645caf 2023-02-12 23:03:12,261 INFO [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] regionserver.HStore(310): Store=62973a244615f8a20fc71cb2630dab12/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,262 INFO [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:12,263 DEBUG [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f2 2023-02-12 23:03:12,263 INFO [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62973a244615f8a20fc71cb2630dab12 columnFamilyName f2 2023-02-12 23:03:12,273 DEBUG [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f2/testWithMapReduce=62973a244615f8a20fc71cb2630dab12-4bea40524ffc4b30a06e1655038df708 2023-02-12 23:03:12,273 INFO [StoreOpener-62973a244615f8a20fc71cb2630dab12-1] regionserver.HStore(310): Store=62973a244615f8a20fc71cb2630dab12/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,274 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:12,274 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 62973a244615f8a20fc71cb2630dab12; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74994219, jitterRate=0.11750094592571259}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:12,274 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 62973a244615f8a20fc71cb2630dab12: Writing region info on filesystem at 1676242992249Initializing all the Stores at 1676242992250 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992250Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992251 (+1 ms)Region opened successfully at 1676242992274 (+23 ms) 2023-02-12 23:03:12,323 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 62973a244615f8a20fc71cb2630dab12, disabling compactions & flushes 2023-02-12 23:03:12,323 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:12,323 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:12,323 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. after waiting 0 ms 2023-02-12 23:03:12,323 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:12,327 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:12,327 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 62973a244615f8a20fc71cb2630dab12: Waiting for close lock at 1676242992322Disabling compacts and flushes for region at 1676242992322Disabling writes for close at 1676242992323 (+1 ms)Writing region close event to WAL at 1676242992327 (+4 ms)Closed at 1676242992327 2023-02-12 23:03:12,333 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:12,333 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:12,345 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:12,355 INFO [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:12,356 DEBUG [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f1 2023-02-12 23:03:12,357 INFO [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b749c60a6e32651a314656be4e49b03 columnFamilyName f1 2023-02-12 23:03:12,382 DEBUG [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f1/testWithMapReduce=9b749c60a6e32651a314656be4e49b03-380a44d1defe4b41a0122bdc9dedfa6a 2023-02-12 23:03:12,382 INFO [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] regionserver.HStore(310): Store=9b749c60a6e32651a314656be4e49b03/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,382 INFO [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:12,383 DEBUG [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f2 2023-02-12 23:03:12,384 INFO [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b749c60a6e32651a314656be4e49b03 columnFamilyName f2 2023-02-12 23:03:12,394 DEBUG [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f2/testWithMapReduce=9b749c60a6e32651a314656be4e49b03-9dfb191111cb44c399fc66732e0852fe 2023-02-12 23:03:12,394 INFO [StoreOpener-9b749c60a6e32651a314656be4e49b03-1] regionserver.HStore(310): Store=9b749c60a6e32651a314656be4e49b03/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,394 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:12,394 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9b749c60a6e32651a314656be4e49b03; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74447993, jitterRate=0.10936154425144196}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:12,394 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9b749c60a6e32651a314656be4e49b03: Writing region info on filesystem at 1676242992345Initializing all the Stores at 1676242992353 (+8 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992353Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992354 (+1 ms)Region opened successfully at 1676242992394 (+40 ms) 2023-02-12 23:03:12,433 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9b749c60a6e32651a314656be4e49b03, disabling compactions & flushes 2023-02-12 23:03:12,433 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:12,433 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:12,433 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. after waiting 0 ms 2023-02-12 23:03:12,433 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:12,443 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:12,443 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9b749c60a6e32651a314656be4e49b03: Waiting for close lock at 1676242992433Disabling compacts and flushes for region at 1676242992433Disabling writes for close at 1676242992433Writing region close event to WAL at 1676242992443 (+10 ms)Closed at 1676242992443 2023-02-12 23:03:12,450 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:12,450 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:12,468 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:12,470 INFO [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:12,472 DEBUG [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f1 2023-02-12 23:03:12,472 INFO [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2973c004b4284eb5f5a933a977f9b8b1 columnFamilyName f1 2023-02-12 23:03:12,482 DEBUG [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f1/testWithMapReduce=2973c004b4284eb5f5a933a977f9b8b1-c82ce22e2d774f1b861d5989b5b17f38 2023-02-12 23:03:12,483 INFO [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] regionserver.HStore(310): Store=2973c004b4284eb5f5a933a977f9b8b1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,483 INFO [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:12,484 DEBUG [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f2 2023-02-12 23:03:12,484 INFO [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2973c004b4284eb5f5a933a977f9b8b1 columnFamilyName f2 2023-02-12 23:03:12,491 DEBUG [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f2/testWithMapReduce=2973c004b4284eb5f5a933a977f9b8b1-b37580da29054810ad3d2c1613f6f947 2023-02-12 23:03:12,491 INFO [StoreOpener-2973c004b4284eb5f5a933a977f9b8b1-1] regionserver.HStore(310): Store=2973c004b4284eb5f5a933a977f9b8b1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,491 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:12,491 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2973c004b4284eb5f5a933a977f9b8b1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69751701, jitterRate=0.03938134014606476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:12,491 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2973c004b4284eb5f5a933a977f9b8b1: Writing region info on filesystem at 1676242992468Initializing all the Stores at 1676242992469 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992469Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992469Region opened successfully at 1676242992491 (+22 ms) 2023-02-12 23:03:12,524 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2973c004b4284eb5f5a933a977f9b8b1, disabling compactions & flushes 2023-02-12 23:03:12,524 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:12,525 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:12,525 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. after waiting 0 ms 2023-02-12 23:03:12,525 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:12,533 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:12,533 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2973c004b4284eb5f5a933a977f9b8b1: Waiting for close lock at 1676242992524Disabling compacts and flushes for region at 1676242992524Disabling writes for close at 1676242992525 (+1 ms)Writing region close event to WAL at 1676242992533 (+8 ms)Closed at 1676242992533 2023-02-12 23:03:12,540 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:12,541 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:12,569 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:12,572 INFO [StoreOpener-804d2c90c6989424a49411184f0845d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:12,574 DEBUG [StoreOpener-804d2c90c6989424a49411184f0845d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3/f1 2023-02-12 23:03:12,575 INFO [StoreOpener-804d2c90c6989424a49411184f0845d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 804d2c90c6989424a49411184f0845d3 columnFamilyName f1 2023-02-12 23:03:12,576 INFO [StoreOpener-804d2c90c6989424a49411184f0845d3-1] regionserver.HStore(310): Store=804d2c90c6989424a49411184f0845d3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,576 INFO [StoreOpener-804d2c90c6989424a49411184f0845d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:12,578 DEBUG [StoreOpener-804d2c90c6989424a49411184f0845d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3/f2 2023-02-12 23:03:12,578 INFO [StoreOpener-804d2c90c6989424a49411184f0845d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 804d2c90c6989424a49411184f0845d3 columnFamilyName f2 2023-02-12 23:03:12,579 INFO [StoreOpener-804d2c90c6989424a49411184f0845d3-1] regionserver.HStore(310): Store=804d2c90c6989424a49411184f0845d3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:12,579 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 804d2c90c6989424a49411184f0845d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66684482, jitterRate=-0.006323784589767456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:12,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 804d2c90c6989424a49411184f0845d3: Writing region info on filesystem at 1676242992569Initializing all the Stores at 1676242992570 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992570Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992570Region opened successfully at 1676242992579 (+9 ms) 2023-02-12 23:03:12,612 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 804d2c90c6989424a49411184f0845d3, disabling compactions & flushes 2023-02-12 23:03:12,612 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:12,612 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:12,612 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. after waiting 0 ms 2023-02-12 23:03:12,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:12,613 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:12,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 804d2c90c6989424a49411184f0845d3: Waiting for close lock at 1676242992612Disabling compacts and flushes for region at 1676242992612Disabling writes for close at 1676242992613 (+1 ms)Writing region close event to WAL at 1676242992613Closed at 1676242992613 2023-02-12 23:03:12,617 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:12,617 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:12,618 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:12,621 INFO [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:12,622 DEBUG [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f1 2023-02-12 23:03:12,622 INFO [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63f710c49b8d97bffccc8db53e57829b columnFamilyName f1 2023-02-12 23:03:12,628 DEBUG [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f1/testWithMapReduce=63f710c49b8d97bffccc8db53e57829b-7898be7957364556abe9dea7fa31eee2 2023-02-12 23:03:12,628 INFO [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] regionserver.HStore(310): Store=63f710c49b8d97bffccc8db53e57829b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,628 INFO [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:12,629 DEBUG [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f2 2023-02-12 23:03:12,630 INFO [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63f710c49b8d97bffccc8db53e57829b columnFamilyName f2 2023-02-12 23:03:12,640 DEBUG [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f2/testWithMapReduce=63f710c49b8d97bffccc8db53e57829b-d130866abfed4d579bf75a832b924420 2023-02-12 23:03:12,640 INFO [StoreOpener-63f710c49b8d97bffccc8db53e57829b-1] regionserver.HStore(310): Store=63f710c49b8d97bffccc8db53e57829b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,640 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:12,641 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 63f710c49b8d97bffccc8db53e57829b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60243820, jitterRate=-0.10229712724685669}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:12,641 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 63f710c49b8d97bffccc8db53e57829b: Writing region info on filesystem at 1676242992618Initializing all the Stores at 1676242992619 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992619Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992620 (+1 ms)Region opened successfully at 1676242992641 (+21 ms) 2023-02-12 23:03:12,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 63f710c49b8d97bffccc8db53e57829b, disabling compactions & flushes 2023-02-12 23:03:12,697 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:12,697 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:12,697 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. after waiting 0 ms 2023-02-12 23:03:12,697 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:12,700 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:12,700 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 63f710c49b8d97bffccc8db53e57829b: Waiting for close lock at 1676242992696Disabling compacts and flushes for region at 1676242992696Disabling writes for close at 1676242992697 (+1 ms)Writing region close event to WAL at 1676242992700 (+3 ms)Closed at 1676242992700 2023-02-12 23:03:12,710 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:12,710 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:12,711 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:12,713 INFO [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:12,714 DEBUG [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f1 2023-02-12 23:03:12,714 INFO [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7a8820caf3f3a0e38f5db61bfdd43a7 columnFamilyName f1 2023-02-12 23:03:12,728 DEBUG [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f1/testWithMapReduce=c7a8820caf3f3a0e38f5db61bfdd43a7-9e69833931944e849f9b1f879aa51204 2023-02-12 23:03:12,729 INFO [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] regionserver.HStore(310): Store=c7a8820caf3f3a0e38f5db61bfdd43a7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,729 INFO [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:12,730 DEBUG [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f2 2023-02-12 23:03:12,730 INFO [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7a8820caf3f3a0e38f5db61bfdd43a7 columnFamilyName f2 2023-02-12 23:03:12,737 DEBUG [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] regionserver.HStore(539): loaded hdfs://localhost:38615/user/jenkins/test-data/774ab33e-c6fe-1339-3d68-c910dfe32e34/testWithMapReduceMultiRegion/e1c43ff9-d494-4dac-8e25-b00c3bf74854/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f2/testWithMapReduce=c7a8820caf3f3a0e38f5db61bfdd43a7-14f4433d83a2460c91eb5da27d708a3e 2023-02-12 23:03:12,737 INFO [StoreOpener-c7a8820caf3f3a0e38f5db61bfdd43a7-1] regionserver.HStore(310): Store=c7a8820caf3f3a0e38f5db61bfdd43a7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:12,737 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:12,737 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c7a8820caf3f3a0e38f5db61bfdd43a7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63726554, jitterRate=-0.050400346517562866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:12,737 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c7a8820caf3f3a0e38f5db61bfdd43a7: Writing region info on filesystem at 1676242992711Initializing all the Stores at 1676242992712 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992712Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242992712Region opened successfully at 1676242992737 (+25 ms) 2023-02-12 23:03:12,777 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c7a8820caf3f3a0e38f5db61bfdd43a7, disabling compactions & flushes 2023-02-12 23:03:12,777 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:12,777 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:12,777 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. after waiting 0 ms 2023-02-12 23:03:12,777 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:12,780 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:12,780 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c7a8820caf3f3a0e38f5db61bfdd43a7: Waiting for close lock at 1676242992777Disabling compacts and flushes for region at 1676242992777Disabling writes for close at 1676242992777Writing region close event to WAL at 1676242992780 (+3 ms)Closed at 1676242992780 2023-02-12 23:03:13,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-12 23:03:13,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-12 23:03:13,631 INFO [Listener at localhost/35801] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 23:03:13,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-12 23:03:13,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-12 23:03:13,642 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676242993642"}]},"ts":"1676242993642"} 2023-02-12 23:03:13,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 23:03:13,644 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-12 23:03:13,648 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-12 23:03:13,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=54b311bf6f51ce93e536f6a73aa344d5, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=54ca3cdd0d82711860e6a784b596d4ab, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=62973a244615f8a20fc71cb2630dab12, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=514afecf3a82c32469d46e77b9303717, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9b749c60a6e32651a314656be4e49b03, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2973c004b4284eb5f5a933a977f9b8b1, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=63f710c49b8d97bffccc8db53e57829b, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=469c8d8500abd7ead7bb9f7741b8add8, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c7a8820caf3f3a0e38f5db61bfdd43a7, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=804d2c90c6989424a49411184f0845d3, UNASSIGN}] 2023-02-12 23:03:13,654 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=804d2c90c6989424a49411184f0845d3, UNASSIGN 2023-02-12 23:03:13,654 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=469c8d8500abd7ead7bb9f7741b8add8, UNASSIGN 2023-02-12 23:03:13,654 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=63f710c49b8d97bffccc8db53e57829b, UNASSIGN 2023-02-12 23:03:13,654 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c7a8820caf3f3a0e38f5db61bfdd43a7, UNASSIGN 2023-02-12 23:03:13,654 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2973c004b4284eb5f5a933a977f9b8b1, UNASSIGN 2023-02-12 23:03:13,655 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=804d2c90c6989424a49411184f0845d3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:13,655 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=469c8d8500abd7ead7bb9f7741b8add8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:13,656 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676242993655"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242993655"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242993655"}]},"ts":"1676242993655"} 2023-02-12 23:03:13,656 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993655"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242993655"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242993655"}]},"ts":"1676242993655"} 2023-02-12 23:03:13,656 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=c7a8820caf3f3a0e38f5db61bfdd43a7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:13,656 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=63f710c49b8d97bffccc8db53e57829b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:13,656 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993656"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242993656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242993656"}]},"ts":"1676242993656"} 2023-02-12 23:03:13,656 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993656"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242993656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242993656"}]},"ts":"1676242993656"} 2023-02-12 23:03:13,656 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=2973c004b4284eb5f5a933a977f9b8b1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:13,657 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993656"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242993656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242993656"}]},"ts":"1676242993656"} 2023-02-12 23:03:13,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE; CloseRegionProcedure 804d2c90c6989424a49411184f0845d3, server=jenkins-hbase4.apache.org,37521,1676242981734}] 2023-02-12 23:03:13,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=41, state=RUNNABLE; CloseRegionProcedure 469c8d8500abd7ead7bb9f7741b8add8, server=jenkins-hbase4.apache.org,37521,1676242981734}] 2023-02-12 23:03:13,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=42, state=RUNNABLE; CloseRegionProcedure c7a8820caf3f3a0e38f5db61bfdd43a7, server=jenkins-hbase4.apache.org,43299,1676242981781}] 2023-02-12 23:03:13,663 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=40, state=RUNNABLE; CloseRegionProcedure 63f710c49b8d97bffccc8db53e57829b, server=jenkins-hbase4.apache.org,43299,1676242981781}] 2023-02-12 23:03:13,665 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=39, state=RUNNABLE; CloseRegionProcedure 2973c004b4284eb5f5a933a977f9b8b1, server=jenkins-hbase4.apache.org,37521,1676242981734}] 2023-02-12 23:03:13,670 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9b749c60a6e32651a314656be4e49b03, UNASSIGN 2023-02-12 23:03:13,670 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=514afecf3a82c32469d46e77b9303717, UNASSIGN 2023-02-12 23:03:13,671 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=62973a244615f8a20fc71cb2630dab12, UNASSIGN 2023-02-12 23:03:13,672 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=514afecf3a82c32469d46e77b9303717, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:13,672 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=54ca3cdd0d82711860e6a784b596d4ab, UNASSIGN 2023-02-12 23:03:13,672 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9b749c60a6e32651a314656be4e49b03, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:13,672 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676242985738.514afecf3a82c32469d46e77b9303717.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993672"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242993672"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242993672"}]},"ts":"1676242993672"} 2023-02-12 23:03:13,673 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=62973a244615f8a20fc71cb2630dab12, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:13,673 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676242985738.62973a244615f8a20fc71cb2630dab12.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993673"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242993673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242993673"}]},"ts":"1676242993673"} 2023-02-12 23:03:13,673 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=54ca3cdd0d82711860e6a784b596d4ab, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:13,672 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993672"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242993672"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242993672"}]},"ts":"1676242993672"} 2023-02-12 23:03:13,673 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993673"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242993673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242993673"}]},"ts":"1676242993673"} 2023-02-12 23:03:13,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=37, state=RUNNABLE; CloseRegionProcedure 514afecf3a82c32469d46e77b9303717, server=jenkins-hbase4.apache.org,43299,1676242981781}] 2023-02-12 23:03:13,676 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=54b311bf6f51ce93e536f6a73aa344d5, UNASSIGN 2023-02-12 23:03:13,677 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=36, state=RUNNABLE; CloseRegionProcedure 62973a244615f8a20fc71cb2630dab12, server=jenkins-hbase4.apache.org,37521,1676242981734}] 2023-02-12 23:03:13,678 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=54b311bf6f51ce93e536f6a73aa344d5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:13,678 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676242993678"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242993678"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242993678"}]},"ts":"1676242993678"} 2023-02-12 23:03:13,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=38, state=RUNNABLE; CloseRegionProcedure 9b749c60a6e32651a314656be4e49b03, server=jenkins-hbase4.apache.org,37521,1676242981734}] 2023-02-12 23:03:13,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure 54ca3cdd0d82711860e6a784b596d4ab, server=jenkins-hbase4.apache.org,43299,1676242981781}] 2023-02-12 23:03:13,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 54b311bf6f51ce93e536f6a73aa344d5, server=jenkins-hbase4.apache.org,43299,1676242981781}] 2023-02-12 23:03:13,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 23:03:13,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:13,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c7a8820caf3f3a0e38f5db61bfdd43a7, disabling compactions & flushes 2023-02-12 23:03:13,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:13,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:13,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 62973a244615f8a20fc71cb2630dab12, disabling compactions & flushes 2023-02-12 23:03:13,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:13,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:13,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. after waiting 0 ms 2023-02-12 23:03:13,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:13,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:13,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. after waiting 0 ms 2023-02-12 23:03:13,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:13,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:13,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7. 2023-02-12 23:03:13,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c7a8820caf3f3a0e38f5db61bfdd43a7: Waiting for close lock at 1676242993821Running coprocessor pre-close hooks at 1676242993821Disabling compacts and flushes for region at 1676242993821Disabling writes for close at 1676242993822 (+1 ms)Writing region close event to WAL at 1676242993829 (+7 ms)Running coprocessor post-close hooks at 1676242993835 (+6 ms)Closed at 1676242993836 (+1 ms) 2023-02-12 23:03:13,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:13,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:13,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 63f710c49b8d97bffccc8db53e57829b, disabling compactions & flushes 2023-02-12 23:03:13,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:13,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:13,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. after waiting 0 ms 2023-02-12 23:03:13,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:13,840 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=c7a8820caf3f3a0e38f5db61bfdd43a7, regionState=CLOSED 2023-02-12 23:03:13,840 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993840"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242993840"}]},"ts":"1676242993840"} 2023-02-12 23:03:13,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:13,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12. 2023-02-12 23:03:13,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 62973a244615f8a20fc71cb2630dab12: Waiting for close lock at 1676242993821Running coprocessor pre-close hooks at 1676242993821Disabling compacts and flushes for region at 1676242993821Disabling writes for close at 1676242993822 (+1 ms)Writing region close event to WAL at 1676242993834 (+12 ms)Running coprocessor post-close hooks at 1676242993847 (+13 ms)Closed at 1676242993847 2023-02-12 23:03:13,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=42 2023-02-12 23:03:13,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:13,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:13,857 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=42, state=SUCCESS; CloseRegionProcedure c7a8820caf3f3a0e38f5db61bfdd43a7, server=jenkins-hbase4.apache.org,43299,1676242981781 in 181 msec 2023-02-12 23:03:13,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 804d2c90c6989424a49411184f0845d3, disabling compactions & flushes 2023-02-12 23:03:13,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:13,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:13,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. after waiting 0 ms 2023-02-12 23:03:13,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:13,858 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=62973a244615f8a20fc71cb2630dab12, regionState=CLOSED 2023-02-12 23:03:13,858 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676242985738.62973a244615f8a20fc71cb2630dab12.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242993858"}]},"ts":"1676242993858"} 2023-02-12 23:03:13,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:13,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c7a8820caf3f3a0e38f5db61bfdd43a7, UNASSIGN in 206 msec 2023-02-12 23:03:13,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b. 2023-02-12 23:03:13,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 63f710c49b8d97bffccc8db53e57829b: Waiting for close lock at 1676242993839Running coprocessor pre-close hooks at 1676242993839Disabling compacts and flushes for region at 1676242993839Disabling writes for close at 1676242993840 (+1 ms)Writing region close event to WAL at 1676242993852 (+12 ms)Running coprocessor post-close hooks at 1676242993862 (+10 ms)Closed at 1676242993863 (+1 ms) 2023-02-12 23:03:13,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:13,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:13,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 54ca3cdd0d82711860e6a784b596d4ab, disabling compactions & flushes 2023-02-12 23:03:13,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:13,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:13,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. after waiting 0 ms 2023-02-12 23:03:13,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:13,866 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=36 2023-02-12 23:03:13,866 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=63f710c49b8d97bffccc8db53e57829b, regionState=CLOSED 2023-02-12 23:03:13,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=36, state=SUCCESS; CloseRegionProcedure 62973a244615f8a20fc71cb2630dab12, server=jenkins-hbase4.apache.org,37521,1676242981734 in 187 msec 2023-02-12 23:03:13,867 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993866"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242993866"}]},"ts":"1676242993866"} 2023-02-12 23:03:13,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 23:03:13,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3. 2023-02-12 23:03:13,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 804d2c90c6989424a49411184f0845d3: Waiting for close lock at 1676242993857Running coprocessor pre-close hooks at 1676242993857Disabling compacts and flushes for region at 1676242993857Disabling writes for close at 1676242993857Writing region close event to WAL at 1676242993858 (+1 ms)Running coprocessor post-close hooks at 1676242993868 (+10 ms)Closed at 1676242993869 (+1 ms) 2023-02-12 23:03:13,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=62973a244615f8a20fc71cb2630dab12, UNASSIGN in 218 msec 2023-02-12 23:03:13,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:13,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:13,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9b749c60a6e32651a314656be4e49b03, disabling compactions & flushes 2023-02-12 23:03:13,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:13,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:13,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. after waiting 0 ms 2023-02-12 23:03:13,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:13,875 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=804d2c90c6989424a49411184f0845d3, regionState=CLOSED 2023-02-12 23:03:13,876 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676242993875"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242993875"}]},"ts":"1676242993875"} 2023-02-12 23:03:13,877 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=40 2023-02-12 23:03:13,877 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=40, state=SUCCESS; CloseRegionProcedure 63f710c49b8d97bffccc8db53e57829b, server=jenkins-hbase4.apache.org,43299,1676242981781 in 208 msec 2023-02-12 23:03:13,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=63f710c49b8d97bffccc8db53e57829b, UNASSIGN in 228 msec 2023-02-12 23:03:13,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:13,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab. 2023-02-12 23:03:13,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 54ca3cdd0d82711860e6a784b596d4ab: Waiting for close lock at 1676242993866Running coprocessor pre-close hooks at 1676242993866Disabling compacts and flushes for region at 1676242993866Disabling writes for close at 1676242993866Writing region close event to WAL at 1676242993874 (+8 ms)Running coprocessor post-close hooks at 1676242993882 (+8 ms)Closed at 1676242993883 (+1 ms) 2023-02-12 23:03:13,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-12 23:03:13,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; CloseRegionProcedure 804d2c90c6989424a49411184f0845d3, server=jenkins-hbase4.apache.org,37521,1676242981734 in 222 msec 2023-02-12 23:03:13,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:13,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:13,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 514afecf3a82c32469d46e77b9303717, disabling compactions & flushes 2023-02-12 23:03:13,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:13,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:13,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. after waiting 0 ms 2023-02-12 23:03:13,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:13,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:13,886 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=804d2c90c6989424a49411184f0845d3, UNASSIGN in 233 msec 2023-02-12 23:03:13,886 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=54ca3cdd0d82711860e6a784b596d4ab, regionState=CLOSED 2023-02-12 23:03:13,887 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993886"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242993886"}]},"ts":"1676242993886"} 2023-02-12 23:03:13,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03. 2023-02-12 23:03:13,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9b749c60a6e32651a314656be4e49b03: Waiting for close lock at 1676242993874Running coprocessor pre-close hooks at 1676242993874Disabling compacts and flushes for region at 1676242993874Disabling writes for close at 1676242993874Writing region close event to WAL at 1676242993879 (+5 ms)Running coprocessor post-close hooks at 1676242993886 (+7 ms)Closed at 1676242993895 (+9 ms) 2023-02-12 23:03:13,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:13,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:13,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 469c8d8500abd7ead7bb9f7741b8add8, disabling compactions & flushes 2023-02-12 23:03:13,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:13,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:13,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. after waiting 0 ms 2023-02-12 23:03:13,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:13,898 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9b749c60a6e32651a314656be4e49b03, regionState=CLOSED 2023-02-12 23:03:13,899 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993898"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242993898"}]},"ts":"1676242993898"} 2023-02-12 23:03:13,899 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-12 23:03:13,899 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure 54ca3cdd0d82711860e6a784b596d4ab, server=jenkins-hbase4.apache.org,43299,1676242981781 in 215 msec 2023-02-12 23:03:13,902 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=54ca3cdd0d82711860e6a784b596d4ab, UNASSIGN in 251 msec 2023-02-12 23:03:13,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:13,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717. 2023-02-12 23:03:13,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 514afecf3a82c32469d46e77b9303717: Waiting for close lock at 1676242993885Running coprocessor pre-close hooks at 1676242993885Disabling compacts and flushes for region at 1676242993885Disabling writes for close at 1676242993886 (+1 ms)Writing region close event to WAL at 1676242993897 (+11 ms)Running coprocessor post-close hooks at 1676242993904 (+7 ms)Closed at 1676242993905 (+1 ms) 2023-02-12 23:03:13,908 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=38 2023-02-12 23:03:13,908 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=38, state=SUCCESS; CloseRegionProcedure 9b749c60a6e32651a314656be4e49b03, server=jenkins-hbase4.apache.org,37521,1676242981734 in 223 msec 2023-02-12 23:03:13,909 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=514afecf3a82c32469d46e77b9303717, regionState=CLOSED 2023-02-12 23:03:13,909 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676242985738.514afecf3a82c32469d46e77b9303717.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993909"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242993909"}]},"ts":"1676242993909"} 2023-02-12 23:03:13,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:13,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:13,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 54b311bf6f51ce93e536f6a73aa344d5, disabling compactions & flushes 2023-02-12 23:03:13,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:13,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:13,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9b749c60a6e32651a314656be4e49b03, UNASSIGN in 259 msec 2023-02-12 23:03:13,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. after waiting 0 ms 2023-02-12 23:03:13,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:13,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:13,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=37 2023-02-12 23:03:13,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=37, state=SUCCESS; CloseRegionProcedure 514afecf3a82c32469d46e77b9303717, server=jenkins-hbase4.apache.org,43299,1676242981781 in 236 msec 2023-02-12 23:03:13,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8. 2023-02-12 23:03:13,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 469c8d8500abd7ead7bb9f7741b8add8: Waiting for close lock at 1676242993898Running coprocessor pre-close hooks at 1676242993898Disabling compacts and flushes for region at 1676242993898Disabling writes for close at 1676242993898Writing region close event to WAL at 1676242993904 (+6 ms)Running coprocessor post-close hooks at 1676242993915 (+11 ms)Closed at 1676242993916 (+1 ms) 2023-02-12 23:03:13,917 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=514afecf3a82c32469d46e77b9303717, UNASSIGN in 266 msec 2023-02-12 23:03:13,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:13,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:13,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2973c004b4284eb5f5a933a977f9b8b1, disabling compactions & flushes 2023-02-12 23:03:13,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:13,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:13,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. after waiting 0 ms 2023-02-12 23:03:13,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:13,918 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=469c8d8500abd7ead7bb9f7741b8add8, regionState=CLOSED 2023-02-12 23:03:13,918 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993918"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242993918"}]},"ts":"1676242993918"} 2023-02-12 23:03:13,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 23:03:13,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5. 2023-02-12 23:03:13,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 54b311bf6f51ce93e536f6a73aa344d5: Waiting for close lock at 1676242993911Running coprocessor pre-close hooks at 1676242993911Disabling compacts and flushes for region at 1676242993911Disabling writes for close at 1676242993911Writing region close event to WAL at 1676242993913 (+2 ms)Running coprocessor post-close hooks at 1676242993920 (+7 ms)Closed at 1676242993922 (+2 ms) 2023-02-12 23:03:13,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:13,926 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=54b311bf6f51ce93e536f6a73aa344d5, regionState=CLOSED 2023-02-12 23:03:13,926 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676242993926"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242993926"}]},"ts":"1676242993926"} 2023-02-12 23:03:13,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=41 2023-02-12 23:03:13,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=41, state=SUCCESS; CloseRegionProcedure 469c8d8500abd7ead7bb9f7741b8add8, server=jenkins-hbase4.apache.org,37521,1676242981734 in 262 msec 2023-02-12 23:03:13,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=469c8d8500abd7ead7bb9f7741b8add8, UNASSIGN in 278 msec 2023-02-12 23:03:13,930 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-12 23:03:13,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 54b311bf6f51ce93e536f6a73aa344d5, server=jenkins-hbase4.apache.org,43299,1676242981781 in 246 msec 2023-02-12 23:03:13,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=54b311bf6f51ce93e536f6a73aa344d5, UNASSIGN in 282 msec 2023-02-12 23:03:13,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:13,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1. 2023-02-12 23:03:13,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2973c004b4284eb5f5a933a977f9b8b1: Waiting for close lock at 1676242993918Running coprocessor pre-close hooks at 1676242993918Disabling compacts and flushes for region at 1676242993918Disabling writes for close at 1676242993918Writing region close event to WAL at 1676242993923 (+5 ms)Running coprocessor post-close hooks at 1676242993934 (+11 ms)Closed at 1676242993935 (+1 ms) 2023-02-12 23:03:13,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:13,937 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=2973c004b4284eb5f5a933a977f9b8b1, regionState=CLOSED 2023-02-12 23:03:13,937 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676242993937"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242993937"}]},"ts":"1676242993937"} 2023-02-12 23:03:13,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=39 2023-02-12 23:03:13,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=39, state=SUCCESS; CloseRegionProcedure 2973c004b4284eb5f5a933a977f9b8b1, server=jenkins-hbase4.apache.org,37521,1676242981734 in 274 msec 2023-02-12 23:03:13,944 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=33 2023-02-12 23:03:13,944 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2973c004b4284eb5f5a933a977f9b8b1, UNASSIGN in 292 msec 2023-02-12 23:03:13,945 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676242993945"}]},"ts":"1676242993945"} 2023-02-12 23:03:13,947 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-12 23:03:13,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 23:03:13,949 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-12 23:03:13,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 317 msec 2023-02-12 23:03:14,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 23:03:14,250 INFO [Listener at localhost/35801] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-12 23:03:14,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-12 23:03:14,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-12 23:03:14,264 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 23:03:14,266 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 23:03:14,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 23:03:14,281 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:14,281 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:14,281 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:14,281 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:14,282 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:14,282 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:14,282 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:14,282 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:14,286 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5/f1, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5/f2, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5/recovered.edits] 2023-02-12 23:03:14,286 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f1, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f2, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/recovered.edits] 2023-02-12 23:03:14,286 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f1, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f2, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/recovered.edits] 2023-02-12 23:03:14,287 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f1, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f2, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/recovered.edits] 2023-02-12 23:03:14,288 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f1, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f2, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/recovered.edits] 2023-02-12 23:03:14,289 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f1, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f2, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/recovered.edits] 2023-02-12 23:03:14,290 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f1, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f2, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/recovered.edits] 2023-02-12 23:03:14,290 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f1, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f2, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/recovered.edits] 2023-02-12 23:03:14,301 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f1/572f6d5935994b9383b829f1797c6641 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f1/572f6d5935994b9383b829f1797c6641 2023-02-12 23:03:14,301 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f1/7898be7957364556abe9dea7fa31eee2 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f1/7898be7957364556abe9dea7fa31eee2 2023-02-12 23:03:14,301 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f1/a157af2f073f420a9f9d532fb70320f1 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f1/a157af2f073f420a9f9d532fb70320f1 2023-02-12 23:03:14,302 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f1/775e400f2b0048afb7b9b626e6477721 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f1/775e400f2b0048afb7b9b626e6477721 2023-02-12 23:03:14,302 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f1/a8017410de2843269089bfe29fa7baa7 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f1/a8017410de2843269089bfe29fa7baa7 2023-02-12 23:03:14,303 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f1/380a44d1defe4b41a0122bdc9dedfa6a to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f1/380a44d1defe4b41a0122bdc9dedfa6a 2023-02-12 23:03:14,305 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f1/0c538667139f452793c4bb2e2f09ba99 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f1/0c538667139f452793c4bb2e2f09ba99 2023-02-12 23:03:14,305 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f1/c82ce22e2d774f1b861d5989b5b17f38 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f1/c82ce22e2d774f1b861d5989b5b17f38 2023-02-12 23:03:14,305 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5/recovered.edits/6.seqid to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5/recovered.edits/6.seqid 2023-02-12 23:03:14,306 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f1/cdd3358cf4f44d4fa4b47cd2b3e3c2d0 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f1/cdd3358cf4f44d4fa4b47cd2b3e3c2d0 2023-02-12 23:03:14,306 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f1/bdb7ce3f5dc148f5995c6c4647eb4ba2 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f1/bdb7ce3f5dc148f5995c6c4647eb4ba2 2023-02-12 23:03:14,307 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f1/eba2eb1e4dc34b60bebdf0c5360d2cc9 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f1/eba2eb1e4dc34b60bebdf0c5360d2cc9 2023-02-12 23:03:14,307 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f1/e507719e896342dabae4d60b658b1b64 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f1/e507719e896342dabae4d60b658b1b64 2023-02-12 23:03:14,307 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54b311bf6f51ce93e536f6a73aa344d5 2023-02-12 23:03:14,307 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:14,308 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f1/ed55a216e54c47f780d7a442229f10f1 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f1/ed55a216e54c47f780d7a442229f10f1 2023-02-12 23:03:14,310 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f1/85952e18553c4fd2b63e577dc9645caf to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f1/85952e18553c4fd2b63e577dc9645caf 2023-02-12 23:03:14,314 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f1, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f2, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/recovered.edits] 2023-02-12 23:03:14,316 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f2/d130866abfed4d579bf75a832b924420 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f2/d130866abfed4d579bf75a832b924420 2023-02-12 23:03:14,317 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f2/37bf1b5da85d46ccb092d3488b08def0 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f2/37bf1b5da85d46ccb092d3488b08def0 2023-02-12 23:03:14,317 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f2/7286c6da594a45cea02f64bbd8eca45c to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f2/7286c6da594a45cea02f64bbd8eca45c 2023-02-12 23:03:14,317 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f2/abe9d9f891a24f16a7f5daceb29cef55 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f2/abe9d9f891a24f16a7f5daceb29cef55 2023-02-12 23:03:14,318 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f2/2884d202f88c4315b89593f89f06e71d to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f2/2884d202f88c4315b89593f89f06e71d 2023-02-12 23:03:14,318 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f2/4e1fc3cabe2243f49f72bf183e05beed to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f2/4e1fc3cabe2243f49f72bf183e05beed 2023-02-12 23:03:14,321 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f2/096ce9e4a76d4c048793866910ad6eea to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f2/096ce9e4a76d4c048793866910ad6eea 2023-02-12 23:03:14,321 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f2/381da499ae9249d494d75edc3f72f95e to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/f2/381da499ae9249d494d75edc3f72f95e 2023-02-12 23:03:14,322 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f2/caa3049ed9ed4390b1fa3fa199fc8dca to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/f2/caa3049ed9ed4390b1fa3fa199fc8dca 2023-02-12 23:03:14,322 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f2/d15ef581514a413a844499a06d8201a2 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/f2/d15ef581514a413a844499a06d8201a2 2023-02-12 23:03:14,322 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f2/9dfb191111cb44c399fc66732e0852fe to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/f2/9dfb191111cb44c399fc66732e0852fe 2023-02-12 23:03:14,323 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f2/4b360e09e02b4a6f81b168f9cf8371df to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/f2/4b360e09e02b4a6f81b168f9cf8371df 2023-02-12 23:03:14,324 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f2/b37580da29054810ad3d2c1613f6f947 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/f2/b37580da29054810ad3d2c1613f6f947 2023-02-12 23:03:14,325 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f2/4bea40524ffc4b30a06e1655038df708 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/f2/4bea40524ffc4b30a06e1655038df708 2023-02-12 23:03:14,326 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f1/058ac748e9c343778f74488b11e06ccb to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f1/058ac748e9c343778f74488b11e06ccb 2023-02-12 23:03:14,334 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/recovered.edits/12.seqid to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b/recovered.edits/12.seqid 2023-02-12 23:03:14,335 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/recovered.edits/12.seqid to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8/recovered.edits/12.seqid 2023-02-12 23:03:14,335 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f1/9e69833931944e849f9b1f879aa51204 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f1/9e69833931944e849f9b1f879aa51204 2023-02-12 23:03:14,335 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/63f710c49b8d97bffccc8db53e57829b 2023-02-12 23:03:14,335 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:14,336 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/recovered.edits/12.seqid to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03/recovered.edits/12.seqid 2023-02-12 23:03:14,336 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/recovered.edits/12.seqid to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab/recovered.edits/12.seqid 2023-02-12 23:03:14,336 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/recovered.edits/12.seqid to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717/recovered.edits/12.seqid 2023-02-12 23:03:14,337 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/469c8d8500abd7ead7bb9f7741b8add8 2023-02-12 23:03:14,337 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/9b749c60a6e32651a314656be4e49b03 2023-02-12 23:03:14,337 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/54ca3cdd0d82711860e6a784b596d4ab 2023-02-12 23:03:14,338 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/recovered.edits/12.seqid to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1/recovered.edits/12.seqid 2023-02-12 23:03:14,338 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/recovered.edits/12.seqid to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12/recovered.edits/12.seqid 2023-02-12 23:03:14,338 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/514afecf3a82c32469d46e77b9303717 2023-02-12 23:03:14,339 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/2973c004b4284eb5f5a933a977f9b8b1 2023-02-12 23:03:14,339 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/62973a244615f8a20fc71cb2630dab12 2023-02-12 23:03:14,340 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3/f1, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3/f2, FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3/recovered.edits] 2023-02-12 23:03:14,342 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f2/14f4433d83a2460c91eb5da27d708a3e to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f2/14f4433d83a2460c91eb5da27d708a3e 2023-02-12 23:03:14,344 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f2/e404ee9f5d2c4bb486dd94a0dfe32798 to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/f2/e404ee9f5d2c4bb486dd94a0dfe32798 2023-02-12 23:03:14,347 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3/recovered.edits/6.seqid to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3/recovered.edits/6.seqid 2023-02-12 23:03:14,348 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/804d2c90c6989424a49411184f0845d3 2023-02-12 23:03:14,348 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/recovered.edits/12.seqid to hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/archive/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7/recovered.edits/12.seqid 2023-02-12 23:03:14,349 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/.tmp/data/default/testWithMapReduce/c7a8820caf3f3a0e38f5db61bfdd43a7 2023-02-12 23:03:14,349 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 23:03:14,351 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 23:03:14,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 23:03:14,376 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-12 23:03:14,384 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-12 23:03:14,386 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 23:03:14,386 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-12 23:03:14,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676242994386"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:14,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676242994386"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:14,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676242985738.62973a244615f8a20fc71cb2630dab12.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676242994386"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:14,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676242985738.514afecf3a82c32469d46e77b9303717.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676242994386"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:14,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676242994386"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:14,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676242994386"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:14,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676242994386"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:14,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676242994386"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:14,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676242994386"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:14,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676242994386"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:14,389 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-12 23:03:14,390 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 54b311bf6f51ce93e536f6a73aa344d5, NAME => 'testWithMapReduce,,1676242985738.54b311bf6f51ce93e536f6a73aa344d5.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 54ca3cdd0d82711860e6a784b596d4ab, NAME => 'testWithMapReduce,aaa,1676242985738.54ca3cdd0d82711860e6a784b596d4ab.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 62973a244615f8a20fc71cb2630dab12, NAME => 'testWithMapReduce,d\x84\x84,1676242985738.62973a244615f8a20fc71cb2630dab12.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 514afecf3a82c32469d46e77b9303717, NAME => 'testWithMapReduce,g\xA7\xA7,1676242985738.514afecf3a82c32469d46e77b9303717.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 9b749c60a6e32651a314656be4e49b03, NAME => 'testWithMapReduce,j\xCA\xCA,1676242985738.9b749c60a6e32651a314656be4e49b03.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 2973c004b4284eb5f5a933a977f9b8b1, NAME => 'testWithMapReduce,m\xED\xED,1676242985738.2973c004b4284eb5f5a933a977f9b8b1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 63f710c49b8d97bffccc8db53e57829b, NAME => 'testWithMapReduce,q\x11\x10,1676242985738.63f710c49b8d97bffccc8db53e57829b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 469c8d8500abd7ead7bb9f7741b8add8, NAME => 'testWithMapReduce,t43,1676242985738.469c8d8500abd7ead7bb9f7741b8add8.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => c7a8820caf3f3a0e38f5db61bfdd43a7, NAME => 'testWithMapReduce,wWV,1676242985738.c7a8820caf3f3a0e38f5db61bfdd43a7.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 804d2c90c6989424a49411184f0845d3, NAME => 'testWithMapReduce,zz{,1676242985738.804d2c90c6989424a49411184f0845d3.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-12 23:03:14,390 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-12 23:03:14,390 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676242994390"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:14,392 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-12 23:03:14,395 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 23:03:14,397 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 139 msec 2023-02-12 23:03:14,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 23:03:14,572 INFO [Listener at localhost/35801] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-12 23:03:14,572 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 23:03:14,572 INFO [Listener at localhost/35801] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 23:03:14,572 DEBUG [Listener at localhost/35801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b8ae91a to 127.0.0.1:56729 2023-02-12 23:03:14,572 DEBUG [Listener at localhost/35801] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:14,572 DEBUG [Listener at localhost/35801] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 23:03:14,573 DEBUG [Listener at localhost/35801] util.JVMClusterUtil(257): Found active master hash=256469361, stopped=false 2023-02-12 23:03:14,573 INFO [Listener at localhost/35801] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37697,1676242980558 2023-02-12 23:03:14,578 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:14,578 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:14,578 INFO [Listener at localhost/35801] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 23:03:14,578 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:14,578 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:14,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:14,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:14,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:14,580 DEBUG [Listener at localhost/35801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21ac6e48 to 127.0.0.1:56729 2023-02-12 23:03:14,580 DEBUG [Listener at localhost/35801] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:14,580 INFO [Listener at localhost/35801] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37521,1676242981734' ***** 2023-02-12 23:03:14,580 INFO [Listener at localhost/35801] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 23:03:14,580 INFO [Listener at localhost/35801] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43299,1676242981781' ***** 2023-02-12 23:03:14,580 INFO [Listener at localhost/35801] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 23:03:14,580 INFO [RS:0;jenkins-hbase4:37521] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 23:03:14,581 INFO [RS:0;jenkins-hbase4:37521] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 23:03:14,581 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 23:03:14,581 INFO [RS:0;jenkins-hbase4:37521] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 23:03:14,581 INFO [RS:1;jenkins-hbase4:43299] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 23:03:14,582 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 23:03:14,582 INFO [RS:1;jenkins-hbase4:43299] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 23:03:14,582 INFO [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(3304): Received CLOSE for 6b22c2b1305adca8d3f7f5b72815c88a 2023-02-12 23:03:14,582 INFO [RS:1;jenkins-hbase4:43299] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 23:03:14,583 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:14,583 INFO [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:14,583 DEBUG [RS:1;jenkins-hbase4:43299] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64674c53 to 127.0.0.1:56729 2023-02-12 23:03:14,583 DEBUG [RS:0;jenkins-hbase4:37521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x216ef8e8 to 127.0.0.1:56729 2023-02-12 23:03:14,583 DEBUG [RS:1;jenkins-hbase4:43299] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:14,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6b22c2b1305adca8d3f7f5b72815c88a, disabling compactions & flushes 2023-02-12 23:03:14,584 INFO [RS:1;jenkins-hbase4:43299] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 23:03:14,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a. 2023-02-12 23:03:14,584 INFO [RS:1;jenkins-hbase4:43299] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 23:03:14,584 INFO [RS:1;jenkins-hbase4:43299] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 23:03:14,584 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 23:03:14,584 DEBUG [RS:0;jenkins-hbase4:37521] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:14,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a. 2023-02-12 23:03:14,584 INFO [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 23:03:14,584 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 23:03:14,585 DEBUG [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(1479): Online Regions={6b22c2b1305adca8d3f7f5b72815c88a=hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a.} 2023-02-12 23:03:14,585 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 23:03:14,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a. after waiting 0 ms 2023-02-12 23:03:14,585 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 23:03:14,585 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 23:03:14,585 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 23:03:14,585 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 23:03:14,585 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 23:03:14,585 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-12 23:03:14,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a. 2023-02-12 23:03:14,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 6b22c2b1305adca8d3f7f5b72815c88a 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 23:03:14,587 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 23:03:14,587 DEBUG [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(1505): Waiting on 6b22c2b1305adca8d3f7f5b72815c88a 2023-02-12 23:03:14,608 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/namespace/6b22c2b1305adca8d3f7f5b72815c88a/.tmp/info/e56fc00ae9254d3c832fd2167b71e080 2023-02-12 23:03:14,612 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/.tmp/info/6d5ff77c873d46f4a14602c862eb15ee 2023-02-12 23:03:14,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/namespace/6b22c2b1305adca8d3f7f5b72815c88a/.tmp/info/e56fc00ae9254d3c832fd2167b71e080 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/namespace/6b22c2b1305adca8d3f7f5b72815c88a/info/e56fc00ae9254d3c832fd2167b71e080 2023-02-12 23:03:14,619 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d5ff77c873d46f4a14602c862eb15ee 2023-02-12 23:03:14,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/namespace/6b22c2b1305adca8d3f7f5b72815c88a/info/e56fc00ae9254d3c832fd2167b71e080, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 23:03:14,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6b22c2b1305adca8d3f7f5b72815c88a in 50ms, sequenceid=6, compaction requested=false 2023-02-12 23:03:14,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/namespace/6b22c2b1305adca8d3f7f5b72815c88a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 23:03:14,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a. 2023-02-12 23:03:14,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6b22c2b1305adca8d3f7f5b72815c88a: Waiting for close lock at 1676242994583Running coprocessor pre-close hooks at 1676242994583Disabling compacts and flushes for region at 1676242994583Disabling writes for close at 1676242994585 (+2 ms)Obtaining lock to block concurrent updates at 1676242994586 (+1 ms)Preparing flush snapshotting stores in 6b22c2b1305adca8d3f7f5b72815c88a at 1676242994586Finished memstore snapshotting hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676242994586Flushing stores of hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a. at 1676242994587 (+1 ms)Flushing 6b22c2b1305adca8d3f7f5b72815c88a/info: creating writer at 1676242994587Flushing 6b22c2b1305adca8d3f7f5b72815c88a/info: appending metadata at 1676242994590 (+3 ms)Flushing 6b22c2b1305adca8d3f7f5b72815c88a/info: closing flushed file at 1676242994590Flushing 6b22c2b1305adca8d3f7f5b72815c88a/info: reopening flushed file at 1676242994619 (+29 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6b22c2b1305adca8d3f7f5b72815c88a in 50ms, sequenceid=6, compaction requested=false at 1676242994635 (+16 ms)Writing region close event to WAL at 1676242994639 (+4 ms)Running coprocessor post-close hooks at 1676242994649 (+10 ms)Closed at 1676242994649 2023-02-12 23:03:14,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676242984772.6b22c2b1305adca8d3f7f5b72815c88a. 2023-02-12 23:03:14,670 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:14,670 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:14,787 INFO [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37521,1676242981734; all regions closed. 2023-02-12 23:03:14,787 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 23:03:14,797 DEBUG [RS:0;jenkins-hbase4:37521] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/oldWALs 2023-02-12 23:03:14,797 INFO [RS:0;jenkins-hbase4:37521] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37521%2C1676242981734:(num 1676242985203) 2023-02-12 23:03:14,797 DEBUG [RS:0;jenkins-hbase4:37521] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:14,797 INFO [RS:0;jenkins-hbase4:37521] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:14,798 INFO [RS:0;jenkins-hbase4:37521] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 23:03:14,798 INFO [RS:0;jenkins-hbase4:37521] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 23:03:14,798 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:14,798 INFO [RS:0;jenkins-hbase4:37521] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 23:03:14,798 INFO [RS:0;jenkins-hbase4:37521] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 23:03:14,799 INFO [RS:0;jenkins-hbase4:37521] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37521 2023-02-12 23:03:14,808 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:14,808 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:14,808 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37521,1676242981734 2023-02-12 23:03:14,808 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:14,809 ERROR [Listener at localhost/35801-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5f2bd4ca rejected from java.util.concurrent.ThreadPoolExecutor@5b144bf7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:14,809 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:14,809 ERROR [Listener at localhost/35801-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ece3dac rejected from java.util.concurrent.ThreadPoolExecutor@5b144bf7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:14,809 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37521,1676242981734] 2023-02-12 23:03:14,809 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37521,1676242981734; numProcessing=1 2023-02-12 23:03:14,811 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37521,1676242981734 already deleted, retry=false 2023-02-12 23:03:14,811 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37521,1676242981734 expired; onlineServers=1 2023-02-12 23:03:14,978 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:14,978 INFO [RS:0;jenkins-hbase4:37521] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37521,1676242981734; zookeeper connection closed. 2023-02-12 23:03:14,978 ERROR [Listener at localhost/35801-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56f09cc7 rejected from java.util.concurrent.ThreadPoolExecutor@5b144bf7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:14,978 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:37521-0x1004ac5f4f20001, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:14,978 ERROR [Listener at localhost/35801-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@21c55088 rejected from java.util.concurrent.ThreadPoolExecutor@5b144bf7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:14,978 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@36086dc6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@36086dc6 2023-02-12 23:03:14,987 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 23:03:15,046 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/.tmp/rep_barrier/23b19b0be7bc46daba681291169defdd 2023-02-12 23:03:15,053 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23b19b0be7bc46daba681291169defdd 2023-02-12 23:03:15,063 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/.tmp/table/6a07a03451a9488da189ee875cb177f4 2023-02-12 23:03:15,068 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a07a03451a9488da189ee875cb177f4 2023-02-12 23:03:15,069 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/.tmp/info/6d5ff77c873d46f4a14602c862eb15ee as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/info/6d5ff77c873d46f4a14602c862eb15ee 2023-02-12 23:03:15,074 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d5ff77c873d46f4a14602c862eb15ee 2023-02-12 23:03:15,074 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/info/6d5ff77c873d46f4a14602c862eb15ee, entries=30, sequenceid=57, filesize=7.9 K 2023-02-12 23:03:15,075 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/.tmp/rep_barrier/23b19b0be7bc46daba681291169defdd as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/rep_barrier/23b19b0be7bc46daba681291169defdd 2023-02-12 23:03:15,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23b19b0be7bc46daba681291169defdd 2023-02-12 23:03:15,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/rep_barrier/23b19b0be7bc46daba681291169defdd, entries=10, sequenceid=57, filesize=5.9 K 2023-02-12 23:03:15,080 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/.tmp/table/6a07a03451a9488da189ee875cb177f4 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/table/6a07a03451a9488da189ee875cb177f4 2023-02-12 23:03:15,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a07a03451a9488da189ee875cb177f4 2023-02-12 23:03:15,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/table/6a07a03451a9488da189ee875cb177f4, entries=13, sequenceid=57, filesize=5.9 K 2023-02-12 23:03:15,087 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 502ms, sequenceid=57, compaction requested=false 2023-02-12 23:03:15,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-12 23:03:15,095 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 23:03:15,096 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:15,096 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676242994584Running coprocessor pre-close hooks at 1676242994584Disabling compacts and flushes for region at 1676242994584Disabling writes for close at 1676242994585 (+1 ms)Obtaining lock to block concurrent updates at 1676242994585Preparing flush snapshotting stores in 1588230740 at 1676242994585Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1676242994586 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676242994587 (+1 ms)Flushing 1588230740/info: creating writer at 1676242994587Flushing 1588230740/info: appending metadata at 1676242994592 (+5 ms)Flushing 1588230740/info: closing flushed file at 1676242994592Flushing 1588230740/rep_barrier: creating writer at 1676242994620 (+28 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676242994622 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676242994622Flushing 1588230740/table: creating writer at 1676242995053 (+431 ms)Flushing 1588230740/table: appending metadata at 1676242995056 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676242995056Flushing 1588230740/info: reopening flushed file at 1676242995069 (+13 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676242995075 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1676242995081 (+6 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 502ms, sequenceid=57, compaction requested=false at 1676242995087 (+6 ms)Writing region close event to WAL at 1676242995091 (+4 ms)Running coprocessor post-close hooks at 1676242995095 (+4 ms)Closed at 1676242995096 (+1 ms) 2023-02-12 23:03:15,096 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:15,126 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-12 23:03:15,127 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-12 23:03:15,187 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43299,1676242981781; all regions closed. 2023-02-12 23:03:15,194 DEBUG [RS:1;jenkins-hbase4:43299] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/oldWALs 2023-02-12 23:03:15,194 INFO [RS:1;jenkins-hbase4:43299] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43299%2C1676242981781.meta:.meta(num 1676242984505) 2023-02-12 23:03:15,199 DEBUG [RS:1;jenkins-hbase4:43299] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/oldWALs 2023-02-12 23:03:15,199 INFO [RS:1;jenkins-hbase4:43299] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43299%2C1676242981781:(num 1676242985194) 2023-02-12 23:03:15,199 DEBUG [RS:1;jenkins-hbase4:43299] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:15,199 INFO [RS:1;jenkins-hbase4:43299] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:15,199 INFO [RS:1;jenkins-hbase4:43299] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 23:03:15,200 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:15,200 INFO [RS:1;jenkins-hbase4:43299] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43299 2023-02-12 23:03:15,203 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:15,203 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43299,1676242981781 2023-02-12 23:03:15,203 ERROR [Listener at localhost/35801-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1dfc49ea rejected from java.util.concurrent.ThreadPoolExecutor@19c3ce8d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:15,204 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43299,1676242981781] 2023-02-12 23:03:15,204 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43299,1676242981781; numProcessing=2 2023-02-12 23:03:15,207 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43299,1676242981781 already deleted, retry=false 2023-02-12 23:03:15,207 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43299,1676242981781 expired; onlineServers=0 2023-02-12 23:03:15,207 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37697,1676242980558' ***** 2023-02-12 23:03:15,207 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 23:03:15,207 DEBUG [M:0;jenkins-hbase4:37697] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e74634a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:15,207 INFO [M:0;jenkins-hbase4:37697] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37697,1676242980558 2023-02-12 23:03:15,207 INFO [M:0;jenkins-hbase4:37697] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37697,1676242980558; all regions closed. 2023-02-12 23:03:15,207 DEBUG [M:0;jenkins-hbase4:37697] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:15,208 DEBUG [M:0;jenkins-hbase4:37697] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 23:03:15,208 DEBUG [M:0;jenkins-hbase4:37697] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 23:03:15,208 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 23:03:15,208 INFO [M:0;jenkins-hbase4:37697] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 23:03:15,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676242983015] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676242983015,5,FailOnTimeoutGroup] 2023-02-12 23:03:15,209 INFO [M:0;jenkins-hbase4:37697] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 23:03:15,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676242983015] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676242983015,5,FailOnTimeoutGroup] 2023-02-12 23:03:15,210 INFO [M:0;jenkins-hbase4:37697] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 23:03:15,210 DEBUG [M:0;jenkins-hbase4:37697] master.HMaster(1502): Stopping service threads 2023-02-12 23:03:15,210 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:15,210 INFO [M:0;jenkins-hbase4:37697] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 23:03:15,210 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:15,211 ERROR [M:0;jenkins-hbase4:37697] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-12 23:03:15,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:15,212 INFO [M:0;jenkins-hbase4:37697] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 23:03:15,212 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 23:03:15,212 DEBUG [M:0;jenkins-hbase4:37697] zookeeper.ZKUtil(398): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 23:03:15,212 WARN [M:0;jenkins-hbase4:37697] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 23:03:15,212 INFO [M:0;jenkins-hbase4:37697] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 23:03:15,212 INFO [M:0;jenkins-hbase4:37697] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 23:03:15,213 DEBUG [M:0;jenkins-hbase4:37697] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 23:03:15,213 INFO [M:0;jenkins-hbase4:37697] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:15,213 DEBUG [M:0;jenkins-hbase4:37697] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:15,213 DEBUG [M:0;jenkins-hbase4:37697] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 23:03:15,213 DEBUG [M:0;jenkins-hbase4:37697] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:15,213 INFO [M:0;jenkins-hbase4:37697] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.22 KB heapSize=192.14 KB 2023-02-12 23:03:15,234 INFO [M:0;jenkins-hbase4:37697] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.22 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c44eabf00cf24ae399fc244489fdf8f3 2023-02-12 23:03:15,241 DEBUG [M:0;jenkins-hbase4:37697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c44eabf00cf24ae399fc244489fdf8f3 as hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c44eabf00cf24ae399fc244489fdf8f3 2023-02-12 23:03:15,247 INFO [M:0;jenkins-hbase4:37697] regionserver.HStore(1080): Added hdfs://localhost:38615/user/jenkins/test-data/2f7de28c-fb26-2f81-2d88-682471196a3d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c44eabf00cf24ae399fc244489fdf8f3, entries=53, sequenceid=357, filesize=10.4 K 2023-02-12 23:03:15,248 INFO [M:0;jenkins-hbase4:37697] regionserver.HRegion(2947): Finished flush of dataSize ~159.22 KB/163044, heapSize ~192.13 KB/196736, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 35ms, sequenceid=357, compaction requested=false 2023-02-12 23:03:15,250 INFO [M:0;jenkins-hbase4:37697] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:15,250 DEBUG [M:0;jenkins-hbase4:37697] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676242995213Disabling compacts and flushes for region at 1676242995213Disabling writes for close at 1676242995213Obtaining lock to block concurrent updates at 1676242995213Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676242995213Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163044, getHeapSize=196736, getOffHeapSize=0, getCellsCount=442 at 1676242995213Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676242995214 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676242995215 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676242995219 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676242995219Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676242995242 (+23 ms)Finished flush of dataSize ~159.22 KB/163044, heapSize ~192.13 KB/196736, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 35ms, sequenceid=357, compaction requested=false at 1676242995248 (+6 ms)Writing region close event to WAL at 1676242995250 (+2 ms)Closed at 1676242995250 2023-02-12 23:03:15,254 INFO [M:0;jenkins-hbase4:37697] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 23:03:15,254 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:15,255 INFO [M:0;jenkins-hbase4:37697] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37697 2023-02-12 23:03:15,259 DEBUG [M:0;jenkins-hbase4:37697] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37697,1676242980558 already deleted, retry=false 2023-02-12 23:03:15,304 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:15,304 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43299,1676242981781; zookeeper connection closed. 2023-02-12 23:03:15,305 ERROR [Listener at localhost/35801-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@129b11f9 rejected from java.util.concurrent.ThreadPoolExecutor@19c3ce8d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:15,305 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x1004ac5f4f20002, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:15,305 ERROR [Listener at localhost/35801-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a67b5c8 rejected from java.util.concurrent.ThreadPoolExecutor@19c3ce8d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:15,305 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4c472ac9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4c472ac9 2023-02-12 23:03:15,306 INFO [Listener at localhost/35801] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 23:03:15,405 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:15,405 INFO [M:0;jenkins-hbase4:37697] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37697,1676242980558; zookeeper connection closed. 2023-02-12 23:03:15,405 ERROR [Listener at localhost/35801-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@21f653d6 rejected from java.util.concurrent.ThreadPoolExecutor@4d8c85c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:15,405 DEBUG [Listener at localhost/35801-EventThread] zookeeper.ZKWatcher(600): master:37697-0x1004ac5f4f20000, quorum=127.0.0.1:56729, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:15,405 ERROR [Listener at localhost/35801-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4effae78 rejected from java.util.concurrent.ThreadPoolExecutor@4d8c85c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:15,407 WARN [Listener at localhost/35801] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 23:03:15,411 INFO [Listener at localhost/35801] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:15,516 WARN [BP-2020686103-172.31.14.131-1676242976981 heartbeating to localhost/127.0.0.1:38615] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 23:03:15,516 WARN [BP-2020686103-172.31.14.131-1676242976981 heartbeating to localhost/127.0.0.1:38615] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2020686103-172.31.14.131-1676242976981 (Datanode Uuid 519d374f-d769-4e85-96f8-7ba7b3715c4e) service to localhost/127.0.0.1:38615 2023-02-12 23:03:15,518 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/cluster_74a21e0e-05c0-1741-5c23-b26ea8e7d86f/dfs/data/data3/current/BP-2020686103-172.31.14.131-1676242976981] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:15,519 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/cluster_74a21e0e-05c0-1741-5c23-b26ea8e7d86f/dfs/data/data4/current/BP-2020686103-172.31.14.131-1676242976981] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:15,521 WARN [Listener at localhost/35801] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 23:03:15,528 INFO [Listener at localhost/35801] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:15,534 WARN [BP-2020686103-172.31.14.131-1676242976981 heartbeating to localhost/127.0.0.1:38615] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 23:03:15,534 WARN [BP-2020686103-172.31.14.131-1676242976981 heartbeating to localhost/127.0.0.1:38615] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2020686103-172.31.14.131-1676242976981 (Datanode Uuid a9a39106-14f3-4441-864f-e355bf474f80) service to localhost/127.0.0.1:38615 2023-02-12 23:03:15,535 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/cluster_74a21e0e-05c0-1741-5c23-b26ea8e7d86f/dfs/data/data1/current/BP-2020686103-172.31.14.131-1676242976981] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:15,535 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/cluster_74a21e0e-05c0-1741-5c23-b26ea8e7d86f/dfs/data/data2/current/BP-2020686103-172.31.14.131-1676242976981] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:15,577 INFO [Listener at localhost/35801] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:15,700 INFO [Listener at localhost/35801] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 23:03:15,770 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 23:03:15,786 INFO [Listener at localhost/35801] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:38615 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35801 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:38615 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:38615 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:38615 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38615 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37697,1676242980558)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:38615 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@646d3976 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:38615 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=538 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=211 (was 247), ProcessCount=165 (was 165), AvailableMemoryMB=4254 (was 5327) 2023-02-12 23:03:15,796 INFO [Listener at localhost/35801] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=538, MaxFileDescriptor=60000, SystemLoadAverage=211, ProcessCount=165, AvailableMemoryMB=4254 2023-02-12 23:03:15,807 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/hadoop.log.dir so I do NOT create it in target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90 2023-02-12 23:03:15,807 WARN [Listener at localhost/35801] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 23:03:15,807 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/hadoop.tmp.dir so I do NOT create it in target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90 2023-02-12 23:03:15,807 WARN [Listener at localhost/35801] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/db2dad8c-a5ac-b281-0464-3e9938fd1a77/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 23:03:15,807 DEBUG [Listener at localhost/35801] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90 2023-02-12 23:03:15,807 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 23:03:15,807 INFO [Listener at localhost/35801] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/cluster_04a8d1d7-5be1-0c44-dc1b-904ae1c1ca0d, deleteOnExit=true 2023-02-12 23:03:15,807 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 23:03:15,807 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/test.cache.data in system properties and HBase conf 2023-02-12 23:03:15,807 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 23:03:15,808 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/hadoop.log.dir in system properties and HBase conf 2023-02-12 23:03:15,808 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 23:03:15,808 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 23:03:15,808 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 23:03:15,808 DEBUG [Listener at localhost/35801] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 23:03:15,808 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 23:03:15,808 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 23:03:15,808 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 23:03:15,808 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 23:03:15,809 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 23:03:15,809 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 23:03:15,809 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 23:03:15,809 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 23:03:15,809 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 23:03:15,809 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/nfs.dump.dir in system properties and HBase conf 2023-02-12 23:03:15,809 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/java.io.tmpdir in system properties and HBase conf 2023-02-12 23:03:15,809 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 23:03:15,810 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 23:03:15,810 INFO [Listener at localhost/35801] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 23:03:15,815 WARN [Listener at localhost/35801] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 23:03:15,815 WARN [Listener at localhost/35801] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 23:03:15,868 WARN [Listener at localhost/35801] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:15,870 INFO [Listener at localhost/35801] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:15,874 INFO [Listener at localhost/35801] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/java.io.tmpdir/Jetty_localhost_40319_hdfs____.wr67qv/webapp 2023-02-12 23:03:16,008 INFO [Listener at localhost/35801] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40319 2023-02-12 23:03:16,013 WARN [Listener at localhost/35801] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 23:03:16,013 WARN [Listener at localhost/35801] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 23:03:16,068 WARN [Listener at localhost/44231] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:16,096 WARN [Listener at localhost/44231] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 23:03:16,100 WARN [Listener at localhost/44231] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:16,101 INFO [Listener at localhost/44231] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:16,110 INFO [Listener at localhost/44231] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/java.io.tmpdir/Jetty_localhost_43913_datanode____.nt7yzh/webapp 2023-02-12 23:03:16,240 INFO [Listener at localhost/44231] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43913 2023-02-12 23:03:16,260 WARN [Listener at localhost/40249] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:16,364 WARN [Listener at localhost/40249] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 23:03:16,372 WARN [Listener at localhost/40249] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:16,373 INFO [Listener at localhost/40249] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:16,378 INFO [Listener at localhost/40249] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/java.io.tmpdir/Jetty_localhost_35035_datanode____.trsk6h/webapp 2023-02-12 23:03:16,500 INFO [Listener at localhost/40249] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35035 2023-02-12 23:03:16,509 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe47d37b63b9c8fed: Processing first storage report for DS-c99868be-1abd-4287-af81-052de6f8714f from datanode 2f46b9af-4748-4a2e-bebf-444cba938ef5 2023-02-12 23:03:16,509 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe47d37b63b9c8fed: from storage DS-c99868be-1abd-4287-af81-052de6f8714f node DatanodeRegistration(127.0.0.1:33849, datanodeUuid=2f46b9af-4748-4a2e-bebf-444cba938ef5, infoPort=37931, infoSecurePort=0, ipcPort=40249, storageInfo=lv=-57;cid=testClusterID;nsid=16784226;c=1676242995817), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:16,509 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe47d37b63b9c8fed: Processing first storage report for DS-c197e5f2-8fb8-448b-b5b5-cf15273c4a6f from datanode 2f46b9af-4748-4a2e-bebf-444cba938ef5 2023-02-12 23:03:16,510 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe47d37b63b9c8fed: from storage DS-c197e5f2-8fb8-448b-b5b5-cf15273c4a6f node DatanodeRegistration(127.0.0.1:33849, datanodeUuid=2f46b9af-4748-4a2e-bebf-444cba938ef5, infoPort=37931, infoSecurePort=0, ipcPort=40249, storageInfo=lv=-57;cid=testClusterID;nsid=16784226;c=1676242995817), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-12 23:03:16,515 WARN [Listener at localhost/37407] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:16,632 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf0e3fb162be08462: Processing first storage report for DS-91671158-514c-4bc0-9286-ab9d81d49e6c from datanode 2f1191a0-3d7f-48eb-b0fc-1de759b2ee55 2023-02-12 23:03:16,633 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf0e3fb162be08462: from storage DS-91671158-514c-4bc0-9286-ab9d81d49e6c node DatanodeRegistration(127.0.0.1:46417, datanodeUuid=2f1191a0-3d7f-48eb-b0fc-1de759b2ee55, infoPort=41211, infoSecurePort=0, ipcPort=37407, storageInfo=lv=-57;cid=testClusterID;nsid=16784226;c=1676242995817), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-12 23:03:16,633 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf0e3fb162be08462: Processing first storage report for DS-2768c8e8-2c91-43e5-8d89-aa07283aaf14 from datanode 2f1191a0-3d7f-48eb-b0fc-1de759b2ee55 2023-02-12 23:03:16,633 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf0e3fb162be08462: from storage DS-2768c8e8-2c91-43e5-8d89-aa07283aaf14 node DatanodeRegistration(127.0.0.1:46417, datanodeUuid=2f1191a0-3d7f-48eb-b0fc-1de759b2ee55, infoPort=41211, infoSecurePort=0, ipcPort=37407, storageInfo=lv=-57;cid=testClusterID;nsid=16784226;c=1676242995817), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:16,640 DEBUG [Listener at localhost/37407] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90 2023-02-12 23:03:16,649 INFO [Listener at localhost/37407] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/cluster_04a8d1d7-5be1-0c44-dc1b-904ae1c1ca0d/zookeeper_0, clientPort=53472, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/cluster_04a8d1d7-5be1-0c44-dc1b-904ae1c1ca0d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/cluster_04a8d1d7-5be1-0c44-dc1b-904ae1c1ca0d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 23:03:16,651 INFO [Listener at localhost/37407] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53472 2023-02-12 23:03:16,651 INFO [Listener at localhost/37407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:16,652 INFO [Listener at localhost/37407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:16,678 INFO [Listener at localhost/37407] util.FSUtils(479): Created version file at hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee with version=8 2023-02-12 23:03:16,678 INFO [Listener at localhost/37407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:16,680 INFO [Listener at localhost/37407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:16,686 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/hbase-staging 2023-02-12 23:03:16,688 INFO [Listener at localhost/37407] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:16,688 INFO [Listener at localhost/37407] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:16,688 INFO [Listener at localhost/37407] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:16,689 INFO [Listener at localhost/37407] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:16,689 INFO [Listener at localhost/37407] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:16,689 INFO [Listener at localhost/37407] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:16,689 INFO [Listener at localhost/37407] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:16,691 INFO [Listener at localhost/37407] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39753 2023-02-12 23:03:16,692 INFO [Listener at localhost/37407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:16,693 INFO [Listener at localhost/37407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:16,694 INFO [Listener at localhost/37407] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39753 connecting to ZooKeeper ensemble=127.0.0.1:53472 2023-02-12 23:03:16,715 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:397530x0, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:16,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39753-0x1004ac6376d0000 connected 2023-02-12 23:03:16,740 DEBUG [Listener at localhost/37407] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:16,740 DEBUG [Listener at localhost/37407] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:16,741 DEBUG [Listener at localhost/37407] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:16,742 DEBUG [Listener at localhost/37407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39753 2023-02-12 23:03:16,744 DEBUG [Listener at localhost/37407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39753 2023-02-12 23:03:16,744 DEBUG [Listener at localhost/37407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39753 2023-02-12 23:03:16,748 DEBUG [Listener at localhost/37407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39753 2023-02-12 23:03:16,748 DEBUG [Listener at localhost/37407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39753 2023-02-12 23:03:16,748 INFO [Listener at localhost/37407] master.HMaster(439): hbase.rootdir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee, hbase.cluster.distributed=false 2023-02-12 23:03:16,771 INFO [Listener at localhost/37407] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:16,771 INFO [Listener at localhost/37407] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:16,772 INFO [Listener at localhost/37407] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:16,772 INFO [Listener at localhost/37407] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:16,772 INFO [Listener at localhost/37407] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:16,772 INFO [Listener at localhost/37407] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:16,772 INFO [Listener at localhost/37407] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:16,776 INFO [Listener at localhost/37407] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45545 2023-02-12 23:03:16,777 INFO [Listener at localhost/37407] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 23:03:16,778 DEBUG [Listener at localhost/37407] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:16,779 INFO [Listener at localhost/37407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:16,780 INFO [Listener at localhost/37407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:16,781 INFO [Listener at localhost/37407] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45545 connecting to ZooKeeper ensemble=127.0.0.1:53472 2023-02-12 23:03:16,788 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:455450x0, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:16,789 DEBUG [Listener at localhost/37407] zookeeper.ZKUtil(164): regionserver:455450x0, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:16,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45545-0x1004ac6376d0001 connected 2023-02-12 23:03:16,792 DEBUG [Listener at localhost/37407] zookeeper.ZKUtil(164): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:16,793 DEBUG [Listener at localhost/37407] zookeeper.ZKUtil(164): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:16,796 DEBUG [Listener at localhost/37407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45545 2023-02-12 23:03:16,796 DEBUG [Listener at localhost/37407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45545 2023-02-12 23:03:16,796 DEBUG [Listener at localhost/37407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45545 2023-02-12 23:03:16,797 DEBUG [Listener at localhost/37407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45545 2023-02-12 23:03:16,797 DEBUG [Listener at localhost/37407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45545 2023-02-12 23:03:16,811 INFO [Listener at localhost/37407] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:16,811 INFO [Listener at localhost/37407] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:16,811 INFO [Listener at localhost/37407] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:16,811 INFO [Listener at localhost/37407] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:16,812 INFO [Listener at localhost/37407] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:16,812 INFO [Listener at localhost/37407] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:16,812 INFO [Listener at localhost/37407] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:16,815 INFO [Listener at localhost/37407] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34617 2023-02-12 23:03:16,815 INFO [Listener at localhost/37407] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 23:03:16,816 DEBUG [Listener at localhost/37407] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:16,817 INFO [Listener at localhost/37407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:16,818 INFO [Listener at localhost/37407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:16,819 INFO [Listener at localhost/37407] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34617 connecting to ZooKeeper ensemble=127.0.0.1:53472 2023-02-12 23:03:16,823 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:346170x0, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:16,824 DEBUG [Listener at localhost/37407] zookeeper.ZKUtil(164): regionserver:346170x0, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:16,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34617-0x1004ac6376d0002 connected 2023-02-12 23:03:16,824 DEBUG [Listener at localhost/37407] zookeeper.ZKUtil(164): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:16,825 DEBUG [Listener at localhost/37407] zookeeper.ZKUtil(164): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:16,828 DEBUG [Listener at localhost/37407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34617 2023-02-12 23:03:16,828 DEBUG [Listener at localhost/37407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34617 2023-02-12 23:03:16,828 DEBUG [Listener at localhost/37407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34617 2023-02-12 23:03:16,832 DEBUG [Listener at localhost/37407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34617 2023-02-12 23:03:16,833 DEBUG [Listener at localhost/37407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34617 2023-02-12 23:03:16,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39753,1676242996687 2023-02-12 23:03:16,838 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 23:03:16,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39753,1676242996687 2023-02-12 23:03:16,840 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:16,840 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:16,840 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:16,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 23:03:16,844 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:16,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 23:03:16,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39753,1676242996687 from backup master directory 2023-02-12 23:03:16,848 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39753,1676242996687 2023-02-12 23:03:16,848 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 23:03:16,848 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:16,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,39753,1676242996687 2023-02-12 23:03:16,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/hbase.id with ID: 3c42141e-8e13-46d7-8176-5a92a843c845 2023-02-12 23:03:16,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:16,901 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:16,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5242d91f to 127.0.0.1:53472 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:16,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b829a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:16,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:16,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 23:03:16,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:16,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/MasterData/data/master/store-tmp 2023-02-12 23:03:16,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:16,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 23:03:16,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:16,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:16,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 23:03:16,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:16,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:16,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676242996935Disabling compacts and flushes for region at 1676242996935Disabling writes for close at 1676242996935Writing region close event to WAL at 1676242996935Closed at 1676242996935 2023-02-12 23:03:16,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/MasterData/WALs/jenkins-hbase4.apache.org,39753,1676242996687 2023-02-12 23:03:16,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39753%2C1676242996687, suffix=, logDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/MasterData/WALs/jenkins-hbase4.apache.org,39753,1676242996687, archiveDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/MasterData/oldWALs, maxLogs=10 2023-02-12 23:03:16,956 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46417,DS-91671158-514c-4bc0-9286-ab9d81d49e6c,DISK] 2023-02-12 23:03:16,956 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33849,DS-c99868be-1abd-4287-af81-052de6f8714f,DISK] 2023-02-12 23:03:16,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/MasterData/WALs/jenkins-hbase4.apache.org,39753,1676242996687/jenkins-hbase4.apache.org%2C39753%2C1676242996687.1676242996939 2023-02-12 23:03:16,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46417,DS-91671158-514c-4bc0-9286-ab9d81d49e6c,DISK], DatanodeInfoWithStorage[127.0.0.1:33849,DS-c99868be-1abd-4287-af81-052de6f8714f,DISK]] 2023-02-12 23:03:16,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:16,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:16,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:16,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:16,968 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:16,969 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 23:03:16,970 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 23:03:16,970 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:16,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:16,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:16,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:16,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:16,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62619356, jitterRate=-0.0668988823890686}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 23:03:16,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676242996963Initializing all the Stores at 1676242996964 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242996964Cleaning up temporary data from old regions at 1676242996972 (+8 ms)Cleaning up detritus from prior splits at 1676242996973 (+1 ms)Region opened successfully at 1676242996981 (+8 ms) 2023-02-12 23:03:16,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 23:03:16,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 23:03:16,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 23:03:16,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 23:03:16,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 23:03:16,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 23:03:16,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 23:03:16,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 23:03:16,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 23:03:16,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 23:03:16,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 23:03:17,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 23:03:17,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 23:03:17,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 23:03:17,069 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:17,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 23:03:17,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 23:03:17,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 23:03:17,099 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:17,100 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:17,100 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:17,100 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:17,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,39753,1676242996687, sessionid=0x1004ac6376d0000, setting cluster-up flag (Was=false) 2023-02-12 23:03:17,223 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:17,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 23:03:17,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39753,1676242996687 2023-02-12 23:03:17,438 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:17,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 23:03:17,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39753,1676242996687 2023-02-12 23:03:17,555 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.hbase-snapshot/.tmp 2023-02-12 23:03:17,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:17,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:17,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:17,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:17,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:17,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 23:03:17,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:17,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:17,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:17,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676243027560 2023-02-12 23:03:17,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 23:03:17,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 23:03:17,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 23:03:17,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 23:03:17,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 23:03:17,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 23:03:17,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:17,560 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:17,561 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 23:03:17,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 23:03:17,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 23:03:17,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 23:03:17,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 23:03:17,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 23:03:17,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676242997562,5,FailOnTimeoutGroup] 2023-02-12 23:03:17,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676242997562,5,FailOnTimeoutGroup] 2023-02-12 23:03:17,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:17,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 23:03:17,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:17,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:17,563 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:17,573 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:17,573 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:17,573 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee 2023-02-12 23:03:17,581 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:17,582 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 23:03:17,584 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/info 2023-02-12 23:03:17,584 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 23:03:17,585 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:17,585 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 23:03:17,587 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:17,587 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 23:03:17,588 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:17,588 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 23:03:17,589 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/table 2023-02-12 23:03:17,589 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 23:03:17,590 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:17,591 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740 2023-02-12 23:03:17,591 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740 2023-02-12 23:03:17,593 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 23:03:17,595 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 23:03:17,597 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:17,597 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64100440, jitterRate=-0.04482901096343994}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 23:03:17,597 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676242997581Initializing all the Stores at 1676242997582 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676242997582Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242997582Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676242997582Cleaning up temporary data from old regions at 1676242997592 (+10 ms)Cleaning up detritus from prior splits at 1676242997593 (+1 ms)Region opened successfully at 1676242997597 (+4 ms) 2023-02-12 23:03:17,597 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 23:03:17,597 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 23:03:17,597 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 23:03:17,597 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 23:03:17,597 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 23:03:17,599 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:17,599 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676242997597Disabling compacts and flushes for region at 1676242997597Disabling writes for close at 1676242997597Writing region close event to WAL at 1676242997599 (+2 ms)Closed at 1676242997599 2023-02-12 23:03:17,600 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:17,600 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 23:03:17,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 23:03:17,602 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 23:03:17,603 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 23:03:17,637 INFO [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(952): ClusterId : 3c42141e-8e13-46d7-8176-5a92a843c845 2023-02-12 23:03:17,637 INFO [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(952): ClusterId : 3c42141e-8e13-46d7-8176-5a92a843c845 2023-02-12 23:03:17,637 DEBUG [RS:1;jenkins-hbase4:34617] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 23:03:17,637 DEBUG [RS:0;jenkins-hbase4:45545] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 23:03:17,685 DEBUG [RS:1;jenkins-hbase4:34617] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 23:03:17,685 DEBUG [RS:1;jenkins-hbase4:34617] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 23:03:17,685 DEBUG [RS:0;jenkins-hbase4:45545] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 23:03:17,686 DEBUG [RS:0;jenkins-hbase4:45545] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 23:03:17,753 WARN [jenkins-hbase4:39753] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-12 23:03:17,754 DEBUG [RS:1;jenkins-hbase4:34617] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 23:03:17,756 DEBUG [RS:1;jenkins-hbase4:34617] zookeeper.ReadOnlyZKClient(139): Connect 0x2bc51921 to 127.0.0.1:53472 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:17,756 DEBUG [RS:0;jenkins-hbase4:45545] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 23:03:17,757 DEBUG [RS:0;jenkins-hbase4:45545] zookeeper.ReadOnlyZKClient(139): Connect 0x080bcc24 to 127.0.0.1:53472 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:17,815 DEBUG [RS:1;jenkins-hbase4:34617] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2502e229, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:17,816 DEBUG [RS:1;jenkins-hbase4:34617] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@213d7251, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:17,822 DEBUG [RS:0;jenkins-hbase4:45545] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cc3355, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:17,823 DEBUG [RS:0;jenkins-hbase4:45545] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f3a754, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:17,826 DEBUG [RS:1;jenkins-hbase4:34617] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34617 2023-02-12 23:03:17,827 INFO [RS:1;jenkins-hbase4:34617] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 23:03:17,827 INFO [RS:1;jenkins-hbase4:34617] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 23:03:17,827 DEBUG [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 23:03:17,828 INFO [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39753,1676242996687 with isa=jenkins-hbase4.apache.org/172.31.14.131:34617, startcode=1676242996811 2023-02-12 23:03:17,828 DEBUG [RS:1;jenkins-hbase4:34617] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 23:03:17,834 DEBUG [RS:0;jenkins-hbase4:45545] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45545 2023-02-12 23:03:17,834 INFO [RS:0;jenkins-hbase4:45545] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 23:03:17,834 INFO [RS:0;jenkins-hbase4:45545] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 23:03:17,834 DEBUG [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 23:03:17,834 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60197, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 23:03:17,835 INFO [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39753,1676242996687 with isa=jenkins-hbase4.apache.org/172.31.14.131:45545, startcode=1676242996771 2023-02-12 23:03:17,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:17,836 DEBUG [RS:0;jenkins-hbase4:45545] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 23:03:17,840 DEBUG [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee 2023-02-12 23:03:17,840 DEBUG [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44231 2023-02-12 23:03:17,840 DEBUG [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 23:03:17,841 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38403, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 23:03:17,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:17,843 DEBUG [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee 2023-02-12 23:03:17,843 DEBUG [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44231 2023-02-12 23:03:17,843 DEBUG [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 23:03:17,861 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:17,990 DEBUG [RS:1;jenkins-hbase4:34617] zookeeper.ZKUtil(162): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:17,990 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34617,1676242996811] 2023-02-12 23:03:17,990 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45545,1676242996771] 2023-02-12 23:03:17,990 WARN [RS:1;jenkins-hbase4:34617] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:17,990 DEBUG [RS:0;jenkins-hbase4:45545] zookeeper.ZKUtil(162): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:17,990 INFO [RS:1;jenkins-hbase4:34617] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:17,990 WARN [RS:0;jenkins-hbase4:45545] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:17,990 DEBUG [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/WALs/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:17,990 INFO [RS:0;jenkins-hbase4:45545] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:17,991 DEBUG [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/WALs/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:17,996 DEBUG [RS:1;jenkins-hbase4:34617] zookeeper.ZKUtil(162): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:17,996 DEBUG [RS:0;jenkins-hbase4:45545] zookeeper.ZKUtil(162): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:17,997 DEBUG [RS:1;jenkins-hbase4:34617] zookeeper.ZKUtil(162): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:17,997 DEBUG [RS:0;jenkins-hbase4:45545] zookeeper.ZKUtil(162): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:17,998 DEBUG [RS:1;jenkins-hbase4:34617] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 23:03:17,998 INFO [RS:1;jenkins-hbase4:34617] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 23:03:18,000 DEBUG [RS:0;jenkins-hbase4:45545] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 23:03:18,000 INFO [RS:1;jenkins-hbase4:34617] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 23:03:18,000 INFO [RS:0;jenkins-hbase4:45545] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 23:03:18,000 INFO [RS:1;jenkins-hbase4:34617] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 23:03:18,000 INFO [RS:1;jenkins-hbase4:34617] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,000 INFO [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 23:03:18,002 INFO [RS:0;jenkins-hbase4:45545] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 23:03:18,002 INFO [RS:0;jenkins-hbase4:45545] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 23:03:18,002 INFO [RS:0;jenkins-hbase4:45545] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,002 INFO [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 23:03:18,003 INFO [RS:1;jenkins-hbase4:34617] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,003 DEBUG [RS:1;jenkins-hbase4:34617] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,003 DEBUG [RS:1;jenkins-hbase4:34617] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,003 DEBUG [RS:1;jenkins-hbase4:34617] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,003 DEBUG [RS:1;jenkins-hbase4:34617] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,003 INFO [RS:0;jenkins-hbase4:45545] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,003 DEBUG [RS:1;jenkins-hbase4:34617] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,004 DEBUG [RS:0;jenkins-hbase4:45545] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,004 DEBUG [jenkins-hbase4:39753] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 23:03:18,004 DEBUG [RS:0;jenkins-hbase4:45545] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,004 DEBUG [jenkins-hbase4:39753] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:18,004 DEBUG [RS:1;jenkins-hbase4:34617] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:18,004 DEBUG [RS:0;jenkins-hbase4:45545] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,004 DEBUG [RS:1;jenkins-hbase4:34617] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,005 DEBUG [RS:0;jenkins-hbase4:45545] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,005 DEBUG [RS:1;jenkins-hbase4:34617] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,005 DEBUG [RS:0;jenkins-hbase4:45545] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,005 DEBUG [RS:1;jenkins-hbase4:34617] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,005 DEBUG [RS:0;jenkins-hbase4:45545] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:18,005 DEBUG [RS:1;jenkins-hbase4:34617] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,005 DEBUG [RS:0;jenkins-hbase4:45545] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,005 DEBUG [RS:0;jenkins-hbase4:45545] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,005 DEBUG [RS:0;jenkins-hbase4:45545] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,005 DEBUG [RS:0;jenkins-hbase4:45545] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:18,006 INFO [RS:1;jenkins-hbase4:34617] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,006 INFO [RS:1;jenkins-hbase4:34617] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,006 INFO [RS:1;jenkins-hbase4:34617] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,006 INFO [RS:0;jenkins-hbase4:45545] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,016 INFO [RS:0;jenkins-hbase4:45545] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,016 INFO [RS:0;jenkins-hbase4:45545] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,017 DEBUG [jenkins-hbase4:39753] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:18,017 DEBUG [jenkins-hbase4:39753] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:18,017 DEBUG [jenkins-hbase4:39753] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:18,020 INFO [RS:1;jenkins-hbase4:34617] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 23:03:18,020 INFO [RS:1;jenkins-hbase4:34617] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34617,1676242996811-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,021 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34617,1676242996811, state=OPENING 2023-02-12 23:03:18,033 INFO [RS:0;jenkins-hbase4:45545] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 23:03:18,033 INFO [RS:0;jenkins-hbase4:45545] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45545,1676242996771-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,046 INFO [RS:0;jenkins-hbase4:45545] regionserver.Replication(203): jenkins-hbase4.apache.org,45545,1676242996771 started 2023-02-12 23:03:18,046 INFO [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45545,1676242996771, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45545, sessionid=0x1004ac6376d0001 2023-02-12 23:03:18,046 INFO [RS:1;jenkins-hbase4:34617] regionserver.Replication(203): jenkins-hbase4.apache.org,34617,1676242996811 started 2023-02-12 23:03:18,046 DEBUG [RS:0;jenkins-hbase4:45545] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 23:03:18,046 DEBUG [RS:0;jenkins-hbase4:45545] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:18,046 INFO [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34617,1676242996811, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34617, sessionid=0x1004ac6376d0002 2023-02-12 23:03:18,046 DEBUG [RS:0;jenkins-hbase4:45545] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45545,1676242996771' 2023-02-12 23:03:18,046 DEBUG [RS:0;jenkins-hbase4:45545] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:18,046 DEBUG [RS:1;jenkins-hbase4:34617] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 23:03:18,046 DEBUG [RS:1;jenkins-hbase4:34617] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:18,046 DEBUG [RS:1;jenkins-hbase4:34617] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34617,1676242996811' 2023-02-12 23:03:18,046 DEBUG [RS:1;jenkins-hbase4:34617] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:18,071 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 23:03:18,071 DEBUG [RS:1;jenkins-hbase4:34617] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:18,071 DEBUG [RS:0;jenkins-hbase4:45545] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:18,071 DEBUG [RS:1;jenkins-hbase4:34617] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 23:03:18,071 DEBUG [RS:1;jenkins-hbase4:34617] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 23:03:18,071 DEBUG [RS:1;jenkins-hbase4:34617] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:18,071 DEBUG [RS:1;jenkins-hbase4:34617] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34617,1676242996811' 2023-02-12 23:03:18,071 DEBUG [RS:1;jenkins-hbase4:34617] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:18,123 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:18,123 DEBUG [RS:1;jenkins-hbase4:34617] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:18,123 DEBUG [RS:0;jenkins-hbase4:45545] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 23:03:18,123 DEBUG [RS:0;jenkins-hbase4:45545] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 23:03:18,123 DEBUG [RS:0;jenkins-hbase4:45545] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:18,123 DEBUG [RS:0;jenkins-hbase4:45545] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45545,1676242996771' 2023-02-12 23:03:18,123 DEBUG [RS:0;jenkins-hbase4:45545] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:18,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34617,1676242996811}] 2023-02-12 23:03:18,123 DEBUG [RS:0;jenkins-hbase4:45545] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:18,124 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 23:03:18,124 DEBUG [RS:1;jenkins-hbase4:34617] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 23:03:18,125 INFO [RS:1;jenkins-hbase4:34617] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 23:03:18,125 DEBUG [RS:0;jenkins-hbase4:45545] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 23:03:18,125 INFO [RS:0;jenkins-hbase4:45545] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 23:03:18,125 INFO [RS:0;jenkins-hbase4:45545] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 23:03:18,125 INFO [RS:1;jenkins-hbase4:34617] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 23:03:18,278 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:18,278 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 23:03:18,281 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60242, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 23:03:18,286 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 23:03:18,286 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:18,287 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34617%2C1676242996811.meta, suffix=.meta, logDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/WALs/jenkins-hbase4.apache.org,34617,1676242996811, archiveDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/oldWALs, maxLogs=32 2023-02-12 23:03:18,309 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33849,DS-c99868be-1abd-4287-af81-052de6f8714f,DISK] 2023-02-12 23:03:18,309 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46417,DS-91671158-514c-4bc0-9286-ab9d81d49e6c,DISK] 2023-02-12 23:03:18,311 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/WALs/jenkins-hbase4.apache.org,34617,1676242996811/jenkins-hbase4.apache.org%2C34617%2C1676242996811.meta.1676242998289.meta 2023-02-12 23:03:18,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46417,DS-91671158-514c-4bc0-9286-ab9d81d49e6c,DISK], DatanodeInfoWithStorage[127.0.0.1:33849,DS-c99868be-1abd-4287-af81-052de6f8714f,DISK]] 2023-02-12 23:03:18,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:18,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 23:03:18,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 23:03:18,313 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 23:03:18,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 23:03:18,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:18,314 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 23:03:18,314 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 23:03:18,315 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 23:03:18,316 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/info 2023-02-12 23:03:18,316 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/info 2023-02-12 23:03:18,317 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 23:03:18,317 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:18,317 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 23:03:18,318 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:18,318 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:18,319 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 23:03:18,319 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:18,319 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 23:03:18,320 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/table 2023-02-12 23:03:18,320 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/table 2023-02-12 23:03:18,320 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 23:03:18,321 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:18,321 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740 2023-02-12 23:03:18,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740 2023-02-12 23:03:18,325 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 23:03:18,326 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 23:03:18,326 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74576135, jitterRate=0.11127100884914398}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 23:03:18,326 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676242998314Writing region info on filesystem at 1676242998314Initializing all the Stores at 1676242998315 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676242998315Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676242998315Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676242998315Cleaning up temporary data from old regions at 1676242998324 (+9 ms)Cleaning up detritus from prior splits at 1676242998324Running coprocessor post-open hooks at 1676242998326 (+2 ms)Region opened successfully at 1676242998326 2023-02-12 23:03:18,327 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676242998278 2023-02-12 23:03:18,331 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 23:03:18,332 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 23:03:18,332 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34617,1676242996811, state=OPEN 2023-02-12 23:03:18,423 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 23:03:18,424 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 23:03:18,426 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 23:03:18,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34617,1676242996811 in 300 msec 2023-02-12 23:03:18,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 23:03:18,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 827 msec 2023-02-12 23:03:18,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 874 msec 2023-02-12 23:03:18,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676242996838, completionTime=-1 2023-02-12 23:03:18,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 23:03:18,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 23:03:18,437 DEBUG [hconnection-0x75ad5cee-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:18,439 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60256, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:18,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 23:03:18,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676243058441 2023-02-12 23:03:18,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676243118441 2023-02-12 23:03:18,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 8 msec 2023-02-12 23:03:18,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39753,1676242996687-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39753,1676242996687-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39753,1676242996687-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39753, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:18,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 23:03:18,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:18,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 23:03:18,634 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 23:03:18,639 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 23:03:18,640 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 23:03:18,642 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/hbase/namespace/6bd6aafce254e495e7782914ac20f86e 2023-02-12 23:03:18,643 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/hbase/namespace/6bd6aafce254e495e7782914ac20f86e empty. 2023-02-12 23:03:18,643 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/hbase/namespace/6bd6aafce254e495e7782914ac20f86e 2023-02-12 23:03:18,643 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 23:03:18,663 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:18,665 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6bd6aafce254e495e7782914ac20f86e, NAME => 'hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp 2023-02-12 23:03:18,677 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:18,677 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 6bd6aafce254e495e7782914ac20f86e, disabling compactions & flushes 2023-02-12 23:03:18,677 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e. 2023-02-12 23:03:18,677 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e. 2023-02-12 23:03:18,677 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e. after waiting 0 ms 2023-02-12 23:03:18,677 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e. 2023-02-12 23:03:18,677 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e. 2023-02-12 23:03:18,677 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 6bd6aafce254e495e7782914ac20f86e: Waiting for close lock at 1676242998677Disabling compacts and flushes for region at 1676242998677Disabling writes for close at 1676242998677Writing region close event to WAL at 1676242998677Closed at 1676242998677 2023-02-12 23:03:18,680 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 23:03:18,681 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676242998680"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676242998680"}]},"ts":"1676242998680"} 2023-02-12 23:03:18,684 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 23:03:18,685 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 23:03:18,685 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676242998685"}]},"ts":"1676242998685"} 2023-02-12 23:03:18,692 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 23:03:18,884 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:18,885 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:18,885 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:18,885 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:18,886 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6bd6aafce254e495e7782914ac20f86e, ASSIGN}] 2023-02-12 23:03:18,888 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6bd6aafce254e495e7782914ac20f86e, ASSIGN 2023-02-12 23:03:18,889 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6bd6aafce254e495e7782914ac20f86e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34617,1676242996811; forceNewPlan=false, retain=false 2023-02-12 23:03:19,039 INFO [jenkins-hbase4:39753] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 23:03:19,040 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6bd6aafce254e495e7782914ac20f86e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:19,041 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676242999040"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676242999040"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676242999040"}]},"ts":"1676242999040"} 2023-02-12 23:03:19,043 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6bd6aafce254e495e7782914ac20f86e, server=jenkins-hbase4.apache.org,34617,1676242996811}] 2023-02-12 23:03:19,127 INFO [RS:1;jenkins-hbase4:34617] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34617%2C1676242996811, suffix=, logDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/WALs/jenkins-hbase4.apache.org,34617,1676242996811, archiveDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/oldWALs, maxLogs=32 2023-02-12 23:03:19,127 INFO [RS:0;jenkins-hbase4:45545] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45545%2C1676242996771, suffix=, logDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/WALs/jenkins-hbase4.apache.org,45545,1676242996771, archiveDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/oldWALs, maxLogs=32 2023-02-12 23:03:19,154 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33849,DS-c99868be-1abd-4287-af81-052de6f8714f,DISK] 2023-02-12 23:03:19,154 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33849,DS-c99868be-1abd-4287-af81-052de6f8714f,DISK] 2023-02-12 23:03:19,154 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46417,DS-91671158-514c-4bc0-9286-ab9d81d49e6c,DISK] 2023-02-12 23:03:19,154 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46417,DS-91671158-514c-4bc0-9286-ab9d81d49e6c,DISK] 2023-02-12 23:03:19,157 INFO [RS:1;jenkins-hbase4:34617] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/WALs/jenkins-hbase4.apache.org,34617,1676242996811/jenkins-hbase4.apache.org%2C34617%2C1676242996811.1676242999128 2023-02-12 23:03:19,157 INFO [RS:0;jenkins-hbase4:45545] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/WALs/jenkins-hbase4.apache.org,45545,1676242996771/jenkins-hbase4.apache.org%2C45545%2C1676242996771.1676242999128 2023-02-12 23:03:19,157 DEBUG [RS:1;jenkins-hbase4:34617] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33849,DS-c99868be-1abd-4287-af81-052de6f8714f,DISK], DatanodeInfoWithStorage[127.0.0.1:46417,DS-91671158-514c-4bc0-9286-ab9d81d49e6c,DISK]] 2023-02-12 23:03:19,157 DEBUG [RS:0;jenkins-hbase4:45545] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33849,DS-c99868be-1abd-4287-af81-052de6f8714f,DISK], DatanodeInfoWithStorage[127.0.0.1:46417,DS-91671158-514c-4bc0-9286-ab9d81d49e6c,DISK]] 2023-02-12 23:03:19,199 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e. 2023-02-12 23:03:19,199 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6bd6aafce254e495e7782914ac20f86e, NAME => 'hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:19,199 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6bd6aafce254e495e7782914ac20f86e 2023-02-12 23:03:19,199 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:19,199 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6bd6aafce254e495e7782914ac20f86e 2023-02-12 23:03:19,199 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6bd6aafce254e495e7782914ac20f86e 2023-02-12 23:03:19,200 INFO [StoreOpener-6bd6aafce254e495e7782914ac20f86e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6bd6aafce254e495e7782914ac20f86e 2023-02-12 23:03:19,202 DEBUG [StoreOpener-6bd6aafce254e495e7782914ac20f86e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/namespace/6bd6aafce254e495e7782914ac20f86e/info 2023-02-12 23:03:19,202 DEBUG [StoreOpener-6bd6aafce254e495e7782914ac20f86e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/namespace/6bd6aafce254e495e7782914ac20f86e/info 2023-02-12 23:03:19,202 INFO [StoreOpener-6bd6aafce254e495e7782914ac20f86e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bd6aafce254e495e7782914ac20f86e columnFamilyName info 2023-02-12 23:03:19,203 INFO [StoreOpener-6bd6aafce254e495e7782914ac20f86e-1] regionserver.HStore(310): Store=6bd6aafce254e495e7782914ac20f86e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:19,204 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/namespace/6bd6aafce254e495e7782914ac20f86e 2023-02-12 23:03:19,204 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/namespace/6bd6aafce254e495e7782914ac20f86e 2023-02-12 23:03:19,207 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6bd6aafce254e495e7782914ac20f86e 2023-02-12 23:03:19,212 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/namespace/6bd6aafce254e495e7782914ac20f86e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:19,212 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6bd6aafce254e495e7782914ac20f86e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66842054, jitterRate=-0.003975778818130493}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 23:03:19,212 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6bd6aafce254e495e7782914ac20f86e: Running coprocessor pre-open hook at 1676242999199Writing region info on filesystem at 1676242999199Initializing all the Stores at 1676242999200 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676242999200Cleaning up temporary data from old regions at 1676242999204 (+4 ms)Cleaning up detritus from prior splits at 1676242999205 (+1 ms)Running coprocessor post-open hooks at 1676242999212 (+7 ms)Region opened successfully at 1676242999212 2023-02-12 23:03:19,213 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e., pid=6, masterSystemTime=1676242999195 2023-02-12 23:03:19,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e. 2023-02-12 23:03:19,216 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e. 2023-02-12 23:03:19,216 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6bd6aafce254e495e7782914ac20f86e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:19,216 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676242999216"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676242999216"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676242999216"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676242999216"}]},"ts":"1676242999216"} 2023-02-12 23:03:19,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 23:03:19,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6bd6aafce254e495e7782914ac20f86e, server=jenkins-hbase4.apache.org,34617,1676242996811 in 175 msec 2023-02-12 23:03:19,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 23:03:19,223 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6bd6aafce254e495e7782914ac20f86e, ASSIGN in 334 msec 2023-02-12 23:03:19,223 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 23:03:19,223 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676242999223"}]},"ts":"1676242999223"} 2023-02-12 23:03:19,225 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 23:03:19,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 23:03:19,294 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 23:03:19,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 663 msec 2023-02-12 23:03:19,342 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 23:03:19,393 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:19,393 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:19,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 23:03:19,484 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:19,548 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 146 msec 2023-02-12 23:03:19,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 23:03:19,631 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:19,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 107 msec 2023-02-12 23:03:19,792 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 23:03:19,930 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 23:03:19,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.082sec 2023-02-12 23:03:19,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 23:03:19,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 23:03:19,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 23:03:19,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39753,1676242996687-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 23:03:19,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39753,1676242996687-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 23:03:19,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 23:03:19,937 DEBUG [Listener at localhost/37407] zookeeper.ReadOnlyZKClient(139): Connect 0x5445615a to 127.0.0.1:53472 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:19,993 DEBUG [Listener at localhost/37407] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b3617cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:19,994 DEBUG [hconnection-0x848c05d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:19,997 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60262, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:19,999 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39753,1676242996687 2023-02-12 23:03:19,999 DEBUG [Listener at localhost/37407] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 23:03:20,001 DEBUG [Listener at localhost/37407] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 23:03:20,003 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55592, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 23:03:20,003 INFO [Listener at localhost/37407] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 23:03:20,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-12 23:03:20,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 23:03:20,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:55592 deadline: 1676243060004, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-12 23:03:20,004 INFO [Listener at localhost/37407] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-12 23:03:20,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:20,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-12 23:03:20,010 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 23:03:20,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-12 23:03:20,011 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 23:03:20,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:20,021 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/fdab89856484d1378024257bd8a44d06 2023-02-12 23:03:20,021 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a 2023-02-12 23:03:20,021 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c 2023-02-12 23:03:20,021 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2 2023-02-12 23:03:20,021 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c 2023-02-12 23:03:20,021 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882 2023-02-12 23:03:20,021 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8 2023-02-12 23:03:20,021 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759 2023-02-12 23:03:20,022 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/fdab89856484d1378024257bd8a44d06 empty. 2023-02-12 23:03:20,022 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2 empty. 2023-02-12 23:03:20,022 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c empty. 2023-02-12 23:03:20,022 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c empty. 2023-02-12 23:03:20,022 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c 2023-02-12 23:03:20,022 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0 2023-02-12 23:03:20,022 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c 2023-02-12 23:03:20,022 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a empty. 2023-02-12 23:03:20,022 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/86a144358000c8ea6648753ad84b60f9 2023-02-12 23:03:20,022 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2 2023-02-12 23:03:20,023 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/fdab89856484d1378024257bd8a44d06 2023-02-12 23:03:20,023 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882 empty. 2023-02-12 23:03:20,023 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/86a144358000c8ea6648753ad84b60f9 empty. 2023-02-12 23:03:20,023 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759 empty. 2023-02-12 23:03:20,023 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8 empty. 2023-02-12 23:03:20,023 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0 empty. 2023-02-12 23:03:20,023 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/86a144358000c8ea6648753ad84b60f9 2023-02-12 23:03:20,023 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882 2023-02-12 23:03:20,024 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8 2023-02-12 23:03:20,024 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759 2023-02-12 23:03:20,024 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0 2023-02-12 23:03:20,024 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a 2023-02-12 23:03:20,024 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 23:03:20,033 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:20,035 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 665dc8533514e2f10d7e2bd897400da8, NAME => 'testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp 2023-02-12 23:03:20,035 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => a6a622ff106adf0ab6f2bbb0307a2759, NAME => 'testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp 2023-02-12 23:03:20,035 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => fdab89856484d1378024257bd8a44d06, NAME => 'testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp 2023-02-12 23:03:20,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing a6a622ff106adf0ab6f2bbb0307a2759, disabling compactions & flushes 2023-02-12 23:03:20,046 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:20,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:20,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. after waiting 0 ms 2023-02-12 23:03:20,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:20,046 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:20,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for a6a622ff106adf0ab6f2bbb0307a2759: Waiting for close lock at 1676243000046Disabling compacts and flushes for region at 1676243000046Disabling writes for close at 1676243000046Writing region close event to WAL at 1676243000046Closed at 1676243000046 2023-02-12 23:03:20,046 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 18ed925f188a6f68eaf81f5831366882, NAME => 'testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp 2023-02-12 23:03:20,052 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,052 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing fdab89856484d1378024257bd8a44d06, disabling compactions & flushes 2023-02-12 23:03:20,052 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:20,052 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:20,052 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. after waiting 0 ms 2023-02-12 23:03:20,053 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:20,053 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:20,053 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for fdab89856484d1378024257bd8a44d06: Waiting for close lock at 1676243000052Disabling compacts and flushes for region at 1676243000052Disabling writes for close at 1676243000053 (+1 ms)Writing region close event to WAL at 1676243000053Closed at 1676243000053 2023-02-12 23:03:20,053 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 32dc68160ede524989d9a76e9e075d5a, NAME => 'testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp 2023-02-12 23:03:20,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 665dc8533514e2f10d7e2bd897400da8, disabling compactions & flushes 2023-02-12 23:03:20,060 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:20,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:20,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. after waiting 0 ms 2023-02-12 23:03:20,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:20,060 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:20,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 665dc8533514e2f10d7e2bd897400da8: Waiting for close lock at 1676243000060Disabling compacts and flushes for region at 1676243000060Disabling writes for close at 1676243000060Writing region close event to WAL at 1676243000060Closed at 1676243000060 2023-02-12 23:03:20,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 18ed925f188a6f68eaf81f5831366882, disabling compactions & flushes 2023-02-12 23:03:20,061 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:20,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:20,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. after waiting 0 ms 2023-02-12 23:03:20,061 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 08eb73920285e635825f35a554ddf21c, NAME => 'testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp 2023-02-12 23:03:20,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:20,061 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:20,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 18ed925f188a6f68eaf81f5831366882: Waiting for close lock at 1676243000060Disabling compacts and flushes for region at 1676243000060Disabling writes for close at 1676243000061 (+1 ms)Writing region close event to WAL at 1676243000061Closed at 1676243000061 2023-02-12 23:03:20,062 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0736d5406d404b5c1b17d60c3167aa7c, NAME => 'testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp 2023-02-12 23:03:20,072 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,072 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 32dc68160ede524989d9a76e9e075d5a, disabling compactions & flushes 2023-02-12 23:03:20,072 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:20,072 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:20,072 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. after waiting 0 ms 2023-02-12 23:03:20,072 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:20,072 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:20,072 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 32dc68160ede524989d9a76e9e075d5a: Waiting for close lock at 1676243000072Disabling compacts and flushes for region at 1676243000072Disabling writes for close at 1676243000072Writing region close event to WAL at 1676243000072Closed at 1676243000072 2023-02-12 23:03:20,073 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e2e562ad32c112155905f7ead92570f2, NAME => 'testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp 2023-02-12 23:03:20,082 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,082 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 0736d5406d404b5c1b17d60c3167aa7c, disabling compactions & flushes 2023-02-12 23:03:20,082 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:20,082 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:20,082 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. after waiting 0 ms 2023-02-12 23:03:20,083 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:20,083 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:20,083 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 0736d5406d404b5c1b17d60c3167aa7c: Waiting for close lock at 1676243000082Disabling compacts and flushes for region at 1676243000082Disabling writes for close at 1676243000082Writing region close event to WAL at 1676243000083 (+1 ms)Closed at 1676243000083 2023-02-12 23:03:20,083 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5f19c1217872b6679c0c16957aeaadf0, NAME => 'testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp 2023-02-12 23:03:20,084 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,084 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 08eb73920285e635825f35a554ddf21c, disabling compactions & flushes 2023-02-12 23:03:20,084 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:20,084 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:20,085 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. after waiting 0 ms 2023-02-12 23:03:20,085 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:20,085 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:20,085 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 08eb73920285e635825f35a554ddf21c: Waiting for close lock at 1676243000084Disabling compacts and flushes for region at 1676243000084Disabling writes for close at 1676243000085 (+1 ms)Writing region close event to WAL at 1676243000085Closed at 1676243000085 2023-02-12 23:03:20,085 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 86a144358000c8ea6648753ad84b60f9, NAME => 'testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.tmp 2023-02-12 23:03:20,096 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,096 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e2e562ad32c112155905f7ead92570f2, disabling compactions & flushes 2023-02-12 23:03:20,096 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:20,096 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:20,096 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. after waiting 0 ms 2023-02-12 23:03:20,096 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:20,096 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:20,096 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e2e562ad32c112155905f7ead92570f2: Waiting for close lock at 1676243000096Disabling compacts and flushes for region at 1676243000096Disabling writes for close at 1676243000096Writing region close event to WAL at 1676243000096Closed at 1676243000096 2023-02-12 23:03:20,098 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,098 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 5f19c1217872b6679c0c16957aeaadf0, disabling compactions & flushes 2023-02-12 23:03:20,098 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:20,098 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:20,098 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. after waiting 0 ms 2023-02-12 23:03:20,098 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:20,098 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:20,098 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 5f19c1217872b6679c0c16957aeaadf0: Waiting for close lock at 1676243000098Disabling compacts and flushes for region at 1676243000098Disabling writes for close at 1676243000098Writing region close event to WAL at 1676243000098Closed at 1676243000098 2023-02-12 23:03:20,100 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,101 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 86a144358000c8ea6648753ad84b60f9, disabling compactions & flushes 2023-02-12 23:03:20,101 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:20,101 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:20,101 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. after waiting 0 ms 2023-02-12 23:03:20,101 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:20,101 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:20,101 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 86a144358000c8ea6648753ad84b60f9: Waiting for close lock at 1676243000101Disabling compacts and flushes for region at 1676243000101Disabling writes for close at 1676243000101Writing region close event to WAL at 1676243000101Closed at 1676243000101 2023-02-12 23:03:20,110 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 23:03:20,111 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243000111"}]},"ts":"1676243000111"} 2023-02-12 23:03:20,111 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676243000111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243000111"}]},"ts":"1676243000111"} 2023-02-12 23:03:20,111 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243000111"}]},"ts":"1676243000111"} 2023-02-12 23:03:20,111 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243000111"}]},"ts":"1676243000111"} 2023-02-12 23:03:20,111 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243000111"}]},"ts":"1676243000111"} 2023-02-12 23:03:20,111 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243000111"}]},"ts":"1676243000111"} 2023-02-12 23:03:20,111 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676243000006.08eb73920285e635825f35a554ddf21c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243000111"}]},"ts":"1676243000111"} 2023-02-12 23:03:20,111 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243000111"}]},"ts":"1676243000111"} 2023-02-12 23:03:20,112 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243000111"}]},"ts":"1676243000111"} 2023-02-12 23:03:20,112 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676243000111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243000111"}]},"ts":"1676243000111"} 2023-02-12 23:03:20,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:20,114 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-12 23:03:20,115 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 23:03:20,115 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243000115"}]},"ts":"1676243000115"} 2023-02-12 23:03:20,117 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-12 23:03:20,239 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:20,247 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:20,247 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:20,247 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:20,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fdab89856484d1378024257bd8a44d06, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a6a622ff106adf0ab6f2bbb0307a2759, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=665dc8533514e2f10d7e2bd897400da8, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=18ed925f188a6f68eaf81f5831366882, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=32dc68160ede524989d9a76e9e075d5a, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=08eb73920285e635825f35a554ddf21c, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0736d5406d404b5c1b17d60c3167aa7c, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e2e562ad32c112155905f7ead92570f2, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5f19c1217872b6679c0c16957aeaadf0, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=86a144358000c8ea6648753ad84b60f9, ASSIGN}] 2023-02-12 23:03:20,250 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a6a622ff106adf0ab6f2bbb0307a2759, ASSIGN 2023-02-12 23:03:20,251 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=18ed925f188a6f68eaf81f5831366882, ASSIGN 2023-02-12 23:03:20,251 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fdab89856484d1378024257bd8a44d06, ASSIGN 2023-02-12 23:03:20,251 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=665dc8533514e2f10d7e2bd897400da8, ASSIGN 2023-02-12 23:03:20,251 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a6a622ff106adf0ab6f2bbb0307a2759, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45545,1676242996771; forceNewPlan=false, retain=false 2023-02-12 23:03:20,252 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=18ed925f188a6f68eaf81f5831366882, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34617,1676242996811; forceNewPlan=false, retain=false 2023-02-12 23:03:20,252 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=665dc8533514e2f10d7e2bd897400da8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45545,1676242996771; forceNewPlan=false, retain=false 2023-02-12 23:03:20,252 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fdab89856484d1378024257bd8a44d06, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34617,1676242996811; forceNewPlan=false, retain=false 2023-02-12 23:03:20,252 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=86a144358000c8ea6648753ad84b60f9, ASSIGN 2023-02-12 23:03:20,253 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5f19c1217872b6679c0c16957aeaadf0, ASSIGN 2023-02-12 23:03:20,253 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e2e562ad32c112155905f7ead92570f2, ASSIGN 2023-02-12 23:03:20,253 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0736d5406d404b5c1b17d60c3167aa7c, ASSIGN 2023-02-12 23:03:20,253 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=86a144358000c8ea6648753ad84b60f9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34617,1676242996811; forceNewPlan=false, retain=false 2023-02-12 23:03:20,253 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=08eb73920285e635825f35a554ddf21c, ASSIGN 2023-02-12 23:03:20,256 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5f19c1217872b6679c0c16957aeaadf0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45545,1676242996771; forceNewPlan=false, retain=false 2023-02-12 23:03:20,257 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0736d5406d404b5c1b17d60c3167aa7c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34617,1676242996811; forceNewPlan=false, retain=false 2023-02-12 23:03:20,257 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=32dc68160ede524989d9a76e9e075d5a, ASSIGN 2023-02-12 23:03:20,257 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e2e562ad32c112155905f7ead92570f2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34617,1676242996811; forceNewPlan=false, retain=false 2023-02-12 23:03:20,257 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=08eb73920285e635825f35a554ddf21c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45545,1676242996771; forceNewPlan=false, retain=false 2023-02-12 23:03:20,258 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=32dc68160ede524989d9a76e9e075d5a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45545,1676242996771; forceNewPlan=false, retain=false 2023-02-12 23:03:20,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:20,402 INFO [jenkins-hbase4:39753] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-12 23:03:20,407 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=32dc68160ede524989d9a76e9e075d5a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:20,407 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=08eb73920285e635825f35a554ddf21c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:20,407 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=a6a622ff106adf0ab6f2bbb0307a2759, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:20,407 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=665dc8533514e2f10d7e2bd897400da8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:20,407 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676243000006.08eb73920285e635825f35a554ddf21c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000407"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243000407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243000407"}]},"ts":"1676243000407"} 2023-02-12 23:03:20,407 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000407"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243000407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243000407"}]},"ts":"1676243000407"} 2023-02-12 23:03:20,407 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=5f19c1217872b6679c0c16957aeaadf0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:20,407 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000407"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243000407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243000407"}]},"ts":"1676243000407"} 2023-02-12 23:03:20,407 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000407"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243000407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243000407"}]},"ts":"1676243000407"} 2023-02-12 23:03:20,408 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000407"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243000407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243000407"}]},"ts":"1676243000407"} 2023-02-12 23:03:20,410 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure 08eb73920285e635825f35a554ddf21c, server=jenkins-hbase4.apache.org,45545,1676242996771}] 2023-02-12 23:03:20,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure a6a622ff106adf0ab6f2bbb0307a2759, server=jenkins-hbase4.apache.org,45545,1676242996771}] 2023-02-12 23:03:20,412 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=13, state=RUNNABLE; OpenRegionProcedure 665dc8533514e2f10d7e2bd897400da8, server=jenkins-hbase4.apache.org,45545,1676242996771}] 2023-02-12 23:03:20,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=15, state=RUNNABLE; OpenRegionProcedure 32dc68160ede524989d9a76e9e075d5a, server=jenkins-hbase4.apache.org,45545,1676242996771}] 2023-02-12 23:03:20,414 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure 5f19c1217872b6679c0c16957aeaadf0, server=jenkins-hbase4.apache.org,45545,1676242996771}] 2023-02-12 23:03:20,416 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=fdab89856484d1378024257bd8a44d06, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:20,417 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=0736d5406d404b5c1b17d60c3167aa7c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:20,417 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676243000416"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243000416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243000416"}]},"ts":"1676243000416"} 2023-02-12 23:03:20,417 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000417"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243000417"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243000417"}]},"ts":"1676243000417"} 2023-02-12 23:03:20,418 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=86a144358000c8ea6648753ad84b60f9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:20,418 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676243000418"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243000418"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243000418"}]},"ts":"1676243000418"} 2023-02-12 23:03:20,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=11, state=RUNNABLE; OpenRegionProcedure fdab89856484d1378024257bd8a44d06, server=jenkins-hbase4.apache.org,34617,1676242996811}] 2023-02-12 23:03:20,420 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=e2e562ad32c112155905f7ead92570f2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:20,420 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=18ed925f188a6f68eaf81f5831366882, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:20,420 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000420"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243000420"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243000420"}]},"ts":"1676243000420"} 2023-02-12 23:03:20,421 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243000419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243000419"}]},"ts":"1676243000419"} 2023-02-12 23:03:20,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=17, state=RUNNABLE; OpenRegionProcedure 0736d5406d404b5c1b17d60c3167aa7c, server=jenkins-hbase4.apache.org,34617,1676242996811}] 2023-02-12 23:03:20,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=20, state=RUNNABLE; OpenRegionProcedure 86a144358000c8ea6648753ad84b60f9, server=jenkins-hbase4.apache.org,34617,1676242996811}] 2023-02-12 23:03:20,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=18, state=RUNNABLE; OpenRegionProcedure e2e562ad32c112155905f7ead92570f2, server=jenkins-hbase4.apache.org,34617,1676242996811}] 2023-02-12 23:03:20,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure 18ed925f188a6f68eaf81f5831366882, server=jenkins-hbase4.apache.org,34617,1676242996811}] 2023-02-12 23:03:20,562 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:20,563 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 23:03:20,566 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52362, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 23:03:20,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:20,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5f19c1217872b6679c0c16957aeaadf0, NAME => 'testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-12 23:03:20,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5f19c1217872b6679c0c16957aeaadf0 2023-02-12 23:03:20,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5f19c1217872b6679c0c16957aeaadf0 2023-02-12 23:03:20,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5f19c1217872b6679c0c16957aeaadf0 2023-02-12 23:03:20,571 INFO [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5f19c1217872b6679c0c16957aeaadf0 2023-02-12 23:03:20,573 DEBUG [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f1 2023-02-12 23:03:20,573 DEBUG [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f1 2023-02-12 23:03:20,573 INFO [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f19c1217872b6679c0c16957aeaadf0 columnFamilyName f1 2023-02-12 23:03:20,574 INFO [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] regionserver.HStore(310): Store=5f19c1217872b6679c0c16957aeaadf0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,574 INFO [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5f19c1217872b6679c0c16957aeaadf0 2023-02-12 23:03:20,575 DEBUG [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f2 2023-02-12 23:03:20,575 DEBUG [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f2 2023-02-12 23:03:20,576 INFO [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f19c1217872b6679c0c16957aeaadf0 columnFamilyName f2 2023-02-12 23:03:20,576 INFO [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] regionserver.HStore(310): Store=5f19c1217872b6679c0c16957aeaadf0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:20,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0736d5406d404b5c1b17d60c3167aa7c, NAME => 'testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-12 23:03:20,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0736d5406d404b5c1b17d60c3167aa7c 2023-02-12 23:03:20,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0 2023-02-12 23:03:20,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0736d5406d404b5c1b17d60c3167aa7c 2023-02-12 23:03:20,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0736d5406d404b5c1b17d60c3167aa7c 2023-02-12 23:03:20,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0 2023-02-12 23:03:20,578 INFO [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0736d5406d404b5c1b17d60c3167aa7c 2023-02-12 23:03:20,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:20,579 DEBUG [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f1 2023-02-12 23:03:20,579 DEBUG [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f1 2023-02-12 23:03:20,580 INFO [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0736d5406d404b5c1b17d60c3167aa7c columnFamilyName f1 2023-02-12 23:03:20,580 INFO [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] regionserver.HStore(310): Store=0736d5406d404b5c1b17d60c3167aa7c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,580 INFO [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0736d5406d404b5c1b17d60c3167aa7c 2023-02-12 23:03:20,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5f19c1217872b6679c0c16957aeaadf0 2023-02-12 23:03:20,581 DEBUG [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f2 2023-02-12 23:03:20,582 DEBUG [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f2 2023-02-12 23:03:20,582 INFO [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0736d5406d404b5c1b17d60c3167aa7c columnFamilyName f2 2023-02-12 23:03:20,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:20,582 INFO [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] regionserver.HStore(310): Store=0736d5406d404b5c1b17d60c3167aa7c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5f19c1217872b6679c0c16957aeaadf0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65740809, jitterRate=-0.020385608077049255}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:20,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5f19c1217872b6679c0c16957aeaadf0: Running coprocessor pre-open hook at 1676243000570Writing region info on filesystem at 1676243000570Initializing all the Stores at 1676243000571 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000571Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000571Cleaning up temporary data from old regions at 1676243000578 (+7 ms)Cleaning up detritus from prior splits at 1676243000578Running coprocessor post-open hooks at 1676243000583 (+5 ms)Region opened successfully at 1676243000583 2023-02-12 23:03:20,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c 2023-02-12 23:03:20,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c 2023-02-12 23:03:20,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0., pid=25, masterSystemTime=1676243000562 2023-02-12 23:03:20,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:20,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:20,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:20,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:20,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 32dc68160ede524989d9a76e9e075d5a, NAME => 'testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-12 23:03:20,588 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=5f19c1217872b6679c0c16957aeaadf0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:20,588 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000588"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243000588"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243000588"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243000588"}]},"ts":"1676243000588"} 2023-02-12 23:03:20,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 32dc68160ede524989d9a76e9e075d5a 2023-02-12 23:03:20,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 32dc68160ede524989d9a76e9e075d5a 2023-02-12 23:03:20,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 32dc68160ede524989d9a76e9e075d5a 2023-02-12 23:03:20,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0736d5406d404b5c1b17d60c3167aa7c 2023-02-12 23:03:20,589 INFO [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 32dc68160ede524989d9a76e9e075d5a 2023-02-12 23:03:20,591 DEBUG [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f1 2023-02-12 23:03:20,591 DEBUG [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f1 2023-02-12 23:03:20,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-12 23:03:20,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure 5f19c1217872b6679c0c16957aeaadf0, server=jenkins-hbase4.apache.org,45545,1676242996771 in 176 msec 2023-02-12 23:03:20,591 INFO [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32dc68160ede524989d9a76e9e075d5a columnFamilyName f1 2023-02-12 23:03:20,592 INFO [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] regionserver.HStore(310): Store=32dc68160ede524989d9a76e9e075d5a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,592 INFO [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 32dc68160ede524989d9a76e9e075d5a 2023-02-12 23:03:20,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5f19c1217872b6679c0c16957aeaadf0, ASSIGN in 343 msec 2023-02-12 23:03:20,593 DEBUG [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f2 2023-02-12 23:03:20,593 DEBUG [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f2 2023-02-12 23:03:20,594 INFO [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32dc68160ede524989d9a76e9e075d5a columnFamilyName f2 2023-02-12 23:03:20,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:20,594 INFO [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] regionserver.HStore(310): Store=32dc68160ede524989d9a76e9e075d5a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0736d5406d404b5c1b17d60c3167aa7c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60329915, jitterRate=-0.10101421177387238}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:20,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0736d5406d404b5c1b17d60c3167aa7c: Running coprocessor pre-open hook at 1676243000577Writing region info on filesystem at 1676243000577Initializing all the Stores at 1676243000578 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000578Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000578Cleaning up temporary data from old regions at 1676243000586 (+8 ms)Cleaning up detritus from prior splits at 1676243000586Running coprocessor post-open hooks at 1676243000594 (+8 ms)Region opened successfully at 1676243000594 2023-02-12 23:03:20,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a 2023-02-12 23:03:20,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c., pid=27, masterSystemTime=1676243000573 2023-02-12 23:03:20,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a 2023-02-12 23:03:20,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:20,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:20,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:20,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 18ed925f188a6f68eaf81f5831366882, NAME => 'testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-12 23:03:20,597 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=0736d5406d404b5c1b17d60c3167aa7c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:20,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 18ed925f188a6f68eaf81f5831366882 2023-02-12 23:03:20,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,597 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000597"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243000597"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243000597"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243000597"}]},"ts":"1676243000597"} 2023-02-12 23:03:20,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:20,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 18ed925f188a6f68eaf81f5831366882 2023-02-12 23:03:20,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 18ed925f188a6f68eaf81f5831366882 2023-02-12 23:03:20,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 32dc68160ede524989d9a76e9e075d5a 2023-02-12 23:03:20,598 INFO [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 18ed925f188a6f68eaf81f5831366882 2023-02-12 23:03:20,600 DEBUG [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f1 2023-02-12 23:03:20,600 DEBUG [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f1 2023-02-12 23:03:20,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=17 2023-02-12 23:03:20,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=17, state=SUCCESS; OpenRegionProcedure 0736d5406d404b5c1b17d60c3167aa7c, server=jenkins-hbase4.apache.org,34617,1676242996811 in 177 msec 2023-02-12 23:03:20,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:20,600 INFO [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18ed925f188a6f68eaf81f5831366882 columnFamilyName f1 2023-02-12 23:03:20,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 32dc68160ede524989d9a76e9e075d5a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61874697, jitterRate=-0.077995166182518}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:20,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 32dc68160ede524989d9a76e9e075d5a: Running coprocessor pre-open hook at 1676243000588Writing region info on filesystem at 1676243000588Initializing all the Stores at 1676243000589 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000589Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000589Cleaning up temporary data from old regions at 1676243000596 (+7 ms)Cleaning up detritus from prior splits at 1676243000596Running coprocessor post-open hooks at 1676243000601 (+5 ms)Region opened successfully at 1676243000601 2023-02-12 23:03:20,601 INFO [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] regionserver.HStore(310): Store=18ed925f188a6f68eaf81f5831366882/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,601 INFO [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 18ed925f188a6f68eaf81f5831366882 2023-02-12 23:03:20,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0736d5406d404b5c1b17d60c3167aa7c, ASSIGN in 352 msec 2023-02-12 23:03:20,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a., pid=24, masterSystemTime=1676243000562 2023-02-12 23:03:20,603 DEBUG [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f2 2023-02-12 23:03:20,603 DEBUG [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f2 2023-02-12 23:03:20,603 INFO [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18ed925f188a6f68eaf81f5831366882 columnFamilyName f2 2023-02-12 23:03:20,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:20,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:20,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:20,603 INFO [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] regionserver.HStore(310): Store=18ed925f188a6f68eaf81f5831366882/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 08eb73920285e635825f35a554ddf21c, NAME => 'testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-12 23:03:20,603 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=32dc68160ede524989d9a76e9e075d5a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:20,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 08eb73920285e635825f35a554ddf21c 2023-02-12 23:03:20,604 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000603"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243000603"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243000603"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243000603"}]},"ts":"1676243000603"} 2023-02-12 23:03:20,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 08eb73920285e635825f35a554ddf21c 2023-02-12 23:03:20,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 08eb73920285e635825f35a554ddf21c 2023-02-12 23:03:20,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882 2023-02-12 23:03:20,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882 2023-02-12 23:03:20,605 INFO [StoreOpener-08eb73920285e635825f35a554ddf21c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08eb73920285e635825f35a554ddf21c 2023-02-12 23:03:20,607 DEBUG [StoreOpener-08eb73920285e635825f35a554ddf21c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f1 2023-02-12 23:03:20,607 DEBUG [StoreOpener-08eb73920285e635825f35a554ddf21c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f1 2023-02-12 23:03:20,607 INFO [StoreOpener-08eb73920285e635825f35a554ddf21c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08eb73920285e635825f35a554ddf21c columnFamilyName f1 2023-02-12 23:03:20,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=15 2023-02-12 23:03:20,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=15, state=SUCCESS; OpenRegionProcedure 32dc68160ede524989d9a76e9e075d5a, server=jenkins-hbase4.apache.org,45545,1676242996771 in 193 msec 2023-02-12 23:03:20,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:20,608 INFO [StoreOpener-08eb73920285e635825f35a554ddf21c-1] regionserver.HStore(310): Store=08eb73920285e635825f35a554ddf21c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,608 INFO [StoreOpener-08eb73920285e635825f35a554ddf21c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08eb73920285e635825f35a554ddf21c 2023-02-12 23:03:20,608 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=32dc68160ede524989d9a76e9e075d5a, ASSIGN in 359 msec 2023-02-12 23:03:20,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 18ed925f188a6f68eaf81f5831366882 2023-02-12 23:03:20,609 DEBUG [StoreOpener-08eb73920285e635825f35a554ddf21c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f2 2023-02-12 23:03:20,609 DEBUG [StoreOpener-08eb73920285e635825f35a554ddf21c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f2 2023-02-12 23:03:20,609 INFO [StoreOpener-08eb73920285e635825f35a554ddf21c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08eb73920285e635825f35a554ddf21c columnFamilyName f2 2023-02-12 23:03:20,610 INFO [StoreOpener-08eb73920285e635825f35a554ddf21c-1] regionserver.HStore(310): Store=08eb73920285e635825f35a554ddf21c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c 2023-02-12 23:03:20,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c 2023-02-12 23:03:20,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:20,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 18ed925f188a6f68eaf81f5831366882; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68228748, jitterRate=0.01668757200241089}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:20,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 18ed925f188a6f68eaf81f5831366882: Running coprocessor pre-open hook at 1676243000597Writing region info on filesystem at 1676243000597Initializing all the Stores at 1676243000598 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000598Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000598Cleaning up temporary data from old regions at 1676243000606 (+8 ms)Cleaning up detritus from prior splits at 1676243000606Running coprocessor post-open hooks at 1676243000613 (+7 ms)Region opened successfully at 1676243000613 2023-02-12 23:03:20,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:20,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882., pid=30, masterSystemTime=1676243000573 2023-02-12 23:03:20,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 08eb73920285e635825f35a554ddf21c 2023-02-12 23:03:20,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:20,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:20,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:20,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e2e562ad32c112155905f7ead92570f2, NAME => 'testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-12 23:03:20,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e2e562ad32c112155905f7ead92570f2 2023-02-12 23:03:20,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e2e562ad32c112155905f7ead92570f2 2023-02-12 23:03:20,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e2e562ad32c112155905f7ead92570f2 2023-02-12 23:03:20,617 INFO [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e2e562ad32c112155905f7ead92570f2 2023-02-12 23:03:20,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:20,618 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=18ed925f188a6f68eaf81f5831366882, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:20,618 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000617"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243000617"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243000617"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243000617"}]},"ts":"1676243000617"} 2023-02-12 23:03:20,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:20,618 DEBUG [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f1 2023-02-12 23:03:20,618 DEBUG [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f1 2023-02-12 23:03:20,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 08eb73920285e635825f35a554ddf21c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65085086, jitterRate=-0.030156642198562622}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:20,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 08eb73920285e635825f35a554ddf21c: Running coprocessor pre-open hook at 1676243000604Writing region info on filesystem at 1676243000604Initializing all the Stores at 1676243000605 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000605Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000605Cleaning up temporary data from old regions at 1676243000612 (+7 ms)Cleaning up detritus from prior splits at 1676243000612Running coprocessor post-open hooks at 1676243000619 (+7 ms)Region opened successfully at 1676243000619 2023-02-12 23:03:20,619 INFO [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2e562ad32c112155905f7ead92570f2 columnFamilyName f1 2023-02-12 23:03:20,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c., pid=21, masterSystemTime=1676243000562 2023-02-12 23:03:20,620 INFO [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] regionserver.HStore(310): Store=e2e562ad32c112155905f7ead92570f2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,620 INFO [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e2e562ad32c112155905f7ead92570f2 2023-02-12 23:03:20,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:20,621 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:20,621 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:20,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 665dc8533514e2f10d7e2bd897400da8, NAME => 'testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-12 23:03:20,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 665dc8533514e2f10d7e2bd897400da8 2023-02-12 23:03:20,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 665dc8533514e2f10d7e2bd897400da8 2023-02-12 23:03:20,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 665dc8533514e2f10d7e2bd897400da8 2023-02-12 23:03:20,623 DEBUG [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f2 2023-02-12 23:03:20,623 DEBUG [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f2 2023-02-12 23:03:20,623 INFO [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2e562ad32c112155905f7ead92570f2 columnFamilyName f2 2023-02-12 23:03:20,624 INFO [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] regionserver.HStore(310): Store=e2e562ad32c112155905f7ead92570f2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2 2023-02-12 23:03:20,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2 2023-02-12 23:03:20,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:20,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e2e562ad32c112155905f7ead92570f2 2023-02-12 23:03:20,630 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=08eb73920285e635825f35a554ddf21c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:20,630 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676243000006.08eb73920285e635825f35a554ddf21c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000630"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243000630"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243000630"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243000630"}]},"ts":"1676243000630"} 2023-02-12 23:03:20,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-12 23:03:20,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure 18ed925f188a6f68eaf81f5831366882, server=jenkins-hbase4.apache.org,34617,1676242996811 in 196 msec 2023-02-12 23:03:20,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=18ed925f188a6f68eaf81f5831366882, ASSIGN in 383 msec 2023-02-12 23:03:20,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-12 23:03:20,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure 08eb73920285e635825f35a554ddf21c, server=jenkins-hbase4.apache.org,45545,1676242996771 in 222 msec 2023-02-12 23:03:20,635 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=08eb73920285e635825f35a554ddf21c, ASSIGN in 386 msec 2023-02-12 23:03:20,636 INFO [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 665dc8533514e2f10d7e2bd897400da8 2023-02-12 23:03:20,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:20,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e2e562ad32c112155905f7ead92570f2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72215244, jitterRate=0.0760909914970398}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:20,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e2e562ad32c112155905f7ead92570f2: Running coprocessor pre-open hook at 1676243000616Writing region info on filesystem at 1676243000616Initializing all the Stores at 1676243000616Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000616Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000617 (+1 ms)Cleaning up temporary data from old regions at 1676243000626 (+9 ms)Cleaning up detritus from prior splits at 1676243000626Running coprocessor post-open hooks at 1676243000637 (+11 ms)Region opened successfully at 1676243000637 2023-02-12 23:03:20,637 DEBUG [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f1 2023-02-12 23:03:20,637 DEBUG [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f1 2023-02-12 23:03:20,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2., pid=29, masterSystemTime=1676243000573 2023-02-12 23:03:20,638 INFO [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 665dc8533514e2f10d7e2bd897400da8 columnFamilyName f1 2023-02-12 23:03:20,638 INFO [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] regionserver.HStore(310): Store=665dc8533514e2f10d7e2bd897400da8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,638 INFO [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 665dc8533514e2f10d7e2bd897400da8 2023-02-12 23:03:20,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:20,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:20,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 86a144358000c8ea6648753ad84b60f9, NAME => 'testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-12 23:03:20,640 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=e2e562ad32c112155905f7ead92570f2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:20,640 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000640"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243000640"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243000640"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243000640"}]},"ts":"1676243000640"} 2023-02-12 23:03:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 86a144358000c8ea6648753ad84b60f9 2023-02-12 23:03:20,640 DEBUG [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f2 2023-02-12 23:03:20,640 DEBUG [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f2 2023-02-12 23:03:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 86a144358000c8ea6648753ad84b60f9 2023-02-12 23:03:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 86a144358000c8ea6648753ad84b60f9 2023-02-12 23:03:20,641 INFO [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 665dc8533514e2f10d7e2bd897400da8 columnFamilyName f2 2023-02-12 23:03:20,641 INFO [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] regionserver.HStore(310): Store=665dc8533514e2f10d7e2bd897400da8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8 2023-02-12 23:03:20,642 INFO [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 86a144358000c8ea6648753ad84b60f9 2023-02-12 23:03:20,644 DEBUG [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/86a144358000c8ea6648753ad84b60f9/f1 2023-02-12 23:03:20,644 DEBUG [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/86a144358000c8ea6648753ad84b60f9/f1 2023-02-12 23:03:20,644 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=18 2023-02-12 23:03:20,644 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=18, state=SUCCESS; OpenRegionProcedure e2e562ad32c112155905f7ead92570f2, server=jenkins-hbase4.apache.org,34617,1676242996811 in 220 msec 2023-02-12 23:03:20,644 INFO [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86a144358000c8ea6648753ad84b60f9 columnFamilyName f1 2023-02-12 23:03:20,645 INFO [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] regionserver.HStore(310): Store=86a144358000c8ea6648753ad84b60f9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8 2023-02-12 23:03:20,645 INFO [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 86a144358000c8ea6648753ad84b60f9 2023-02-12 23:03:20,646 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e2e562ad32c112155905f7ead92570f2, ASSIGN in 396 msec 2023-02-12 23:03:20,647 DEBUG [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/86a144358000c8ea6648753ad84b60f9/f2 2023-02-12 23:03:20,647 DEBUG [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/86a144358000c8ea6648753ad84b60f9/f2 2023-02-12 23:03:20,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:20,647 INFO [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86a144358000c8ea6648753ad84b60f9 columnFamilyName f2 2023-02-12 23:03:20,648 INFO [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] regionserver.HStore(310): Store=86a144358000c8ea6648753ad84b60f9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 665dc8533514e2f10d7e2bd897400da8 2023-02-12 23:03:20,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/86a144358000c8ea6648753ad84b60f9 2023-02-12 23:03:20,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/86a144358000c8ea6648753ad84b60f9 2023-02-12 23:03:20,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:20,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 665dc8533514e2f10d7e2bd897400da8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74184661, jitterRate=0.10543759167194366}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:20,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 665dc8533514e2f10d7e2bd897400da8: Running coprocessor pre-open hook at 1676243000622Writing region info on filesystem at 1676243000622Initializing all the Stores at 1676243000630 (+8 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000630Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000636 (+6 ms)Cleaning up temporary data from old regions at 1676243000646 (+10 ms)Cleaning up detritus from prior splits at 1676243000646Running coprocessor post-open hooks at 1676243000651 (+5 ms)Region opened successfully at 1676243000651 2023-02-12 23:03:20,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:20,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8., pid=23, masterSystemTime=1676243000562 2023-02-12 23:03:20,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 86a144358000c8ea6648753ad84b60f9 2023-02-12 23:03:20,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:20,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:20,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:20,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a6a622ff106adf0ab6f2bbb0307a2759, NAME => 'testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-12 23:03:20,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a6a622ff106adf0ab6f2bbb0307a2759 2023-02-12 23:03:20,654 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=665dc8533514e2f10d7e2bd897400da8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:20,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a6a622ff106adf0ab6f2bbb0307a2759 2023-02-12 23:03:20,655 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000654"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243000654"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243000654"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243000654"}]},"ts":"1676243000654"} 2023-02-12 23:03:20,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a6a622ff106adf0ab6f2bbb0307a2759 2023-02-12 23:03:20,657 INFO [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a6a622ff106adf0ab6f2bbb0307a2759 2023-02-12 23:03:20,659 DEBUG [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f1 2023-02-12 23:03:20,659 DEBUG [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f1 2023-02-12 23:03:20,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/86a144358000c8ea6648753ad84b60f9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:20,659 INFO [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6a622ff106adf0ab6f2bbb0307a2759 columnFamilyName f1 2023-02-12 23:03:20,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 86a144358000c8ea6648753ad84b60f9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69541179, jitterRate=0.03624431788921356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:20,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 86a144358000c8ea6648753ad84b60f9: Running coprocessor pre-open hook at 1676243000641Writing region info on filesystem at 1676243000641Initializing all the Stores at 1676243000642 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000642Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000642Cleaning up temporary data from old regions at 1676243000650 (+8 ms)Cleaning up detritus from prior splits at 1676243000651 (+1 ms)Running coprocessor post-open hooks at 1676243000660 (+9 ms)Region opened successfully at 1676243000660 2023-02-12 23:03:20,660 INFO [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] regionserver.HStore(310): Store=a6a622ff106adf0ab6f2bbb0307a2759/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,660 INFO [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a6a622ff106adf0ab6f2bbb0307a2759 2023-02-12 23:03:20,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9., pid=28, masterSystemTime=1676243000573 2023-02-12 23:03:20,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=13 2023-02-12 23:03:20,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=13, state=SUCCESS; OpenRegionProcedure 665dc8533514e2f10d7e2bd897400da8, server=jenkins-hbase4.apache.org,45545,1676242996771 in 246 msec 2023-02-12 23:03:20,662 DEBUG [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f2 2023-02-12 23:03:20,662 DEBUG [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f2 2023-02-12 23:03:20,662 INFO [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6a622ff106adf0ab6f2bbb0307a2759 columnFamilyName f2 2023-02-12 23:03:20,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:20,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:20,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:20,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fdab89856484d1378024257bd8a44d06, NAME => 'testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-12 23:03:20,663 INFO [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] regionserver.HStore(310): Store=a6a622ff106adf0ab6f2bbb0307a2759/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,663 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=665dc8533514e2f10d7e2bd897400da8, ASSIGN in 413 msec 2023-02-12 23:03:20,663 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=86a144358000c8ea6648753ad84b60f9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:20,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fdab89856484d1378024257bd8a44d06 2023-02-12 23:03:20,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:20,663 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676243000663"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243000663"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243000663"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243000663"}]},"ts":"1676243000663"} 2023-02-12 23:03:20,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fdab89856484d1378024257bd8a44d06 2023-02-12 23:03:20,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fdab89856484d1378024257bd8a44d06 2023-02-12 23:03:20,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759 2023-02-12 23:03:20,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759 2023-02-12 23:03:20,665 INFO [StoreOpener-fdab89856484d1378024257bd8a44d06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fdab89856484d1378024257bd8a44d06 2023-02-12 23:03:20,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:20,666 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=20 2023-02-12 23:03:20,666 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=20, state=SUCCESS; OpenRegionProcedure 86a144358000c8ea6648753ad84b60f9, server=jenkins-hbase4.apache.org,34617,1676242996811 in 242 msec 2023-02-12 23:03:20,667 DEBUG [StoreOpener-fdab89856484d1378024257bd8a44d06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/fdab89856484d1378024257bd8a44d06/f1 2023-02-12 23:03:20,667 DEBUG [StoreOpener-fdab89856484d1378024257bd8a44d06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/fdab89856484d1378024257bd8a44d06/f1 2023-02-12 23:03:20,667 INFO [StoreOpener-fdab89856484d1378024257bd8a44d06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdab89856484d1378024257bd8a44d06 columnFamilyName f1 2023-02-12 23:03:20,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=86a144358000c8ea6648753ad84b60f9, ASSIGN in 418 msec 2023-02-12 23:03:20,668 INFO [StoreOpener-fdab89856484d1378024257bd8a44d06-1] regionserver.HStore(310): Store=fdab89856484d1378024257bd8a44d06/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,668 INFO [StoreOpener-fdab89856484d1378024257bd8a44d06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fdab89856484d1378024257bd8a44d06 2023-02-12 23:03:20,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a6a622ff106adf0ab6f2bbb0307a2759 2023-02-12 23:03:20,670 DEBUG [StoreOpener-fdab89856484d1378024257bd8a44d06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/fdab89856484d1378024257bd8a44d06/f2 2023-02-12 23:03:20,670 DEBUG [StoreOpener-fdab89856484d1378024257bd8a44d06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/fdab89856484d1378024257bd8a44d06/f2 2023-02-12 23:03:20,670 INFO [StoreOpener-fdab89856484d1378024257bd8a44d06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdab89856484d1378024257bd8a44d06 columnFamilyName f2 2023-02-12 23:03:20,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:20,670 INFO [StoreOpener-fdab89856484d1378024257bd8a44d06-1] regionserver.HStore(310): Store=fdab89856484d1378024257bd8a44d06/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:20,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a6a622ff106adf0ab6f2bbb0307a2759; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64020984, jitterRate=-0.0460129976272583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:20,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a6a622ff106adf0ab6f2bbb0307a2759: Running coprocessor pre-open hook at 1676243000655Writing region info on filesystem at 1676243000655Initializing all the Stores at 1676243000656 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000656Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000657 (+1 ms)Cleaning up temporary data from old regions at 1676243000665 (+8 ms)Cleaning up detritus from prior splits at 1676243000665Running coprocessor post-open hooks at 1676243000671 (+6 ms)Region opened successfully at 1676243000671 2023-02-12 23:03:20,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/fdab89856484d1378024257bd8a44d06 2023-02-12 23:03:20,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759., pid=22, masterSystemTime=1676243000562 2023-02-12 23:03:20,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/fdab89856484d1378024257bd8a44d06 2023-02-12 23:03:20,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:20,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:20,674 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=a6a622ff106adf0ab6f2bbb0307a2759, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:20,674 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676243000674"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243000674"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243000674"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243000674"}]},"ts":"1676243000674"} 2023-02-12 23:03:20,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:20,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fdab89856484d1378024257bd8a44d06 2023-02-12 23:03:20,678 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-12 23:03:20,678 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure a6a622ff106adf0ab6f2bbb0307a2759, server=jenkins-hbase4.apache.org,45545,1676242996771 in 265 msec 2023-02-12 23:03:20,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/fdab89856484d1378024257bd8a44d06/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:20,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fdab89856484d1378024257bd8a44d06; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69551749, jitterRate=0.03640182316303253}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:20,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fdab89856484d1378024257bd8a44d06: Running coprocessor pre-open hook at 1676243000663Writing region info on filesystem at 1676243000663Initializing all the Stores at 1676243000665 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000665Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243000665Cleaning up temporary data from old regions at 1676243000673 (+8 ms)Cleaning up detritus from prior splits at 1676243000674 (+1 ms)Running coprocessor post-open hooks at 1676243000680 (+6 ms)Region opened successfully at 1676243000680 2023-02-12 23:03:20,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a6a622ff106adf0ab6f2bbb0307a2759, ASSIGN in 430 msec 2023-02-12 23:03:20,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06., pid=26, masterSystemTime=1676243000573 2023-02-12 23:03:20,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:20,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:20,682 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=fdab89856484d1378024257bd8a44d06, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:20,683 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676243000682"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243000682"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243000682"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243000682"}]},"ts":"1676243000682"} 2023-02-12 23:03:20,686 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=11 2023-02-12 23:03:20,686 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=11, state=SUCCESS; OpenRegionProcedure fdab89856484d1378024257bd8a44d06, server=jenkins-hbase4.apache.org,34617,1676242996811 in 265 msec 2023-02-12 23:03:20,687 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 23:03:20,688 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fdab89856484d1378024257bd8a44d06, ASSIGN in 438 msec 2023-02-12 23:03:20,688 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 23:03:20,688 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243000688"}]},"ts":"1676243000688"} 2023-02-12 23:03:20,690 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-12 23:03:20,755 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 23:03:20,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 748 msec 2023-02-12 23:03:21,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:21,119 INFO [Listener at localhost/37407] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-12 23:03:21,119 DEBUG [Listener at localhost/37407] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-12 23:03:21,120 INFO [Listener at localhost/37407] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 23:03:21,123 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-12 23:03:21,123 INFO [Listener at localhost/37407] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 23:03:21,123 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-12 23:03:21,123 INFO [Listener at localhost/37407] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 23:03:21,175 DEBUG [hconnection-0x848c05d-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:21,187 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34617] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:21,195 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52374, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:21,205 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45545] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:21,284 INFO [Listener at localhost/37407] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 23:03:21,284 INFO [Listener at localhost/37407] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 23:03:21,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 23:03:21,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676243001285 (current time:1676243001285). 2023-02-12 23:03:21,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 23:03:21,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] zookeeper.ReadOnlyZKClient(139): Connect 0x096b2500 to 127.0.0.1:53472 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:21,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b32cd85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:21,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:21,295 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60272, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:21,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x096b2500 to 127.0.0.1:53472 2023-02-12 23:03:21,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:21,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 23:03:21,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 23:03:21,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 23:03:21,300 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 23:03:21,301 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676243601301 2023-02-12 23:03:21,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 23:03:21,302 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-12 23:03:21,303 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 23:03:21,303 DEBUG [Listener at localhost/37407] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 23:03:21,303 DEBUG [Listener at localhost/37407] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 23:03:21,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 23:03:21,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-12 23:03:21,305 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 23:03:21,306 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676243601306 2023-02-12 23:03:21,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,320 INFO [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-12 23:03:21,320 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:21,321 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-12 23:03:21,321 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-12 23:03:21,321 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,321 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,323 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:21,323 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:21,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:21,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:21,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:21,323 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:21,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,324 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,324 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,325 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-12 23:03:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-12 23:03:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,325 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 23:03:21,325 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 23:03:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,325 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 23:03:21,325 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,328 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,328 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-12 23:03:21,328 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:21,329 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-12 23:03:21,329 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-12 23:03:21,329 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45545,1676242996771' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-12 23:03:21,329 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-12 23:03:21,329 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:21,329 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-12 23:03:21,329 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-12 23:03:21,329 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34617,1676242996811' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-12 23:03:21,332 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,332 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:21,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:21,333 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,333 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,333 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:21,333 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:21,334 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,334 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:21,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:21,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:21,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45545,1676242996771' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-12 23:03:21,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d92b890[Count = 1] remaining members to acquire global barrier 2023-02-12 23:03:21,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:21,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:21,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:21,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:21,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:21,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34617,1676242996811' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-12 23:03:21,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d92b890[Count = 0] remaining members to acquire global barrier 2023-02-12 23:03:21,338 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-12 23:03:21,338 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,339 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,339 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,340 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-12 23:03:21,340 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,340 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-12 23:03:21,340 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:21,340 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. started... 2023-02-12 23:03:21,340 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,340 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 23:03:21,341 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:21,341 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 665dc8533514e2f10d7e2bd897400da8 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:21,341 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. started... 2023-02-12 23:03:21,342 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0736d5406d404b5c1b17d60c3167aa7c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:21,342 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:21,342 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:21,342 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. started... 2023-02-12 23:03:21,342 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. started... 2023-02-12 23:03:21,342 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 23:03:21,344 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 23:03:21,344 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:21,344 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 23:03:21,344 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 23:03:21,344 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 18ed925f188a6f68eaf81f5831366882 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:21,343 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:21,343 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e2e562ad32c112155905f7ead92570f2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:21,344 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. started... 2023-02-12 23:03:21,344 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. started... 2023-02-12 23:03:21,345 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 08eb73920285e635825f35a554ddf21c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:21,346 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.HRegion(2744): Flushing a6a622ff106adf0ab6f2bbb0307a2759 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 23:03:21,403 DEBUG [Listener at localhost/37407] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:21,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 23:03:21,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 23:03:21,406 DEBUG [Listener at localhost/37407] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 23:03:21,448 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/.tmp/f1/b27782d1a53f4045bbe6a043b7035e38 2023-02-12 23:03:21,448 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/.tmp/f1/bba853ee31524732802229478bb082bc 2023-02-12 23:03:21,452 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/.tmp/f1/34375b41bb6745aeacffbdabba62b4f0 2023-02-12 23:03:21,458 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/.tmp/f1/b983f0225c7a4e86b12e71ff1da90309 2023-02-12 23:03:21,468 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/.tmp/f1/e25167c8d186459085d7be0a191d6c5b 2023-02-12 23:03:21,477 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/.tmp/f1/c25107b077e14f2a9df53ad19d65cc6d 2023-02-12 23:03:21,528 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/.tmp/f2/6a64f5921a0e44ff893bedfc4020c172 2023-02-12 23:03:21,528 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/.tmp/f2/c7a1995726ad44368c15c9d0c95c4b1d 2023-02-12 23:03:21,538 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/.tmp/f2/b052237b856347529b11be56a0a13344 2023-02-12 23:03:21,538 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/.tmp/f2/b55216d619c543608f0d3c40144b9b1e 2023-02-12 23:03:21,544 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/.tmp/f1/b27782d1a53f4045bbe6a043b7035e38 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f1/b27782d1a53f4045bbe6a043b7035e38 2023-02-12 23:03:21,545 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/.tmp/f1/bba853ee31524732802229478bb082bc as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f1/bba853ee31524732802229478bb082bc 2023-02-12 23:03:21,547 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/.tmp/f2/ea5043c2e0f34964a9404e7f57a159c9 2023-02-12 23:03:21,547 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/.tmp/f1/c25107b077e14f2a9df53ad19d65cc6d as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f1/c25107b077e14f2a9df53ad19d65cc6d 2023-02-12 23:03:21,549 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/.tmp/f1/e25167c8d186459085d7be0a191d6c5b as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f1/e25167c8d186459085d7be0a191d6c5b 2023-02-12 23:03:21,553 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f1/bba853ee31524732802229478bb082bc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:21,554 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/.tmp/f1/34375b41bb6745aeacffbdabba62b4f0 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f1/34375b41bb6745aeacffbdabba62b4f0 2023-02-12 23:03:21,554 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f1/b27782d1a53f4045bbe6a043b7035e38, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:21,555 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/.tmp/f2/c7a1995726ad44368c15c9d0c95c4b1d as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f2/c7a1995726ad44368c15c9d0c95c4b1d 2023-02-12 23:03:21,556 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/.tmp/f2/6a64f5921a0e44ff893bedfc4020c172 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f2/6a64f5921a0e44ff893bedfc4020c172 2023-02-12 23:03:21,557 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f1/c25107b077e14f2a9df53ad19d65cc6d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 23:03:21,557 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f1/e25167c8d186459085d7be0a191d6c5b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:21,559 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/.tmp/f2/b55216d619c543608f0d3c40144b9b1e as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f2/b55216d619c543608f0d3c40144b9b1e 2023-02-12 23:03:21,560 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/.tmp/f2/b052237b856347529b11be56a0a13344 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f2/b052237b856347529b11be56a0a13344 2023-02-12 23:03:21,563 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f2/6a64f5921a0e44ff893bedfc4020c172, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:21,563 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f1/34375b41bb6745aeacffbdabba62b4f0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:21,564 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e2e562ad32c112155905f7ead92570f2 in 221ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:21,564 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-12 23:03:21,565 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/.tmp/f2/ea5043c2e0f34964a9404e7f57a159c9 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f2/ea5043c2e0f34964a9404e7f57a159c9 2023-02-12 23:03:21,565 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e2e562ad32c112155905f7ead92570f2: 2023-02-12 23:03:21,565 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,565 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:21,565 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f1/b27782d1a53f4045bbe6a043b7035e38] hfiles 2023-02-12 23:03:21,565 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f1/b27782d1a53f4045bbe6a043b7035e38 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,565 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f2/6a64f5921a0e44ff893bedfc4020c172] hfiles 2023-02-12 23:03:21,565 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f2/6a64f5921a0e44ff893bedfc4020c172 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,568 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f2/b55216d619c543608f0d3c40144b9b1e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 23:03:21,569 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for a6a622ff106adf0ab6f2bbb0307a2759 in 223ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:21,573 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for a6a622ff106adf0ab6f2bbb0307a2759: 2023-02-12 23:03:21,573 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,573 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:21,573 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f1/c25107b077e14f2a9df53ad19d65cc6d] hfiles 2023-02-12 23:03:21,573 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f1/c25107b077e14f2a9df53ad19d65cc6d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,573 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f2/b55216d619c543608f0d3c40144b9b1e] hfiles 2023-02-12 23:03:21,574 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f2/b55216d619c543608f0d3c40144b9b1e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,577 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f2/b052237b856347529b11be56a0a13344, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:21,578 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f2/ea5043c2e0f34964a9404e7f57a159c9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:21,578 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f2/c7a1995726ad44368c15c9d0c95c4b1d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:21,579 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0736d5406d404b5c1b17d60c3167aa7c in 237ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:21,579 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0736d5406d404b5c1b17d60c3167aa7c: 2023-02-12 23:03:21,579 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 18ed925f188a6f68eaf81f5831366882 in 235ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:21,579 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 18ed925f188a6f68eaf81f5831366882: 2023-02-12 23:03:21,579 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,579 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:21,579 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,579 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f1/e25167c8d186459085d7be0a191d6c5b] hfiles 2023-02-12 23:03:21,579 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:21,579 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f1/e25167c8d186459085d7be0a191d6c5b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,579 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f1/bba853ee31524732802229478bb082bc] hfiles 2023-02-12 23:03:21,579 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f2/b052237b856347529b11be56a0a13344] hfiles 2023-02-12 23:03:21,579 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f1/bba853ee31524732802229478bb082bc for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,579 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f2/b052237b856347529b11be56a0a13344 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,579 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f2/c7a1995726ad44368c15c9d0c95c4b1d] hfiles 2023-02-12 23:03:21,580 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f2/c7a1995726ad44368c15c9d0c95c4b1d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,587 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 665dc8533514e2f10d7e2bd897400da8 in 246ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:21,587 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 665dc8533514e2f10d7e2bd897400da8: 2023-02-12 23:03:21,587 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,587 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:21,587 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f1/34375b41bb6745aeacffbdabba62b4f0] hfiles 2023-02-12 23:03:21,587 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f1/34375b41bb6745aeacffbdabba62b4f0 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,587 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f2/ea5043c2e0f34964a9404e7f57a159c9] hfiles 2023-02-12 23:03:21,587 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f2/ea5043c2e0f34964a9404e7f57a159c9 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,600 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. completed. 2023-02-12 23:03:21,600 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:21,600 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:21,600 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 23:03:21,600 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. started... 2023-02-12 23:03:21,606 DEBUG [Listener at localhost/37407] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:21,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 23:03:21,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 23:03:21,608 DEBUG [Listener at localhost/37407] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 23:03:21,608 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. completed. 2023-02-12 23:03:21,608 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:21,608 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:21,608 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 23:03:21,608 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. started... 2023-02-12 23:03:21,615 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for fdab89856484d1378024257bd8a44d06: 2023-02-12 23:03:21,615 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 32dc68160ede524989d9a76e9e075d5a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:21,615 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,615 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:21,615 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 23:03:21,615 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 23:03:21,620 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. completed. 2023-02-12 23:03:21,620 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:21,620 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:21,620 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. started... 2023-02-12 23:03:21,621 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 86a144358000c8ea6648753ad84b60f9: 2023-02-12 23:03:21,621 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,621 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:21,621 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 23:03:21,621 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 23:03:21,621 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 23:03:21,626 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. completed. 2023-02-12 23:03:21,627 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:21,628 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 23:03:21,632 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. completed. 2023-02-12 23:03:21,632 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:21,632 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:21,632 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 23:03:21,632 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. started... 2023-02-12 23:03:21,632 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5f19c1217872b6679c0c16957aeaadf0 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 23:03:21,660 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. completed. 2023-02-12 23:03:21,660 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:21,660 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 23:03:21,660 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/.tmp/f1/f7593b32787e4f0d82dec5853b211a5a 2023-02-12 23:03:21,663 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. completed. 2023-02-12 23:03:21,663 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:21,663 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 23:03:21,664 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 23:03:21,664 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,664 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-12 23:03:21,664 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,34617,1676242996811' in zk 2023-02-12 23:03:21,666 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-12 23:03:21,666 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,666 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:21,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:21,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:21,666 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-12 23:03:21,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:21,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:21,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,34617,1676242996811': 2023-02-12 23:03:21,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34617,1676242996811' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 23:03:21,676 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/.tmp/f1/21b85f29cb6444fba3fa0e54b6ea6e73 2023-02-12 23:03:21,683 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/.tmp/f2/fdbaa699706a4293b6fdc9138dc9027d 2023-02-12 23:03:21,692 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/.tmp/f1/f7593b32787e4f0d82dec5853b211a5a as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f1/f7593b32787e4f0d82dec5853b211a5a 2023-02-12 23:03:21,698 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f1/f7593b32787e4f0d82dec5853b211a5a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:21,699 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/.tmp/f2/fdbaa699706a4293b6fdc9138dc9027d as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f2/fdbaa699706a4293b6fdc9138dc9027d 2023-02-12 23:03:21,706 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f2/fdbaa699706a4293b6fdc9138dc9027d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:21,707 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 32dc68160ede524989d9a76e9e075d5a in 93ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:21,707 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 32dc68160ede524989d9a76e9e075d5a: 2023-02-12 23:03:21,708 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,708 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:21,708 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f1/f7593b32787e4f0d82dec5853b211a5a] hfiles 2023-02-12 23:03:21,708 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f1/f7593b32787e4f0d82dec5853b211a5a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,708 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f2/fdbaa699706a4293b6fdc9138dc9027d] hfiles 2023-02-12 23:03:21,708 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f2/fdbaa699706a4293b6fdc9138dc9027d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,712 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/.tmp/f2/b1c83e164dc840aab851a4ac7a29ea5e 2023-02-12 23:03:21,718 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/.tmp/f1/21b85f29cb6444fba3fa0e54b6ea6e73 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f1/21b85f29cb6444fba3fa0e54b6ea6e73 2023-02-12 23:03:21,723 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f1/21b85f29cb6444fba3fa0e54b6ea6e73, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 23:03:21,724 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/.tmp/f2/b1c83e164dc840aab851a4ac7a29ea5e as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f2/b1c83e164dc840aab851a4ac7a29ea5e 2023-02-12 23:03:21,735 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f2/b1c83e164dc840aab851a4ac7a29ea5e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 23:03:21,735 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. completed. 2023-02-12 23:03:21,736 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:21,736 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 23:03:21,737 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 5f19c1217872b6679c0c16957aeaadf0 in 105ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:21,737 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5f19c1217872b6679c0c16957aeaadf0: 2023-02-12 23:03:21,737 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,738 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:21,738 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f1/21b85f29cb6444fba3fa0e54b6ea6e73] hfiles 2023-02-12 23:03:21,738 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f1/21b85f29cb6444fba3fa0e54b6ea6e73 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,738 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f2/b1c83e164dc840aab851a4ac7a29ea5e] hfiles 2023-02-12 23:03:21,738 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f2/b1c83e164dc840aab851a4ac7a29ea5e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,750 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. completed. 2023-02-12 23:03:21,751 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:21,751 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 23:03:21,908 DEBUG [Listener at localhost/37407] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:21,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 23:03:21,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 23:03:21,910 DEBUG [Listener at localhost/37407] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 23:03:21,943 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/.tmp/f2/4cbcac3046ba4638b5e6b719cdd00df9 2023-02-12 23:03:21,949 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/.tmp/f1/b983f0225c7a4e86b12e71ff1da90309 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f1/b983f0225c7a4e86b12e71ff1da90309 2023-02-12 23:03:21,954 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f1/b983f0225c7a4e86b12e71ff1da90309, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:21,955 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/.tmp/f2/4cbcac3046ba4638b5e6b719cdd00df9 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f2/4cbcac3046ba4638b5e6b719cdd00df9 2023-02-12 23:03:21,960 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f2/4cbcac3046ba4638b5e6b719cdd00df9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:21,960 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 08eb73920285e635825f35a554ddf21c in 615ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:21,960 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 08eb73920285e635825f35a554ddf21c: 2023-02-12 23:03:21,961 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,961 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:21,961 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f1/b983f0225c7a4e86b12e71ff1da90309] hfiles 2023-02-12 23:03:21,961 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f1/b983f0225c7a4e86b12e71ff1da90309 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,961 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f2/4cbcac3046ba4638b5e6b719cdd00df9] hfiles 2023-02-12 23:03:21,961 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f2/4cbcac3046ba4638b5e6b719cdd00df9 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,967 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. completed. 2023-02-12 23:03:21,967 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:21,967 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 23:03:21,967 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 23:03:21,967 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,967 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-12 23:03:21,967 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,45545,1676242996771' in zk 2023-02-12 23:03:21,971 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,971 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-12 23:03:21,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,971 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:21,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:21,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:21,971 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-12 23:03:21,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:21,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:21,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:21,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,45545,1676242996771': 2023-02-12 23:03:21,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45545,1676242996771' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 23:03:21,975 INFO [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-12 23:03:21,975 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 23:03:21,975 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 23:03:21,975 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,975 INFO [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 23:03:21,976 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,976 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,976 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,976 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:21,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,976 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:21,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:21,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:21,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:21,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:21,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:21,977 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:21,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:21,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,977 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:21,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,979 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:21,979 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,986 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,986 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:21,986 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:21,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:21,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:21,986 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,986 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:21,986 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,986 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:21,986 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,986 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:21,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:21,986 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:21,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:21,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,987 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:21,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:21,987 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:21,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:21,988 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:21,988 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,988 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:21,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:22,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:22,039 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-12 23:03:22,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:22,039 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:22,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676243001302Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676243001987 (+685 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676243001987Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676243001997 (+10 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676243002007 (+10 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676243002039 (+32 ms) 2023-02-12 23:03:22,041 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 23:03:22,042 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 738 msec 2023-02-12 23:03:22,410 DEBUG [Listener at localhost/37407] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:22,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 23:03:22,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 23:03:22,412 INFO [Listener at localhost/37407] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 23:03:22,417 INFO [Listener at localhost/37407] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 23:03:22,425 INFO [Listener at localhost/37407] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 23:03:22,664 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34617] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:22,677 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45545] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:22,752 INFO [Listener at localhost/37407] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 23:03:22,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 23:03:22,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-12 23:03:22,761 INFO [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-12 23:03:22,762 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:22,762 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-12 23:03:22,762 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-12 23:03:22,763 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:22,763 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:22,765 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:22,765 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:22,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:22,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:22,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:22,765 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:22,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:22,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:22,765 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:22,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:22,765 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:22,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:22,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:22,766 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:22,766 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 23:03:22,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 23:03:22,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:22,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 23:03:22,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:22,766 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 23:03:22,766 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 23:03:22,767 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 23:03:22,767 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 23:03:22,768 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 23:03:22,768 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:22,772 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 23:03:22,772 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 23:03:22,773 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:22,773 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 23:03:22,773 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:22,773 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. started... 2023-02-12 23:03:22,774 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 665dc8533514e2f10d7e2bd897400da8 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:22,774 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:22,774 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. started... 2023-02-12 23:03:22,774 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 08eb73920285e635825f35a554ddf21c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:22,775 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:22,775 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. started... 2023-02-12 23:03:22,775 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0736d5406d404b5c1b17d60c3167aa7c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:22,776 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 23:03:22,776 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 23:03:22,777 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:22,777 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. started... 2023-02-12 23:03:22,777 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a6a622ff106adf0ab6f2bbb0307a2759 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 23:03:22,779 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:22,779 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. started... 2023-02-12 23:03:22,779 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 18ed925f188a6f68eaf81f5831366882 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:22,780 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 23:03:22,780 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 23:03:22,780 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:22,780 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. started... 2023-02-12 23:03:22,780 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e2e562ad32c112155905f7ead92570f2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:22,824 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/.tmp/f1/9eab57b5f256462dabdc2cfbaa2aa1ba 2023-02-12 23:03:22,836 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/.tmp/f1/19508f4218e245f887c5610fdc8b9dd9 2023-02-12 23:03:22,837 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/.tmp/f1/8b46bdeff3d944f7bfe37459b3447a8c 2023-02-12 23:03:22,848 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/.tmp/f1/cba4779c1436415cb12f4706a93a5661 2023-02-12 23:03:22,857 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/.tmp/f1/764783e9b7e643a09bea0ecdaffbe040 2023-02-12 23:03:22,860 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/.tmp/f1/2f400eb2f71b4424b51cc039f81eae03 2023-02-12 23:03:22,890 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/.tmp/f2/440555de8f3f45acab09e469fc4cb0f0 2023-02-12 23:03:22,897 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/.tmp/f1/8b46bdeff3d944f7bfe37459b3447a8c as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f1/8b46bdeff3d944f7bfe37459b3447a8c 2023-02-12 23:03:22,903 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f1/8b46bdeff3d944f7bfe37459b3447a8c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:22,904 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/.tmp/f2/440555de8f3f45acab09e469fc4cb0f0 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f2/440555de8f3f45acab09e469fc4cb0f0 2023-02-12 23:03:22,908 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f2/440555de8f3f45acab09e469fc4cb0f0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:22,909 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/.tmp/f2/fa218949ae3248e3b13256c193539f27 2023-02-12 23:03:22,913 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 18ed925f188a6f68eaf81f5831366882 in 134ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:22,913 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 18ed925f188a6f68eaf81f5831366882: 2023-02-12 23:03:22,913 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:22,920 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 23:03:22,920 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:22,920 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. started... 2023-02-12 23:03:22,920 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/.tmp/f2/1b878fe40b854da7abe5ce0499e3155a 2023-02-12 23:03:22,920 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for fdab89856484d1378024257bd8a44d06: 2023-02-12 23:03:22,920 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:22,920 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:22,920 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 23:03:22,920 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. started... 2023-02-12 23:03:22,921 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 86a144358000c8ea6648753ad84b60f9: 2023-02-12 23:03:22,921 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:22,921 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 23:03:22,923 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/.tmp/f1/9eab57b5f256462dabdc2cfbaa2aa1ba as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f1/9eab57b5f256462dabdc2cfbaa2aa1ba 2023-02-12 23:03:22,926 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/.tmp/f1/cba4779c1436415cb12f4706a93a5661 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f1/cba4779c1436415cb12f4706a93a5661 2023-02-12 23:03:22,930 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f1/9eab57b5f256462dabdc2cfbaa2aa1ba, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:22,931 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/.tmp/f2/fa218949ae3248e3b13256c193539f27 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f2/fa218949ae3248e3b13256c193539f27 2023-02-12 23:03:22,937 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f1/cba4779c1436415cb12f4706a93a5661, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:22,938 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/.tmp/f2/1b878fe40b854da7abe5ce0499e3155a as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f2/1b878fe40b854da7abe5ce0499e3155a 2023-02-12 23:03:22,944 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/.tmp/f2/f18be86d26954fb88125f5fe09473c2e 2023-02-12 23:03:22,947 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f2/fa218949ae3248e3b13256c193539f27, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:22,948 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 08eb73920285e635825f35a554ddf21c in 174ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:22,948 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 08eb73920285e635825f35a554ddf21c: 2023-02-12 23:03:22,948 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:22,950 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/.tmp/f1/2f400eb2f71b4424b51cc039f81eae03 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f1/2f400eb2f71b4424b51cc039f81eae03 2023-02-12 23:03:22,952 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:22,952 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. started... 2023-02-12 23:03:22,952 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 23:03:22,952 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 32dc68160ede524989d9a76e9e075d5a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:22,957 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f2/1b878fe40b854da7abe5ce0499e3155a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:22,958 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 665dc8533514e2f10d7e2bd897400da8 in 185ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:22,958 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 665dc8533514e2f10d7e2bd897400da8: 2023-02-12 23:03:22,959 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/.tmp/f2/2b036941b20f47a0af1275edc1318909 2023-02-12 23:03:22,959 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:22,959 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:22,959 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 23:03:22,959 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. started... 2023-02-12 23:03:22,959 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5f19c1217872b6679c0c16957aeaadf0 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 23:03:22,960 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f1/2f400eb2f71b4424b51cc039f81eae03, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:22,962 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/.tmp/f2/f18be86d26954fb88125f5fe09473c2e as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f2/f18be86d26954fb88125f5fe09473c2e 2023-02-12 23:03:22,967 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/.tmp/f1/764783e9b7e643a09bea0ecdaffbe040 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f1/764783e9b7e643a09bea0ecdaffbe040 2023-02-12 23:03:22,968 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f2/f18be86d26954fb88125f5fe09473c2e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:22,969 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0736d5406d404b5c1b17d60c3167aa7c in 194ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:22,969 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0736d5406d404b5c1b17d60c3167aa7c: 2023-02-12 23:03:22,969 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:22,969 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 23:03:22,974 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f1/764783e9b7e643a09bea0ecdaffbe040, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 23:03:22,975 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/.tmp/f2/2b036941b20f47a0af1275edc1318909 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f2/2b036941b20f47a0af1275edc1318909 2023-02-12 23:03:22,983 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f2/2b036941b20f47a0af1275edc1318909, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 23:03:22,984 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for a6a622ff106adf0ab6f2bbb0307a2759 in 207ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:22,984 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a6a622ff106adf0ab6f2bbb0307a2759: 2023-02-12 23:03:22,984 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:22,984 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 23:03:22,992 WARN [DataStreamer for file /user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/.tmp/f1/65bd8e3e03b34512b073e4bf94d7c02d] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-12 23:03:22,992 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/.tmp/f1/180abc8015d54b0a808a4e8220c179be 2023-02-12 23:03:22,993 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/.tmp/f1/65bd8e3e03b34512b073e4bf94d7c02d 2023-02-12 23:03:23,011 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/.tmp/f2/bd3d70901fa44e4e9a4dd95eb57f72aa 2023-02-12 23:03:23,012 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/.tmp/f2/b8fa94ea3aa943b79dad8372f602c579 2023-02-12 23:03:23,016 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/.tmp/f1/180abc8015d54b0a808a4e8220c179be as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f1/180abc8015d54b0a808a4e8220c179be 2023-02-12 23:03:23,016 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/.tmp/f1/65bd8e3e03b34512b073e4bf94d7c02d as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f1/65bd8e3e03b34512b073e4bf94d7c02d 2023-02-12 23:03:23,021 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f1/180abc8015d54b0a808a4e8220c179be, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 23:03:23,022 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f1/65bd8e3e03b34512b073e4bf94d7c02d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:23,022 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/.tmp/f2/bd3d70901fa44e4e9a4dd95eb57f72aa as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f2/bd3d70901fa44e4e9a4dd95eb57f72aa 2023-02-12 23:03:23,022 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/.tmp/f2/b8fa94ea3aa943b79dad8372f602c579 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f2/b8fa94ea3aa943b79dad8372f602c579 2023-02-12 23:03:23,027 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f2/bd3d70901fa44e4e9a4dd95eb57f72aa, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 23:03:23,028 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 5f19c1217872b6679c0c16957aeaadf0 in 69ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:23,028 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5f19c1217872b6679c0c16957aeaadf0: 2023-02-12 23:03:23,028 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:23,028 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 23:03:23,028 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f2/b8fa94ea3aa943b79dad8372f602c579, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:23,029 INFO [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 32dc68160ede524989d9a76e9e075d5a in 77ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:23,029 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 32dc68160ede524989d9a76e9e075d5a: 2023-02-12 23:03:23,029 DEBUG [rs(jenkins-hbase4.apache.org,45545,1676242996771)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:23,029 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 23:03:23,029 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 23:03:23,029 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,029 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 23:03:23,030 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45545,1676242996771' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 23:03:23,031 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,031 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:23,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:23,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:23,032 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:23,032 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:23,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:23,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:23,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:23,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:23,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45545,1676242996771' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 23:03:23,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9ad2dfa[Count = 1] remaining members to acquire global barrier 2023-02-12 23:03:23,294 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/.tmp/f2/1b0037ceb19d4a479ffe4db6e11a7bbb 2023-02-12 23:03:23,299 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/.tmp/f1/19508f4218e245f887c5610fdc8b9dd9 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f1/19508f4218e245f887c5610fdc8b9dd9 2023-02-12 23:03:23,304 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f1/19508f4218e245f887c5610fdc8b9dd9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:23,305 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/.tmp/f2/1b0037ceb19d4a479ffe4db6e11a7bbb as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f2/1b0037ceb19d4a479ffe4db6e11a7bbb 2023-02-12 23:03:23,309 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f2/1b0037ceb19d4a479ffe4db6e11a7bbb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:23,310 INFO [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e2e562ad32c112155905f7ead92570f2 in 530ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:23,310 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e2e562ad32c112155905f7ead92570f2: 2023-02-12 23:03:23,310 DEBUG [rs(jenkins-hbase4.apache.org,34617,1676242996811)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:23,310 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 23:03:23,310 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 23:03:23,310 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,311 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 23:03:23,311 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34617,1676242996811' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 23:03:23,312 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,312 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:23,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:23,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:23,313 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:23,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:23,313 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:23,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:23,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:23,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:23,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34617,1676242996811' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 23:03:23,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9ad2dfa[Count = 0] remaining members to acquire global barrier 2023-02-12 23:03:23,314 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-12 23:03:23,314 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:23,316 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:23,316 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:23,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:23,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:23,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:23,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:23,316 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,316 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 23:03:23,317 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 23:03:23,316 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 23:03:23,317 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,45545,1676242996771' in zk 2023-02-12 23:03:23,317 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 23:03:23,317 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,34617,1676242996811' in zk 2023-02-12 23:03:23,317 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,317 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 23:03:23,318 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 23:03:23,318 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:23,318 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,318 DEBUG [member: 'jenkins-hbase4.apache.org,45545,1676242996771' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 23:03:23,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:23,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:23,319 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 23:03:23,319 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,319 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:23,319 DEBUG [member: 'jenkins-hbase4.apache.org,34617,1676242996811' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 23:03:23,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:23,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:23,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:23,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:23,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:23,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,45545,1676242996771': 2023-02-12 23:03:23,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45545,1676242996771' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-12 23:03:23,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:23,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:23,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:23,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:23,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:23,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:23,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:23,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,34617,1676242996811': 2023-02-12 23:03:23,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34617,1676242996811' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-12 23:03:23,325 INFO [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-12 23:03:23,325 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 23:03:23,325 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 23:03:23,325 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-12 23:03:23,325 INFO [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 23:03:23,327 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:23,327 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:23,327 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:23,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:23,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:23,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:23,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:23,327 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:23,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:23,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:23,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:23,327 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:23,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:23,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:23,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:23,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:23,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:23,328 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:23,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:23,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:23,328 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:23,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:23,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:23,330 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:23,330 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,334 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,334 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:23,334 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:23,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:23,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:23,334 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:23,334 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,334 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:23,334 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:23,334 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:23,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:23,336 DEBUG [(jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:23,336 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:23,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:23,337 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:23,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-12 23:03:23,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 23:03:23,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:23,337 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,337 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:23,337 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:23,337 DEBUG [Listener at localhost/37407] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-12 23:03:23,337 DEBUG [Listener at localhost/37407] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 23:03:23,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:23,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:23,437 DEBUG [Listener at localhost/37407] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 23:03:23,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39753] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 23:03:23,439 INFO [Listener at localhost/37407] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 23:03:23,440 DEBUG [Listener at localhost/37407] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5445615a to 127.0.0.1:53472 2023-02-12 23:03:23,440 DEBUG [Listener at localhost/37407] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:23,440 DEBUG [Listener at localhost/37407] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 23:03:23,440 DEBUG [Listener at localhost/37407] util.JVMClusterUtil(257): Found active master hash=244477039, stopped=false 2023-02-12 23:03:23,440 INFO [Listener at localhost/37407] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39753,1676242996687 2023-02-12 23:03:23,442 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:23,442 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:23,442 INFO [Listener at localhost/37407] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 23:03:23,442 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:23,442 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:23,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:23,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:23,444 DEBUG [Listener at localhost/37407] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5242d91f to 127.0.0.1:53472 2023-02-12 23:03:23,444 DEBUG [Listener at localhost/37407] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:23,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:23,444 INFO [Listener at localhost/37407] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45545,1676242996771' ***** 2023-02-12 23:03:23,444 INFO [Listener at localhost/37407] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 23:03:23,444 INFO [Listener at localhost/37407] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34617,1676242996811' ***** 2023-02-12 23:03:23,444 INFO [Listener at localhost/37407] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 23:03:23,444 INFO [RS:0;jenkins-hbase4:45545] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 23:03:23,444 INFO [RS:1;jenkins-hbase4:34617] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 23:03:23,445 INFO [RS:0;jenkins-hbase4:45545] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 23:03:23,445 INFO [RS:1;jenkins-hbase4:34617] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 23:03:23,445 INFO [RS:0;jenkins-hbase4:45545] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 23:03:23,445 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 23:03:23,445 INFO [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(3304): Received CLOSE for 665dc8533514e2f10d7e2bd897400da8 2023-02-12 23:03:23,444 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 23:03:23,445 INFO [RS:1;jenkins-hbase4:34617] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 23:03:23,446 INFO [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(3304): Received CLOSE for 08eb73920285e635825f35a554ddf21c 2023-02-12 23:03:23,446 INFO [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(3304): Received CLOSE for 0736d5406d404b5c1b17d60c3167aa7c 2023-02-12 23:03:23,447 INFO [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(3304): Received CLOSE for a6a622ff106adf0ab6f2bbb0307a2759 2023-02-12 23:03:23,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 665dc8533514e2f10d7e2bd897400da8, disabling compactions & flushes 2023-02-12 23:03:23,447 INFO [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(3304): Received CLOSE for 32dc68160ede524989d9a76e9e075d5a 2023-02-12 23:03:23,447 INFO [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(3304): Received CLOSE for 18ed925f188a6f68eaf81f5831366882 2023-02-12 23:03:23,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:23,447 INFO [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(3304): Received CLOSE for 6bd6aafce254e495e7782914ac20f86e 2023-02-12 23:03:23,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:23,447 INFO [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(3304): Received CLOSE for e2e562ad32c112155905f7ead92570f2 2023-02-12 23:03:23,447 INFO [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(3304): Received CLOSE for 5f19c1217872b6679c0c16957aeaadf0 2023-02-12 23:03:23,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0736d5406d404b5c1b17d60c3167aa7c, disabling compactions & flushes 2023-02-12 23:03:23,447 INFO [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,447 INFO [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(3304): Received CLOSE for fdab89856484d1378024257bd8a44d06 2023-02-12 23:03:23,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. after waiting 0 ms 2023-02-12 23:03:23,447 INFO [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(3304): Received CLOSE for 86a144358000c8ea6648753ad84b60f9 2023-02-12 23:03:23,447 DEBUG [RS:0;jenkins-hbase4:45545] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x080bcc24 to 127.0.0.1:53472 2023-02-12 23:03:23,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:23,447 DEBUG [RS:0;jenkins-hbase4:45545] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:23,447 INFO [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:23,447 DEBUG [RS:1;jenkins-hbase4:34617] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bc51921 to 127.0.0.1:53472 2023-02-12 23:03:23,447 INFO [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-12 23:03:23,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:23,448 DEBUG [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(1479): Online Regions={665dc8533514e2f10d7e2bd897400da8=testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8., 08eb73920285e635825f35a554ddf21c=testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c., a6a622ff106adf0ab6f2bbb0307a2759=testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759., 32dc68160ede524989d9a76e9e075d5a=testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a., 5f19c1217872b6679c0c16957aeaadf0=testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0.} 2023-02-12 23:03:23,448 DEBUG [RS:1;jenkins-hbase4:34617] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:23,448 DEBUG [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(1505): Waiting on 08eb73920285e635825f35a554ddf21c, 32dc68160ede524989d9a76e9e075d5a, 5f19c1217872b6679c0c16957aeaadf0, 665dc8533514e2f10d7e2bd897400da8, a6a622ff106adf0ab6f2bbb0307a2759 2023-02-12 23:03:23,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. after waiting 0 ms 2023-02-12 23:03:23,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:23,448 INFO [RS:1;jenkins-hbase4:34617] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 23:03:23,449 INFO [RS:1;jenkins-hbase4:34617] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 23:03:23,449 INFO [RS:1;jenkins-hbase4:34617] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 23:03:23,449 INFO [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 23:03:23,449 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:23,450 INFO [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-12 23:03:23,450 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:23,450 DEBUG [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(1479): Online Regions={0736d5406d404b5c1b17d60c3167aa7c=testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c., 18ed925f188a6f68eaf81f5831366882=testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882., 6bd6aafce254e495e7782914ac20f86e=hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e., 1588230740=hbase:meta,,1.1588230740, e2e562ad32c112155905f7ead92570f2=testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2., fdab89856484d1378024257bd8a44d06=testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06., 86a144358000c8ea6648753ad84b60f9=testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9.} 2023-02-12 23:03:23,451 DEBUG [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(1505): Waiting on 0736d5406d404b5c1b17d60c3167aa7c, 1588230740, 18ed925f188a6f68eaf81f5831366882, 6bd6aafce254e495e7782914ac20f86e, 86a144358000c8ea6648753ad84b60f9, e2e562ad32c112155905f7ead92570f2, fdab89856484d1378024257bd8a44d06 2023-02-12 23:03:23,452 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 23:03:23,453 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 23:03:23,453 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 23:03:23,453 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 23:03:23,453 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 23:03:23,453 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-12 23:03:23,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:23,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:23,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 665dc8533514e2f10d7e2bd897400da8: Waiting for close lock at 1676243003446Running coprocessor pre-close hooks at 1676243003447 (+1 ms)Disabling compacts and flushes for region at 1676243003447Disabling writes for close at 1676243003447Writing region close event to WAL at 1676243003457 (+10 ms)Running coprocessor post-close hooks at 1676243003461 (+4 ms)Closed at 1676243003461 2023-02-12 23:03:23,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:23,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 08eb73920285e635825f35a554ddf21c, disabling compactions & flushes 2023-02-12 23:03:23,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:23,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:23,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. after waiting 0 ms 2023-02-12 23:03:23,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:23,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:23,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:23,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0736d5406d404b5c1b17d60c3167aa7c: Waiting for close lock at 1676243003447Running coprocessor pre-close hooks at 1676243003447Disabling compacts and flushes for region at 1676243003447Disabling writes for close at 1676243003448 (+1 ms)Writing region close event to WAL at 1676243003458 (+10 ms)Running coprocessor post-close hooks at 1676243003470 (+12 ms)Closed at 1676243003470 2023-02-12 23:03:23,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:23,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 18ed925f188a6f68eaf81f5831366882, disabling compactions & flushes 2023-02-12 23:03:23,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:23,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:23,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. after waiting 0 ms 2023-02-12 23:03:23,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:23,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:23,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:23,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 08eb73920285e635825f35a554ddf21c: Waiting for close lock at 1676243003461Running coprocessor pre-close hooks at 1676243003461Disabling compacts and flushes for region at 1676243003461Disabling writes for close at 1676243003461Writing region close event to WAL at 1676243003468 (+7 ms)Running coprocessor post-close hooks at 1676243003480 (+12 ms)Closed at 1676243003480 2023-02-12 23:03:23,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:23,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a6a622ff106adf0ab6f2bbb0307a2759, disabling compactions & flushes 2023-02-12 23:03:23,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:23,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:23,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. after waiting 0 ms 2023-02-12 23:03:23,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:23,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:23,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:23,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 18ed925f188a6f68eaf81f5831366882: Waiting for close lock at 1676243003470Running coprocessor pre-close hooks at 1676243003470Disabling compacts and flushes for region at 1676243003470Disabling writes for close at 1676243003470Writing region close event to WAL at 1676243003479 (+9 ms)Running coprocessor post-close hooks at 1676243003483 (+4 ms)Closed at 1676243003483 2023-02-12 23:03:23,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:23,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6bd6aafce254e495e7782914ac20f86e, disabling compactions & flushes 2023-02-12 23:03:23,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e. 2023-02-12 23:03:23,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e. 2023-02-12 23:03:23,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e. after waiting 0 ms 2023-02-12 23:03:23,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e. 2023-02-12 23:03:23,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 6bd6aafce254e495e7782914ac20f86e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 23:03:23,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:23,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:23,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a6a622ff106adf0ab6f2bbb0307a2759: Waiting for close lock at 1676243003480Running coprocessor pre-close hooks at 1676243003480Disabling compacts and flushes for region at 1676243003480Disabling writes for close at 1676243003481 (+1 ms)Writing region close event to WAL at 1676243003482 (+1 ms)Running coprocessor post-close hooks at 1676243003486 (+4 ms)Closed at 1676243003486 2023-02-12 23:03:23,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:23,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 32dc68160ede524989d9a76e9e075d5a, disabling compactions & flushes 2023-02-12 23:03:23,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:23,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:23,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. after waiting 0 ms 2023-02-12 23:03:23,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:23,487 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/.tmp/info/39874059548d4bce94c17b05ac414a01 2023-02-12 23:03:23,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:23,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:23,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 32dc68160ede524989d9a76e9e075d5a: Waiting for close lock at 1676243003486Running coprocessor pre-close hooks at 1676243003486Disabling compacts and flushes for region at 1676243003486Disabling writes for close at 1676243003486Writing region close event to WAL at 1676243003488 (+2 ms)Running coprocessor post-close hooks at 1676243003495 (+7 ms)Closed at 1676243003495 2023-02-12 23:03:23,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:23,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5f19c1217872b6679c0c16957aeaadf0, disabling compactions & flushes 2023-02-12 23:03:23,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:23,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:23,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. after waiting 0 ms 2023-02-12 23:03:23,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:23,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/namespace/6bd6aafce254e495e7782914ac20f86e/.tmp/info/bb4f3ae29e7a42f89f4509aadedf807e 2023-02-12 23:03:23,500 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/.tmp/table/36247878f7b843349107323f13115f7b 2023-02-12 23:03:23,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/namespace/6bd6aafce254e495e7782914ac20f86e/.tmp/info/bb4f3ae29e7a42f89f4509aadedf807e as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/namespace/6bd6aafce254e495e7782914ac20f86e/info/bb4f3ae29e7a42f89f4509aadedf807e 2023-02-12 23:03:23,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:23,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:23,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5f19c1217872b6679c0c16957aeaadf0: Waiting for close lock at 1676243003495Running coprocessor pre-close hooks at 1676243003495Disabling compacts and flushes for region at 1676243003495Disabling writes for close at 1676243003495Writing region close event to WAL at 1676243003501 (+6 ms)Running coprocessor post-close hooks at 1676243003505 (+4 ms)Closed at 1676243003505 2023-02-12 23:03:23,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:23,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/.tmp/info/39874059548d4bce94c17b05ac414a01 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/info/39874059548d4bce94c17b05ac414a01 2023-02-12 23:03:23,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/namespace/6bd6aafce254e495e7782914ac20f86e/info/bb4f3ae29e7a42f89f4509aadedf807e, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 23:03:23,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6bd6aafce254e495e7782914ac20f86e in 25ms, sequenceid=6, compaction requested=false 2023-02-12 23:03:23,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-12 23:03:23,513 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/info/39874059548d4bce94c17b05ac414a01, entries=110, sequenceid=32, filesize=18.7 K 2023-02-12 23:03:23,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/namespace/6bd6aafce254e495e7782914ac20f86e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 23:03:23,514 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/.tmp/table/36247878f7b843349107323f13115f7b as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/table/36247878f7b843349107323f13115f7b 2023-02-12 23:03:23,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e. 2023-02-12 23:03:23,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6bd6aafce254e495e7782914ac20f86e: Waiting for close lock at 1676243003483Running coprocessor pre-close hooks at 1676243003483Disabling compacts and flushes for region at 1676243003483Disabling writes for close at 1676243003484 (+1 ms)Obtaining lock to block concurrent updates at 1676243003484Preparing flush snapshotting stores in 6bd6aafce254e495e7782914ac20f86e at 1676243003484Finished memstore snapshotting hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676243003484Flushing stores of hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e. at 1676243003484Flushing 6bd6aafce254e495e7782914ac20f86e/info: creating writer at 1676243003485 (+1 ms)Flushing 6bd6aafce254e495e7782914ac20f86e/info: appending metadata at 1676243003487 (+2 ms)Flushing 6bd6aafce254e495e7782914ac20f86e/info: closing flushed file at 1676243003487Flushing 6bd6aafce254e495e7782914ac20f86e/info: reopening flushed file at 1676243003502 (+15 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6bd6aafce254e495e7782914ac20f86e in 25ms, sequenceid=6, compaction requested=false at 1676243003509 (+7 ms)Writing region close event to WAL at 1676243003510 (+1 ms)Running coprocessor post-close hooks at 1676243003515 (+5 ms)Closed at 1676243003515 2023-02-12 23:03:23,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676242998632.6bd6aafce254e495e7782914ac20f86e. 2023-02-12 23:03:23,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e2e562ad32c112155905f7ead92570f2, disabling compactions & flushes 2023-02-12 23:03:23,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:23,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:23,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. after waiting 0 ms 2023-02-12 23:03:23,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:23,520 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/table/36247878f7b843349107323f13115f7b, entries=4, sequenceid=32, filesize=4.8 K 2023-02-12 23:03:23,521 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 68ms, sequenceid=32, compaction requested=false 2023-02-12 23:03:23,521 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-12 23:03:23,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:23,536 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-12 23:03:23,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:23,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e2e562ad32c112155905f7ead92570f2: Waiting for close lock at 1676243003516Running coprocessor pre-close hooks at 1676243003516Disabling compacts and flushes for region at 1676243003516Disabling writes for close at 1676243003516Writing region close event to WAL at 1676243003528 (+12 ms)Running coprocessor post-close hooks at 1676243003537 (+9 ms)Closed at 1676243003537 2023-02-12 23:03:23,537 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 23:03:23,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:23,538 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:23,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fdab89856484d1378024257bd8a44d06, disabling compactions & flushes 2023-02-12 23:03:23,538 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676243003452Running coprocessor pre-close hooks at 1676243003452Disabling compacts and flushes for region at 1676243003452Disabling writes for close at 1676243003453 (+1 ms)Obtaining lock to block concurrent updates at 1676243003453Preparing flush snapshotting stores in 1588230740 at 1676243003453Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1676243003454 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676243003458 (+4 ms)Flushing 1588230740/info: creating writer at 1676243003458Flushing 1588230740/info: appending metadata at 1676243003469 (+11 ms)Flushing 1588230740/info: closing flushed file at 1676243003469Flushing 1588230740/table: creating writer at 1676243003491 (+22 ms)Flushing 1588230740/table: appending metadata at 1676243003494 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676243003494Flushing 1588230740/info: reopening flushed file at 1676243003506 (+12 ms)Flushing 1588230740/table: reopening flushed file at 1676243003515 (+9 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 68ms, sequenceid=32, compaction requested=false at 1676243003521 (+6 ms)Writing region close event to WAL at 1676243003529 (+8 ms)Running coprocessor post-close hooks at 1676243003537 (+8 ms)Closed at 1676243003538 (+1 ms) 2023-02-12 23:03:23,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:23,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:23,539 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:23,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. after waiting 0 ms 2023-02-12 23:03:23,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:23,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/fdab89856484d1378024257bd8a44d06/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 23:03:23,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:23,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fdab89856484d1378024257bd8a44d06: Waiting for close lock at 1676243003538Running coprocessor pre-close hooks at 1676243003538Disabling compacts and flushes for region at 1676243003538Disabling writes for close at 1676243003539 (+1 ms)Writing region close event to WAL at 1676243003539Running coprocessor post-close hooks at 1676243003543 (+4 ms)Closed at 1676243003543 2023-02-12 23:03:23,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:23,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 86a144358000c8ea6648753ad84b60f9, disabling compactions & flushes 2023-02-12 23:03:23,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:23,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:23,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. after waiting 0 ms 2023-02-12 23:03:23,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:23,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/data/default/testWithMapReduce/86a144358000c8ea6648753ad84b60f9/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 23:03:23,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:23,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 86a144358000c8ea6648753ad84b60f9: Waiting for close lock at 1676243003544Running coprocessor pre-close hooks at 1676243003544Disabling compacts and flushes for region at 1676243003544Disabling writes for close at 1676243003544Writing region close event to WAL at 1676243003544Running coprocessor post-close hooks at 1676243003547 (+3 ms)Closed at 1676243003547 2023-02-12 23:03:23,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:23,648 INFO [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45545,1676242996771; all regions closed. 2023-02-12 23:03:23,652 INFO [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34617,1676242996811; all regions closed. 2023-02-12 23:03:23,654 DEBUG [RS:0;jenkins-hbase4:45545] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/oldWALs 2023-02-12 23:03:23,654 INFO [RS:0;jenkins-hbase4:45545] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45545%2C1676242996771:(num 1676242999128) 2023-02-12 23:03:23,654 DEBUG [RS:0;jenkins-hbase4:45545] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:23,654 INFO [RS:0;jenkins-hbase4:45545] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:23,655 INFO [RS:0;jenkins-hbase4:45545] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 23:03:23,655 INFO [RS:0;jenkins-hbase4:45545] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 23:03:23,655 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:23,655 INFO [RS:0;jenkins-hbase4:45545] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 23:03:23,655 INFO [RS:0;jenkins-hbase4:45545] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 23:03:23,656 INFO [RS:0;jenkins-hbase4:45545] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45545 2023-02-12 23:03:23,661 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:23,661 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,661 DEBUG [RS:1;jenkins-hbase4:34617] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/oldWALs 2023-02-12 23:03:23,661 ERROR [Listener at localhost/37407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6ad1f300 rejected from java.util.concurrent.ThreadPoolExecutor@6eee7a82[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:23,661 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45545,1676242996771 2023-02-12 23:03:23,661 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:23,661 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:23,661 ERROR [Listener at localhost/37407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7f21e435 rejected from java.util.concurrent.ThreadPoolExecutor@6eee7a82[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:23,661 INFO [RS:1;jenkins-hbase4:34617] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34617%2C1676242996811.meta:.meta(num 1676242998289) 2023-02-12 23:03:23,662 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45545,1676242996771] 2023-02-12 23:03:23,662 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45545,1676242996771; numProcessing=1 2023-02-12 23:03:23,664 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45545,1676242996771 already deleted, retry=false 2023-02-12 23:03:23,664 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45545,1676242996771 expired; onlineServers=1 2023-02-12 23:03:23,667 DEBUG [RS:1;jenkins-hbase4:34617] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/oldWALs 2023-02-12 23:03:23,667 INFO [RS:1;jenkins-hbase4:34617] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34617%2C1676242996811:(num 1676242999128) 2023-02-12 23:03:23,667 DEBUG [RS:1;jenkins-hbase4:34617] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:23,667 INFO [RS:1;jenkins-hbase4:34617] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:23,667 INFO [RS:1;jenkins-hbase4:34617] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 23:03:23,667 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:23,668 INFO [RS:1;jenkins-hbase4:34617] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34617 2023-02-12 23:03:23,671 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:23,671 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34617,1676242996811 2023-02-12 23:03:23,671 ERROR [Listener at localhost/37407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7d7faa91 rejected from java.util.concurrent.ThreadPoolExecutor@794021e6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:23,672 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34617,1676242996811] 2023-02-12 23:03:23,672 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34617,1676242996811; numProcessing=2 2023-02-12 23:03:23,674 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34617,1676242996811 already deleted, retry=false 2023-02-12 23:03:23,674 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34617,1676242996811 expired; onlineServers=0 2023-02-12 23:03:23,674 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39753,1676242996687' ***** 2023-02-12 23:03:23,674 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 23:03:23,675 DEBUG [M:0;jenkins-hbase4:39753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4faf6654, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:23,675 INFO [M:0;jenkins-hbase4:39753] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39753,1676242996687 2023-02-12 23:03:23,675 INFO [M:0;jenkins-hbase4:39753] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39753,1676242996687; all regions closed. 2023-02-12 23:03:23,675 DEBUG [M:0;jenkins-hbase4:39753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:23,675 DEBUG [M:0;jenkins-hbase4:39753] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 23:03:23,675 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 23:03:23,675 DEBUG [M:0;jenkins-hbase4:39753] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 23:03:23,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676242997562] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676242997562,5,FailOnTimeoutGroup] 2023-02-12 23:03:23,675 INFO [M:0;jenkins-hbase4:39753] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 23:03:23,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676242997562] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676242997562,5,FailOnTimeoutGroup] 2023-02-12 23:03:23,676 INFO [M:0;jenkins-hbase4:39753] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 23:03:23,676 INFO [M:0;jenkins-hbase4:39753] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 23:03:23,677 DEBUG [M:0;jenkins-hbase4:39753] master.HMaster(1502): Stopping service threads 2023-02-12 23:03:23,677 INFO [M:0;jenkins-hbase4:39753] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 23:03:23,677 ERROR [M:0;jenkins-hbase4:39753] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 23:03:23,677 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:23,677 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:23,677 INFO [M:0;jenkins-hbase4:39753] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 23:03:23,677 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 23:03:23,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:23,678 DEBUG [M:0;jenkins-hbase4:39753] zookeeper.ZKUtil(398): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 23:03:23,678 WARN [M:0;jenkins-hbase4:39753] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 23:03:23,678 INFO [M:0;jenkins-hbase4:39753] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 23:03:23,678 INFO [M:0;jenkins-hbase4:39753] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 23:03:23,679 DEBUG [M:0;jenkins-hbase4:39753] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 23:03:23,679 INFO [M:0;jenkins-hbase4:39753] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:23,679 DEBUG [M:0;jenkins-hbase4:39753] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:23,679 DEBUG [M:0;jenkins-hbase4:39753] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 23:03:23,679 DEBUG [M:0;jenkins-hbase4:39753] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:23,679 INFO [M:0;jenkins-hbase4:39753] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.94 KB heapSize=120.63 KB 2023-02-12 23:03:23,687 INFO [M:0;jenkins-hbase4:39753] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.94 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1bb75c204bc94340a3567cd8d7538fd2 2023-02-12 23:03:23,693 DEBUG [M:0;jenkins-hbase4:39753] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1bb75c204bc94340a3567cd8d7538fd2 as hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1bb75c204bc94340a3567cd8d7538fd2 2023-02-12 23:03:23,699 INFO [M:0;jenkins-hbase4:39753] regionserver.HStore(1080): Added hdfs://localhost:44231/user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1bb75c204bc94340a3567cd8d7538fd2, entries=31, sequenceid=218, filesize=9.0 K 2023-02-12 23:03:23,700 INFO [M:0;jenkins-hbase4:39753] regionserver.HRegion(2947): Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=218, compaction requested=false 2023-02-12 23:03:23,701 INFO [M:0;jenkins-hbase4:39753] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:23,701 DEBUG [M:0;jenkins-hbase4:39753] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676243003679Disabling compacts and flushes for region at 1676243003679Disabling writes for close at 1676243003679Obtaining lock to block concurrent updates at 1676243003679Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676243003679Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103362, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1676243003679Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676243003680 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676243003680Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676243003682 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676243003682Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676243003694 (+12 ms)Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=218, compaction requested=false at 1676243003700 (+6 ms)Writing region close event to WAL at 1676243003701 (+1 ms)Closed at 1676243003701 2023-02-12 23:03:23,705 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/a2661824-6755-0ac2-0122-f0102114eeee/MasterData/WALs/jenkins-hbase4.apache.org,39753,1676242996687/jenkins-hbase4.apache.org%2C39753%2C1676242996687.1676242996939 not finished, retry = 0 2023-02-12 23:03:23,806 INFO [M:0;jenkins-hbase4:39753] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 23:03:23,807 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:23,807 INFO [M:0;jenkins-hbase4:39753] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39753 2023-02-12 23:03:23,812 DEBUG [M:0;jenkins-hbase4:39753] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39753,1676242996687 already deleted, retry=false 2023-02-12 23:03:23,943 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:23,943 INFO [M:0;jenkins-hbase4:39753] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39753,1676242996687; zookeeper connection closed. 2023-02-12 23:03:23,943 ERROR [Listener at localhost/37407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b07af25 rejected from java.util.concurrent.ThreadPoolExecutor@6f38269d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:23,944 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): master:39753-0x1004ac6376d0000, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:23,944 ERROR [Listener at localhost/37407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4d722a91 rejected from java.util.concurrent.ThreadPoolExecutor@6f38269d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:24,043 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:24,044 INFO [RS:1;jenkins-hbase4:34617] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34617,1676242996811; zookeeper connection closed. 2023-02-12 23:03:24,044 ERROR [Listener at localhost/37407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@d9fb14e rejected from java.util.concurrent.ThreadPoolExecutor@794021e6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:24,044 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:34617-0x1004ac6376d0002, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:24,044 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@692c8ec9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@692c8ec9 2023-02-12 23:03:24,044 ERROR [Listener at localhost/37407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7503f61f rejected from java.util.concurrent.ThreadPoolExecutor@794021e6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:24,144 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:24,144 INFO [RS:0;jenkins-hbase4:45545] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45545,1676242996771; zookeeper connection closed. 2023-02-12 23:03:24,144 ERROR [Listener at localhost/37407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7aa129b rejected from java.util.concurrent.ThreadPoolExecutor@6eee7a82[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:24,144 DEBUG [Listener at localhost/37407-EventThread] zookeeper.ZKWatcher(600): regionserver:45545-0x1004ac6376d0001, quorum=127.0.0.1:53472, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:24,144 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2b7dcdb0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2b7dcdb0 2023-02-12 23:03:24,144 ERROR [Listener at localhost/37407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3bb35375 rejected from java.util.concurrent.ThreadPoolExecutor@6eee7a82[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:24,144 INFO [Listener at localhost/37407] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 23:03:24,232 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/hadoop-1878741135532940093.jar 2023-02-12 23:03:24,237 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676243001285 type: FLUSH version: 2 ttl: 0 2023-02-12 23:03:24,237 DEBUG [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce 2023-02-12 23:03:24,238 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(239): region to add: 0736d5406d404b5c1b17d60c3167aa7c 2023-02-12 23:03:24,238 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(239): region to add: 18ed925f188a6f68eaf81f5831366882 2023-02-12 23:03:24,238 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(239): region to add: 665dc8533514e2f10d7e2bd897400da8 2023-02-12 23:03:24,238 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(239): region to add: 08eb73920285e635825f35a554ddf21c 2023-02-12 23:03:24,238 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(239): region to add: a6a622ff106adf0ab6f2bbb0307a2759 2023-02-12 23:03:24,238 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(239): region to add: e2e562ad32c112155905f7ead92570f2 2023-02-12 23:03:24,238 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(239): region to add: fdab89856484d1378024257bd8a44d06 2023-02-12 23:03:24,238 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(239): region to add: 32dc68160ede524989d9a76e9e075d5a 2023-02-12 23:03:24,238 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(239): region to add: 5f19c1217872b6679c0c16957aeaadf0 2023-02-12 23:03:24,238 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(239): region to add: 86a144358000c8ea6648753ad84b60f9 2023-02-12 23:03:24,239 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(585): clone region=0736d5406d404b5c1b17d60c3167aa7c as 0736d5406d404b5c1b17d60c3167aa7c in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:24,239 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(585): clone region=18ed925f188a6f68eaf81f5831366882 as 18ed925f188a6f68eaf81f5831366882 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:24,239 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(585): clone region=665dc8533514e2f10d7e2bd897400da8 as 665dc8533514e2f10d7e2bd897400da8 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:24,239 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(585): clone region=08eb73920285e635825f35a554ddf21c as 08eb73920285e635825f35a554ddf21c in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:24,239 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(585): clone region=a6a622ff106adf0ab6f2bbb0307a2759 as a6a622ff106adf0ab6f2bbb0307a2759 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:24,239 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(585): clone region=e2e562ad32c112155905f7ead92570f2 as e2e562ad32c112155905f7ead92570f2 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:24,239 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(585): clone region=fdab89856484d1378024257bd8a44d06 as fdab89856484d1378024257bd8a44d06 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:24,239 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(585): clone region=32dc68160ede524989d9a76e9e075d5a as 32dc68160ede524989d9a76e9e075d5a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:24,239 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(585): clone region=5f19c1217872b6679c0c16957aeaadf0 as 5f19c1217872b6679c0c16957aeaadf0 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:24,239 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(585): clone region=86a144358000c8ea6648753ad84b60f9 as 86a144358000c8ea6648753ad84b60f9 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 23:03:24,241 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => a6a622ff106adf0ab6f2bbb0307a2759, NAME => 'testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80 2023-02-12 23:03:24,241 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 665dc8533514e2f10d7e2bd897400da8, NAME => 'testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80 2023-02-12 23:03:24,241 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 08eb73920285e635825f35a554ddf21c, NAME => 'testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80 2023-02-12 23:03:24,241 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 18ed925f188a6f68eaf81f5831366882, NAME => 'testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80 2023-02-12 23:03:24,241 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0736d5406d404b5c1b17d60c3167aa7c, NAME => 'testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80 2023-02-12 23:03:24,242 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => e2e562ad32c112155905f7ead92570f2, NAME => 'testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80 2023-02-12 23:03:24,242 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => fdab89856484d1378024257bd8a44d06, NAME => 'testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80 2023-02-12 23:03:24,243 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 32dc68160ede524989d9a76e9e075d5a, NAME => 'testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80 2023-02-12 23:03:24,261 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,262 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 34375b41bb6745aeacffbdabba62b4f0 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,262 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,262 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c25107b077e14f2a9df53ad19d65cc6d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,271 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b55216d619c543608f0d3c40144b9b1e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,272 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ea5043c2e0f34964a9404e7f57a159c9 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,274 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,275 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,275 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bba853ee31524732802229478bb082bc from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,275 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e25167c8d186459085d7be0a191d6c5b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,275 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing a6a622ff106adf0ab6f2bbb0307a2759, disabling compactions & flushes 2023-02-12 23:03:24,275 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:24,275 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,275 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:24,275 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. after waiting 0 ms 2023-02-12 23:03:24,275 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f7593b32787e4f0d82dec5853b211a5a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,275 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:24,275 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:24,275 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for a6a622ff106adf0ab6f2bbb0307a2759: Waiting for close lock at 1676243004275Disabling compacts and flushes for region at 1676243004275Disabling writes for close at 1676243004275Writing region close event to WAL at 1676243004275Closed at 1676243004275 2023-02-12 23:03:24,276 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 5f19c1217872b6679c0c16957aeaadf0, NAME => 'testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80 2023-02-12 23:03:24,277 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 665dc8533514e2f10d7e2bd897400da8, disabling compactions & flushes 2023-02-12 23:03:24,277 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:24,277 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:24,277 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. after waiting 0 ms 2023-02-12 23:03:24,277 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:24,277 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:24,277 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 665dc8533514e2f10d7e2bd897400da8: Waiting for close lock at 1676243004277Disabling compacts and flushes for region at 1676243004277Disabling writes for close at 1676243004277Writing region close event to WAL at 1676243004277Closed at 1676243004277 2023-02-12 23:03:24,278 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 86a144358000c8ea6648753ad84b60f9, NAME => 'testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80 2023-02-12 23:03:24,278 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,278 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b983f0225c7a4e86b12e71ff1da90309 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,279 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,279 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b27782d1a53f4045bbe6a043b7035e38 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,284 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,284 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing fdab89856484d1378024257bd8a44d06, disabling compactions & flushes 2023-02-12 23:03:24,285 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:24,285 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:24,285 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6a64f5921a0e44ff893bedfc4020c172 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,285 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fdbaa699706a4293b6fdc9138dc9027d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,285 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. after waiting 0 ms 2023-02-12 23:03:24,285 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:24,285 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:24,285 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for fdab89856484d1378024257bd8a44d06: Waiting for close lock at 1676243004284Disabling compacts and flushes for region at 1676243004284Disabling writes for close at 1676243004285 (+1 ms)Writing region close event to WAL at 1676243004285Closed at 1676243004285 2023-02-12 23:03:24,285 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c7a1995726ad44368c15c9d0c95c4b1d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,289 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4cbcac3046ba4638b5e6b719cdd00df9 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,290 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing e2e562ad32c112155905f7ead92570f2, disabling compactions & flushes 2023-02-12 23:03:24,290 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b052237b856347529b11be56a0a13344 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,290 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 32dc68160ede524989d9a76e9e075d5a, disabling compactions & flushes 2023-02-12 23:03:24,290 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:24,290 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:24,290 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:24,290 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:24,291 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 18ed925f188a6f68eaf81f5831366882, disabling compactions & flushes 2023-02-12 23:03:24,291 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. after waiting 0 ms 2023-02-12 23:03:24,291 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. after waiting 0 ms 2023-02-12 23:03:24,291 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:24,291 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:24,291 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:24,291 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:24,291 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:24,291 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 32dc68160ede524989d9a76e9e075d5a: Waiting for close lock at 1676243004290Disabling compacts and flushes for region at 1676243004290Disabling writes for close at 1676243004291 (+1 ms)Writing region close event to WAL at 1676243004291Closed at 1676243004291 2023-02-12 23:03:24,291 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:24,291 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. after waiting 0 ms 2023-02-12 23:03:24,291 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:24,291 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:24,291 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 18ed925f188a6f68eaf81f5831366882: Waiting for close lock at 1676243004291Disabling compacts and flushes for region at 1676243004291Disabling writes for close at 1676243004291Writing region close event to WAL at 1676243004291Closed at 1676243004291 2023-02-12 23:03:24,291 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for e2e562ad32c112155905f7ead92570f2: Waiting for close lock at 1676243004290Disabling compacts and flushes for region at 1676243004290Disabling writes for close at 1676243004291 (+1 ms)Writing region close event to WAL at 1676243004291Closed at 1676243004291 2023-02-12 23:03:24,296 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 08eb73920285e635825f35a554ddf21c, disabling compactions & flushes 2023-02-12 23:03:24,296 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:24,296 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:24,296 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. after waiting 0 ms 2023-02-12 23:03:24,296 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:24,296 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:24,296 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 08eb73920285e635825f35a554ddf21c: Waiting for close lock at 1676243004296Disabling compacts and flushes for region at 1676243004296Disabling writes for close at 1676243004296Writing region close event to WAL at 1676243004296Closed at 1676243004296 2023-02-12 23:03:24,297 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 0736d5406d404b5c1b17d60c3167aa7c, disabling compactions & flushes 2023-02-12 23:03:24,297 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:24,297 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:24,297 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. after waiting 0 ms 2023-02-12 23:03:24,297 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:24,297 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:24,297 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 0736d5406d404b5c1b17d60c3167aa7c: Waiting for close lock at 1676243004297Disabling compacts and flushes for region at 1676243004297Disabling writes for close at 1676243004297Writing region close event to WAL at 1676243004297Closed at 1676243004297 2023-02-12 23:03:24,298 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,298 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 21b85f29cb6444fba3fa0e54b6ea6e73 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,299 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,299 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 86a144358000c8ea6648753ad84b60f9, disabling compactions & flushes 2023-02-12 23:03:24,299 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:24,299 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:24,299 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. after waiting 0 ms 2023-02-12 23:03:24,299 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:24,299 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:24,299 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 86a144358000c8ea6648753ad84b60f9: Waiting for close lock at 1676243004299Disabling compacts and flushes for region at 1676243004299Disabling writes for close at 1676243004299Writing region close event to WAL at 1676243004299Closed at 1676243004299 2023-02-12 23:03:24,300 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b1c83e164dc840aab851a4ac7a29ea5e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 23:03:24,302 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 5f19c1217872b6679c0c16957aeaadf0, disabling compactions & flushes 2023-02-12 23:03:24,302 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:24,302 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:24,302 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. after waiting 0 ms 2023-02-12 23:03:24,302 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:24,303 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:24,303 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 5f19c1217872b6679c0c16957aeaadf0: Waiting for close lock at 1676243004302Disabling compacts and flushes for region at 1676243004302Disabling writes for close at 1676243004302Writing region close event to WAL at 1676243004302Closed at 1676243004302 2023-02-12 23:03:24,303 INFO [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676243001285 type: FLUSH version: 2 ttl: 0 2023-02-12 23:03:24,303 DEBUG [Listener at localhost/37407] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80 2023-02-12 23:03:24,303 DEBUG [Listener at localhost/37407] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80 2023-02-12 23:03:24,304 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-data/ 2023-02-12 23:03:24,304 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |----default/ 2023-02-12 23:03:24,305 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-12 23:03:24,305 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |----------0736d5406d404b5c1b17d60c3167aa7c/ 2023-02-12 23:03:24,306 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:24,306 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:24,306 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=0736d5406d404b5c1b17d60c3167aa7c-e25167c8d186459085d7be0a191d6c5b 2023-02-12 23:03:24,307 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:24,307 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=0736d5406d404b5c1b17d60c3167aa7c-b052237b856347529b11be56a0a13344 2023-02-12 23:03:24,307 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |----------08eb73920285e635825f35a554ddf21c/ 2023-02-12 23:03:24,307 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:24,307 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:24,308 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=08eb73920285e635825f35a554ddf21c-b983f0225c7a4e86b12e71ff1da90309 2023-02-12 23:03:24,308 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:24,308 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=08eb73920285e635825f35a554ddf21c-4cbcac3046ba4638b5e6b719cdd00df9 2023-02-12 23:03:24,308 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |----------18ed925f188a6f68eaf81f5831366882/ 2023-02-12 23:03:24,309 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:24,309 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:24,309 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=18ed925f188a6f68eaf81f5831366882-bba853ee31524732802229478bb082bc 2023-02-12 23:03:24,309 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:24,310 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=18ed925f188a6f68eaf81f5831366882-c7a1995726ad44368c15c9d0c95c4b1d 2023-02-12 23:03:24,310 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |----------32dc68160ede524989d9a76e9e075d5a/ 2023-02-12 23:03:24,310 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:24,311 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:24,311 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=32dc68160ede524989d9a76e9e075d5a-f7593b32787e4f0d82dec5853b211a5a 2023-02-12 23:03:24,311 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:24,311 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=32dc68160ede524989d9a76e9e075d5a-fdbaa699706a4293b6fdc9138dc9027d 2023-02-12 23:03:24,311 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |----------5f19c1217872b6679c0c16957aeaadf0/ 2023-02-12 23:03:24,312 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:24,312 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:24,313 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=5f19c1217872b6679c0c16957aeaadf0-21b85f29cb6444fba3fa0e54b6ea6e73 2023-02-12 23:03:24,313 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:24,313 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=5f19c1217872b6679c0c16957aeaadf0-b1c83e164dc840aab851a4ac7a29ea5e 2023-02-12 23:03:24,313 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |----------665dc8533514e2f10d7e2bd897400da8/ 2023-02-12 23:03:24,314 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:24,314 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:24,314 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=665dc8533514e2f10d7e2bd897400da8-34375b41bb6745aeacffbdabba62b4f0 2023-02-12 23:03:24,314 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:24,315 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=665dc8533514e2f10d7e2bd897400da8-ea5043c2e0f34964a9404e7f57a159c9 2023-02-12 23:03:24,315 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |----------86a144358000c8ea6648753ad84b60f9/ 2023-02-12 23:03:24,315 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:24,315 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |----------a6a622ff106adf0ab6f2bbb0307a2759/ 2023-02-12 23:03:24,316 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:24,316 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:24,316 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=a6a622ff106adf0ab6f2bbb0307a2759-c25107b077e14f2a9df53ad19d65cc6d 2023-02-12 23:03:24,316 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:24,317 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=a6a622ff106adf0ab6f2bbb0307a2759-b55216d619c543608f0d3c40144b9b1e 2023-02-12 23:03:24,317 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |----------e2e562ad32c112155905f7ead92570f2/ 2023-02-12 23:03:24,317 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:24,317 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:24,318 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=e2e562ad32c112155905f7ead92570f2-b27782d1a53f4045bbe6a043b7035e38 2023-02-12 23:03:24,318 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:24,318 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |----------------testWithMapReduce=e2e562ad32c112155905f7ead92570f2-6a64f5921a0e44ff893bedfc4020c172 2023-02-12 23:03:24,318 DEBUG [Listener at localhost/37407] util.CommonFSUtils(699): |----------fdab89856484d1378024257bd8a44d06/ 2023-02-12 23:03:24,318 DEBUG [Listener at localhost/37407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:24,319 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:24,319 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:24,320 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:24,320 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:24,320 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:24,321 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:24,321 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:24,387 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/hadoop-833869922400848886.jar 2023-02-12 23:03:24,387 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:24,388 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:24,388 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:24,388 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:24,389 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:24,389 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:24,389 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-12 23:03:24,390 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-12 23:03:24,390 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-12 23:03:24,390 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-12 23:03:24,391 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-12 23:03:24,391 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-12 23:03:24,391 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-12 23:03:24,392 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-12 23:03:24,392 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-12 23:03:24,393 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-12 23:03:24,393 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:24,393 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 23:03:24,394 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 23:03:24,394 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 23:03:24,394 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 23:03:24,460 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/hadoop-2828676857765182402.jar 2023-02-12 23:03:24,460 DEBUG [Listener at localhost/37407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 23:03:24,466 WARN [Listener at localhost/37407] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-12 23:03:24,496 INFO [Listener at localhost/37407] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 23:03:24,591 WARN [Listener at localhost/37407] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/mapreduce.cluster.local.dir/1676243004560/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-12 23:03:24,591 WARN [Listener at localhost/37407] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/mapreduce.cluster.local.dir/1676243004560/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-12 23:03:24,624 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,625 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:24,627 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:24,629 INFO [StoreOpener-08eb73920285e635825f35a554ddf21c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08eb73920285e635825f35a554ddf21c 2023-02-12 23:03:24,630 DEBUG [StoreOpener-08eb73920285e635825f35a554ddf21c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f1 2023-02-12 23:03:24,631 INFO [StoreOpener-08eb73920285e635825f35a554ddf21c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08eb73920285e635825f35a554ddf21c columnFamilyName f1 2023-02-12 23:03:24,636 DEBUG [StoreOpener-08eb73920285e635825f35a554ddf21c-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f1/testWithMapReduce=08eb73920285e635825f35a554ddf21c-b983f0225c7a4e86b12e71ff1da90309 2023-02-12 23:03:24,636 INFO [StoreOpener-08eb73920285e635825f35a554ddf21c-1] regionserver.HStore(310): Store=08eb73920285e635825f35a554ddf21c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:24,636 INFO [StoreOpener-08eb73920285e635825f35a554ddf21c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08eb73920285e635825f35a554ddf21c 2023-02-12 23:03:24,637 DEBUG [StoreOpener-08eb73920285e635825f35a554ddf21c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f2 2023-02-12 23:03:24,638 INFO [StoreOpener-08eb73920285e635825f35a554ddf21c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08eb73920285e635825f35a554ddf21c columnFamilyName f2 2023-02-12 23:03:24,643 DEBUG [StoreOpener-08eb73920285e635825f35a554ddf21c-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/08eb73920285e635825f35a554ddf21c/f2/testWithMapReduce=08eb73920285e635825f35a554ddf21c-4cbcac3046ba4638b5e6b719cdd00df9 2023-02-12 23:03:24,643 INFO [StoreOpener-08eb73920285e635825f35a554ddf21c-1] regionserver.HStore(310): Store=08eb73920285e635825f35a554ddf21c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:24,643 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:24,643 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 08eb73920285e635825f35a554ddf21c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66561025, jitterRate=-0.008163437247276306}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:24,643 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 08eb73920285e635825f35a554ddf21c: Writing region info on filesystem at 1676243004627Initializing all the Stores at 1676243004628 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243004629 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243004629Region opened successfully at 1676243004643 (+14 ms) 2023-02-12 23:03:24,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 08eb73920285e635825f35a554ddf21c, disabling compactions & flushes 2023-02-12 23:03:24,696 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:24,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:24,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. after waiting 0 ms 2023-02-12 23:03:24,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:24,700 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676243000006.08eb73920285e635825f35a554ddf21c. 2023-02-12 23:03:24,700 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 08eb73920285e635825f35a554ddf21c: Waiting for close lock at 1676243004696Disabling compacts and flushes for region at 1676243004696Disabling writes for close at 1676243004696Writing region close event to WAL at 1676243004700 (+4 ms)Closed at 1676243004700 2023-02-12 23:03:24,703 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 23:03:24,704 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,704 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:24,712 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:24,716 INFO [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0736d5406d404b5c1b17d60c3167aa7c 2023-02-12 23:03:24,717 DEBUG [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f1 2023-02-12 23:03:24,717 INFO [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0736d5406d404b5c1b17d60c3167aa7c columnFamilyName f1 2023-02-12 23:03:24,722 DEBUG [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f1/testWithMapReduce=0736d5406d404b5c1b17d60c3167aa7c-e25167c8d186459085d7be0a191d6c5b 2023-02-12 23:03:24,722 INFO [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] regionserver.HStore(310): Store=0736d5406d404b5c1b17d60c3167aa7c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:24,722 INFO [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0736d5406d404b5c1b17d60c3167aa7c 2023-02-12 23:03:24,724 DEBUG [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f2 2023-02-12 23:03:24,724 INFO [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0736d5406d404b5c1b17d60c3167aa7c columnFamilyName f2 2023-02-12 23:03:24,732 DEBUG [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/0736d5406d404b5c1b17d60c3167aa7c/f2/testWithMapReduce=0736d5406d404b5c1b17d60c3167aa7c-b052237b856347529b11be56a0a13344 2023-02-12 23:03:24,732 INFO [StoreOpener-0736d5406d404b5c1b17d60c3167aa7c-1] regionserver.HStore(310): Store=0736d5406d404b5c1b17d60c3167aa7c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:24,732 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:24,732 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0736d5406d404b5c1b17d60c3167aa7c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72563768, jitterRate=0.08128440380096436}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:24,732 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0736d5406d404b5c1b17d60c3167aa7c: Writing region info on filesystem at 1676243004713Initializing all the Stores at 1676243004714 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243004714Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243004715 (+1 ms)Region opened successfully at 1676243004732 (+17 ms) 2023-02-12 23:03:24,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0736d5406d404b5c1b17d60c3167aa7c, disabling compactions & flushes 2023-02-12 23:03:24,770 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:24,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:24,771 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. after waiting 0 ms 2023-02-12 23:03:24,771 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:24,772 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676243000006.0736d5406d404b5c1b17d60c3167aa7c. 2023-02-12 23:03:24,772 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0736d5406d404b5c1b17d60c3167aa7c: Waiting for close lock at 1676243004770Disabling compacts and flushes for region at 1676243004770Disabling writes for close at 1676243004771 (+1 ms)Writing region close event to WAL at 1676243004772 (+1 ms)Closed at 1676243004772 2023-02-12 23:03:24,776 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,776 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:24,777 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:24,779 INFO [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 86a144358000c8ea6648753ad84b60f9 2023-02-12 23:03:24,780 DEBUG [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/86a144358000c8ea6648753ad84b60f9/f1 2023-02-12 23:03:24,781 INFO [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86a144358000c8ea6648753ad84b60f9 columnFamilyName f1 2023-02-12 23:03:24,781 INFO [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] regionserver.HStore(310): Store=86a144358000c8ea6648753ad84b60f9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:24,781 INFO [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 86a144358000c8ea6648753ad84b60f9 2023-02-12 23:03:24,782 DEBUG [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/86a144358000c8ea6648753ad84b60f9/f2 2023-02-12 23:03:24,783 INFO [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86a144358000c8ea6648753ad84b60f9 columnFamilyName f2 2023-02-12 23:03:24,783 INFO [StoreOpener-86a144358000c8ea6648753ad84b60f9-1] regionserver.HStore(310): Store=86a144358000c8ea6648753ad84b60f9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:24,783 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:24,783 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 86a144358000c8ea6648753ad84b60f9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61158768, jitterRate=-0.08866333961486816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:24,784 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 86a144358000c8ea6648753ad84b60f9: Writing region info on filesystem at 1676243004777Initializing all the Stores at 1676243004778 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243004778Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243004778Region opened successfully at 1676243004784 (+6 ms) 2023-02-12 23:03:24,814 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 86a144358000c8ea6648753ad84b60f9, disabling compactions & flushes 2023-02-12 23:03:24,815 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:24,815 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:24,815 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. after waiting 0 ms 2023-02-12 23:03:24,815 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:24,815 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676243000006.86a144358000c8ea6648753ad84b60f9. 2023-02-12 23:03:24,815 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 86a144358000c8ea6648753ad84b60f9: Waiting for close lock at 1676243004814Disabling compacts and flushes for region at 1676243004814Disabling writes for close at 1676243004815 (+1 ms)Writing region close event to WAL at 1676243004815Closed at 1676243004815 2023-02-12 23:03:24,819 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,819 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:24,820 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:24,822 INFO [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 18ed925f188a6f68eaf81f5831366882 2023-02-12 23:03:24,823 DEBUG [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f1 2023-02-12 23:03:24,823 INFO [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18ed925f188a6f68eaf81f5831366882 columnFamilyName f1 2023-02-12 23:03:24,828 DEBUG [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f1/testWithMapReduce=18ed925f188a6f68eaf81f5831366882-bba853ee31524732802229478bb082bc 2023-02-12 23:03:24,829 INFO [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] regionserver.HStore(310): Store=18ed925f188a6f68eaf81f5831366882/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:24,829 INFO [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 18ed925f188a6f68eaf81f5831366882 2023-02-12 23:03:24,829 DEBUG [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f2 2023-02-12 23:03:24,830 INFO [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18ed925f188a6f68eaf81f5831366882 columnFamilyName f2 2023-02-12 23:03:24,835 DEBUG [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/18ed925f188a6f68eaf81f5831366882/f2/testWithMapReduce=18ed925f188a6f68eaf81f5831366882-c7a1995726ad44368c15c9d0c95c4b1d 2023-02-12 23:03:24,835 INFO [StoreOpener-18ed925f188a6f68eaf81f5831366882-1] regionserver.HStore(310): Store=18ed925f188a6f68eaf81f5831366882/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:24,835 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:24,835 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 18ed925f188a6f68eaf81f5831366882; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63478359, jitterRate=-0.054098740220069885}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:24,835 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 18ed925f188a6f68eaf81f5831366882: Writing region info on filesystem at 1676243004821Initializing all the Stores at 1676243004821Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243004821Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243004822 (+1 ms)Region opened successfully at 1676243004835 (+13 ms) 2023-02-12 23:03:24,869 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 18ed925f188a6f68eaf81f5831366882, disabling compactions & flushes 2023-02-12 23:03:24,869 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:24,869 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:24,869 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. after waiting 0 ms 2023-02-12 23:03:24,869 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:24,870 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676243000006.18ed925f188a6f68eaf81f5831366882. 2023-02-12 23:03:24,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 18ed925f188a6f68eaf81f5831366882: Waiting for close lock at 1676243004869Disabling compacts and flushes for region at 1676243004869Disabling writes for close at 1676243004869Writing region close event to WAL at 1676243004870 (+1 ms)Closed at 1676243004870 2023-02-12 23:03:24,874 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,874 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:24,877 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:24,878 INFO [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 665dc8533514e2f10d7e2bd897400da8 2023-02-12 23:03:24,879 DEBUG [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f1 2023-02-12 23:03:24,880 INFO [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 665dc8533514e2f10d7e2bd897400da8 columnFamilyName f1 2023-02-12 23:03:24,886 DEBUG [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f1/testWithMapReduce=665dc8533514e2f10d7e2bd897400da8-34375b41bb6745aeacffbdabba62b4f0 2023-02-12 23:03:24,887 INFO [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] regionserver.HStore(310): Store=665dc8533514e2f10d7e2bd897400da8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:24,887 INFO [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 665dc8533514e2f10d7e2bd897400da8 2023-02-12 23:03:24,888 DEBUG [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f2 2023-02-12 23:03:24,888 INFO [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 665dc8533514e2f10d7e2bd897400da8 columnFamilyName f2 2023-02-12 23:03:24,892 DEBUG [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/665dc8533514e2f10d7e2bd897400da8/f2/testWithMapReduce=665dc8533514e2f10d7e2bd897400da8-ea5043c2e0f34964a9404e7f57a159c9 2023-02-12 23:03:24,892 INFO [StoreOpener-665dc8533514e2f10d7e2bd897400da8-1] regionserver.HStore(310): Store=665dc8533514e2f10d7e2bd897400da8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:24,892 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:24,892 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 665dc8533514e2f10d7e2bd897400da8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64955363, jitterRate=-0.03208966553211212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:24,892 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 665dc8533514e2f10d7e2bd897400da8: Writing region info on filesystem at 1676243004877Initializing all the Stores at 1676243004878 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243004878Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243004878Region opened successfully at 1676243004892 (+14 ms) 2023-02-12 23:03:24,919 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 665dc8533514e2f10d7e2bd897400da8, disabling compactions & flushes 2023-02-12 23:03:24,919 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:24,920 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:24,920 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. after waiting 0 ms 2023-02-12 23:03:24,920 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:24,921 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676243000006.665dc8533514e2f10d7e2bd897400da8. 2023-02-12 23:03:24,921 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 665dc8533514e2f10d7e2bd897400da8: Waiting for close lock at 1676243004919Disabling compacts and flushes for region at 1676243004919Disabling writes for close at 1676243004920 (+1 ms)Writing region close event to WAL at 1676243004921 (+1 ms)Closed at 1676243004921 2023-02-12 23:03:24,924 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,924 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:24,926 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:24,927 INFO [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5f19c1217872b6679c0c16957aeaadf0 2023-02-12 23:03:24,928 DEBUG [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f1 2023-02-12 23:03:24,929 INFO [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f19c1217872b6679c0c16957aeaadf0 columnFamilyName f1 2023-02-12 23:03:24,933 DEBUG [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f1/testWithMapReduce=5f19c1217872b6679c0c16957aeaadf0-21b85f29cb6444fba3fa0e54b6ea6e73 2023-02-12 23:03:24,933 INFO [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] regionserver.HStore(310): Store=5f19c1217872b6679c0c16957aeaadf0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:24,933 INFO [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5f19c1217872b6679c0c16957aeaadf0 2023-02-12 23:03:24,934 DEBUG [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f2 2023-02-12 23:03:24,935 INFO [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f19c1217872b6679c0c16957aeaadf0 columnFamilyName f2 2023-02-12 23:03:24,939 DEBUG [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/5f19c1217872b6679c0c16957aeaadf0/f2/testWithMapReduce=5f19c1217872b6679c0c16957aeaadf0-b1c83e164dc840aab851a4ac7a29ea5e 2023-02-12 23:03:24,939 INFO [StoreOpener-5f19c1217872b6679c0c16957aeaadf0-1] regionserver.HStore(310): Store=5f19c1217872b6679c0c16957aeaadf0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:24,939 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:24,939 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5f19c1217872b6679c0c16957aeaadf0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59298702, jitterRate=-0.1163804829120636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:24,939 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5f19c1217872b6679c0c16957aeaadf0: Writing region info on filesystem at 1676243004926Initializing all the Stores at 1676243004927 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243004927Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243004927Region opened successfully at 1676243004939 (+12 ms) 2023-02-12 23:03:24,969 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5f19c1217872b6679c0c16957aeaadf0, disabling compactions & flushes 2023-02-12 23:03:24,969 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:24,969 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:24,969 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. after waiting 0 ms 2023-02-12 23:03:24,970 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:24,970 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676243000006.5f19c1217872b6679c0c16957aeaadf0. 2023-02-12 23:03:24,970 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5f19c1217872b6679c0c16957aeaadf0: Waiting for close lock at 1676243004969Disabling compacts and flushes for region at 1676243004969Disabling writes for close at 1676243004970 (+1 ms)Writing region close event to WAL at 1676243004970Closed at 1676243004970 2023-02-12 23:03:24,973 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:24,973 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:24,974 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:24,976 INFO [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e2e562ad32c112155905f7ead92570f2 2023-02-12 23:03:24,977 DEBUG [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f1 2023-02-12 23:03:24,978 INFO [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2e562ad32c112155905f7ead92570f2 columnFamilyName f1 2023-02-12 23:03:24,984 DEBUG [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f1/testWithMapReduce=e2e562ad32c112155905f7ead92570f2-b27782d1a53f4045bbe6a043b7035e38 2023-02-12 23:03:24,984 INFO [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] regionserver.HStore(310): Store=e2e562ad32c112155905f7ead92570f2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:24,984 INFO [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e2e562ad32c112155905f7ead92570f2 2023-02-12 23:03:24,985 DEBUG [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f2 2023-02-12 23:03:24,985 INFO [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2e562ad32c112155905f7ead92570f2 columnFamilyName f2 2023-02-12 23:03:24,990 DEBUG [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/e2e562ad32c112155905f7ead92570f2/f2/testWithMapReduce=e2e562ad32c112155905f7ead92570f2-6a64f5921a0e44ff893bedfc4020c172 2023-02-12 23:03:24,990 INFO [StoreOpener-e2e562ad32c112155905f7ead92570f2-1] regionserver.HStore(310): Store=e2e562ad32c112155905f7ead92570f2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:24,990 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:24,990 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e2e562ad32c112155905f7ead92570f2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74684853, jitterRate=0.11289103329181671}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:24,991 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e2e562ad32c112155905f7ead92570f2: Writing region info on filesystem at 1676243004974Initializing all the Stores at 1676243004975 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243004975Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243004976 (+1 ms)Region opened successfully at 1676243004991 (+15 ms) 2023-02-12 23:03:25,028 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e2e562ad32c112155905f7ead92570f2, disabling compactions & flushes 2023-02-12 23:03:25,029 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:25,029 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:25,029 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. after waiting 0 ms 2023-02-12 23:03:25,029 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:25,029 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676243000006.e2e562ad32c112155905f7ead92570f2. 2023-02-12 23:03:25,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e2e562ad32c112155905f7ead92570f2: Waiting for close lock at 1676243005028Disabling compacts and flushes for region at 1676243005028Disabling writes for close at 1676243005029 (+1 ms)Writing region close event to WAL at 1676243005029Closed at 1676243005029 2023-02-12 23:03:25,032 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:25,032 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:25,033 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:25,035 INFO [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a6a622ff106adf0ab6f2bbb0307a2759 2023-02-12 23:03:25,036 DEBUG [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f1 2023-02-12 23:03:25,036 INFO [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6a622ff106adf0ab6f2bbb0307a2759 columnFamilyName f1 2023-02-12 23:03:25,041 DEBUG [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f1/testWithMapReduce=a6a622ff106adf0ab6f2bbb0307a2759-c25107b077e14f2a9df53ad19d65cc6d 2023-02-12 23:03:25,041 INFO [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] regionserver.HStore(310): Store=a6a622ff106adf0ab6f2bbb0307a2759/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:25,041 INFO [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a6a622ff106adf0ab6f2bbb0307a2759 2023-02-12 23:03:25,042 DEBUG [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f2 2023-02-12 23:03:25,043 INFO [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6a622ff106adf0ab6f2bbb0307a2759 columnFamilyName f2 2023-02-12 23:03:25,047 DEBUG [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/a6a622ff106adf0ab6f2bbb0307a2759/f2/testWithMapReduce=a6a622ff106adf0ab6f2bbb0307a2759-b55216d619c543608f0d3c40144b9b1e 2023-02-12 23:03:25,047 INFO [StoreOpener-a6a622ff106adf0ab6f2bbb0307a2759-1] regionserver.HStore(310): Store=a6a622ff106adf0ab6f2bbb0307a2759/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:25,047 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:25,047 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a6a622ff106adf0ab6f2bbb0307a2759; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63848395, jitterRate=-0.048584774136543274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:25,048 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a6a622ff106adf0ab6f2bbb0307a2759: Writing region info on filesystem at 1676243005033Initializing all the Stores at 1676243005034 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243005034Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243005034Region opened successfully at 1676243005048 (+14 ms) 2023-02-12 23:03:25,077 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a6a622ff106adf0ab6f2bbb0307a2759, disabling compactions & flushes 2023-02-12 23:03:25,077 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:25,077 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:25,077 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. after waiting 0 ms 2023-02-12 23:03:25,077 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:25,078 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676243000006.a6a622ff106adf0ab6f2bbb0307a2759. 2023-02-12 23:03:25,078 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a6a622ff106adf0ab6f2bbb0307a2759: Waiting for close lock at 1676243005077Disabling compacts and flushes for region at 1676243005077Disabling writes for close at 1676243005077Writing region close event to WAL at 1676243005078 (+1 ms)Closed at 1676243005078 2023-02-12 23:03:25,081 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:25,081 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:25,082 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:25,084 INFO [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 32dc68160ede524989d9a76e9e075d5a 2023-02-12 23:03:25,084 DEBUG [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f1 2023-02-12 23:03:25,085 INFO [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32dc68160ede524989d9a76e9e075d5a columnFamilyName f1 2023-02-12 23:03:25,089 DEBUG [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f1/testWithMapReduce=32dc68160ede524989d9a76e9e075d5a-f7593b32787e4f0d82dec5853b211a5a 2023-02-12 23:03:25,089 INFO [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] regionserver.HStore(310): Store=32dc68160ede524989d9a76e9e075d5a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:25,089 INFO [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 32dc68160ede524989d9a76e9e075d5a 2023-02-12 23:03:25,090 DEBUG [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f2 2023-02-12 23:03:25,091 INFO [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32dc68160ede524989d9a76e9e075d5a columnFamilyName f2 2023-02-12 23:03:25,095 DEBUG [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] regionserver.HStore(539): loaded hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/32dc68160ede524989d9a76e9e075d5a/f2/testWithMapReduce=32dc68160ede524989d9a76e9e075d5a-fdbaa699706a4293b6fdc9138dc9027d 2023-02-12 23:03:25,095 INFO [StoreOpener-32dc68160ede524989d9a76e9e075d5a-1] regionserver.HStore(310): Store=32dc68160ede524989d9a76e9e075d5a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:25,095 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:25,095 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 32dc68160ede524989d9a76e9e075d5a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61577338, jitterRate=-0.08242616057395935}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:25,095 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 32dc68160ede524989d9a76e9e075d5a: Writing region info on filesystem at 1676243005082Initializing all the Stores at 1676243005083 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243005083Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243005083Region opened successfully at 1676243005095 (+12 ms) 2023-02-12 23:03:25,122 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 32dc68160ede524989d9a76e9e075d5a, disabling compactions & flushes 2023-02-12 23:03:25,122 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:25,122 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:25,122 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. after waiting 0 ms 2023-02-12 23:03:25,122 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:25,125 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676243000006.32dc68160ede524989d9a76e9e075d5a. 2023-02-12 23:03:25,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 32dc68160ede524989d9a76e9e075d5a: Waiting for close lock at 1676243005122Disabling compacts and flushes for region at 1676243005122Disabling writes for close at 1676243005122Writing region close event to WAL at 1676243005125 (+3 ms)Closed at 1676243005125 2023-02-12 23:03:25,128 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:25,128 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:25,132 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:25,135 INFO [StoreOpener-fdab89856484d1378024257bd8a44d06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fdab89856484d1378024257bd8a44d06 2023-02-12 23:03:25,136 DEBUG [StoreOpener-fdab89856484d1378024257bd8a44d06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/fdab89856484d1378024257bd8a44d06/f1 2023-02-12 23:03:25,137 INFO [StoreOpener-fdab89856484d1378024257bd8a44d06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdab89856484d1378024257bd8a44d06 columnFamilyName f1 2023-02-12 23:03:25,137 INFO [StoreOpener-fdab89856484d1378024257bd8a44d06-1] regionserver.HStore(310): Store=fdab89856484d1378024257bd8a44d06/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:25,137 INFO [StoreOpener-fdab89856484d1378024257bd8a44d06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fdab89856484d1378024257bd8a44d06 2023-02-12 23:03:25,139 DEBUG [StoreOpener-fdab89856484d1378024257bd8a44d06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44231/user/jenkins/test-data/5ebdbcd4-51c5-aec6-abc8-6585d464a32b/testWithMapReduceAndOfflineHBaseMultiRegion/977eecce-05d0-48a6-9093-35c98b20bc80/data/default/testWithMapReduce/fdab89856484d1378024257bd8a44d06/f2 2023-02-12 23:03:25,139 INFO [StoreOpener-fdab89856484d1378024257bd8a44d06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdab89856484d1378024257bd8a44d06 columnFamilyName f2 2023-02-12 23:03:25,140 INFO [StoreOpener-fdab89856484d1378024257bd8a44d06-1] regionserver.HStore(310): Store=fdab89856484d1378024257bd8a44d06/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:25,140 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:25,140 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fdab89856484d1378024257bd8a44d06; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68102358, jitterRate=0.014804214239120483}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:25,141 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fdab89856484d1378024257bd8a44d06: Writing region info on filesystem at 1676243005132Initializing all the Stores at 1676243005133 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243005133Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243005133Region opened successfully at 1676243005141 (+8 ms) 2023-02-12 23:03:25,161 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fdab89856484d1378024257bd8a44d06, disabling compactions & flushes 2023-02-12 23:03:25,161 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:25,161 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:25,161 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. after waiting 0 ms 2023-02-12 23:03:25,161 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:25,161 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676243000006.fdab89856484d1378024257bd8a44d06. 2023-02-12 23:03:25,161 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fdab89856484d1378024257bd8a44d06: Waiting for close lock at 1676243005161Disabling compacts and flushes for region at 1676243005161Disabling writes for close at 1676243005161Writing region close event to WAL at 1676243005161Closed at 1676243005161 2023-02-12 23:03:25,625 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 23:03:25,626 WARN [Listener at localhost/37407] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 23:03:25,628 INFO [Listener at localhost/37407] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:25,649 WARN [BP-211918451-172.31.14.131-1676242995817 heartbeating to localhost/127.0.0.1:44231] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-211918451-172.31.14.131-1676242995817 (Datanode Uuid 2f1191a0-3d7f-48eb-b0fc-1de759b2ee55) service to localhost/127.0.0.1:44231 2023-02-12 23:03:25,650 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/cluster_04a8d1d7-5be1-0c44-dc1b-904ae1c1ca0d/dfs/data/data3/current/BP-211918451-172.31.14.131-1676242995817] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:25,650 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/cluster_04a8d1d7-5be1-0c44-dc1b-904ae1c1ca0d/dfs/data/data4/current/BP-211918451-172.31.14.131-1676242995817] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:25,732 WARN [Listener at localhost/37407] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 23:03:25,737 INFO [Listener at localhost/37407] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:25,840 WARN [BP-211918451-172.31.14.131-1676242995817 heartbeating to localhost/127.0.0.1:44231] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 23:03:25,840 WARN [BP-211918451-172.31.14.131-1676242995817 heartbeating to localhost/127.0.0.1:44231] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-211918451-172.31.14.131-1676242995817 (Datanode Uuid 2f46b9af-4748-4a2e-bebf-444cba938ef5) service to localhost/127.0.0.1:44231 2023-02-12 23:03:25,841 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/cluster_04a8d1d7-5be1-0c44-dc1b-904ae1c1ca0d/dfs/data/data1/current/BP-211918451-172.31.14.131-1676242995817] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:25,841 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/cluster_04a8d1d7-5be1-0c44-dc1b-904ae1c1ca0d/dfs/data/data2/current/BP-211918451-172.31.14.131-1676242995817] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:25,852 INFO [Listener at localhost/37407] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:25,972 INFO [Listener at localhost/37407] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 23:03:26,015 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 23:03:26,027 INFO [Listener at localhost/37407] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=154 (was 103) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44231 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39753,1676242996687)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37407 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:44231 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:44231 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:44231 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:44231 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:44231 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:44231 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=531 (was 538), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=209 (was 211), ProcessCount=166 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=4063 (was 4254) 2023-02-12 23:03:26,037 INFO [Listener at localhost/37407] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=154, OpenFileDescriptor=531, MaxFileDescriptor=60000, SystemLoadAverage=209, ProcessCount=166, AvailableMemoryMB=4063 2023-02-12 23:03:26,047 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/hadoop.log.dir so I do NOT create it in target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f 2023-02-12 23:03:26,047 WARN [Listener at localhost/37407] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 23:03:26,047 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/hadoop.tmp.dir so I do NOT create it in target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f 2023-02-12 23:03:26,047 WARN [Listener at localhost/37407] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbd4c7e6-5d8f-55e7-bde0-5d7342524b90/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 23:03:26,047 DEBUG [Listener at localhost/37407] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f 2023-02-12 23:03:26,047 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 23:03:26,047 INFO [Listener at localhost/37407] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/cluster_ac983163-7479-cf58-97b6-78b83e21f214, deleteOnExit=true 2023-02-12 23:03:26,047 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 23:03:26,048 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/test.cache.data in system properties and HBase conf 2023-02-12 23:03:26,048 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 23:03:26,048 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/hadoop.log.dir in system properties and HBase conf 2023-02-12 23:03:26,048 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 23:03:26,048 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 23:03:26,048 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 23:03:26,048 DEBUG [Listener at localhost/37407] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 23:03:26,048 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 23:03:26,048 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 23:03:26,049 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 23:03:26,049 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 23:03:26,049 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 23:03:26,049 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 23:03:26,049 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 23:03:26,049 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 23:03:26,049 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 23:03:26,049 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/nfs.dump.dir in system properties and HBase conf 2023-02-12 23:03:26,049 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/java.io.tmpdir in system properties and HBase conf 2023-02-12 23:03:26,049 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 23:03:26,049 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 23:03:26,049 INFO [Listener at localhost/37407] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 23:03:26,053 WARN [Listener at localhost/37407] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 23:03:26,054 WARN [Listener at localhost/37407] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 23:03:26,094 WARN [Listener at localhost/37407] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:26,097 INFO [Listener at localhost/37407] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:26,104 INFO [Listener at localhost/37407] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/java.io.tmpdir/Jetty_localhost_45929_hdfs____9ga0g9/webapp 2023-02-12 23:03:26,201 INFO [Listener at localhost/37407] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45929 2023-02-12 23:03:26,231 WARN [Listener at localhost/37407] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 23:03:26,231 WARN [Listener at localhost/37407] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 23:03:26,271 WARN [Listener at localhost/39205] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:26,283 WARN [Listener at localhost/39205] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 23:03:26,288 WARN [Listener at localhost/39205] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:26,289 INFO [Listener at localhost/39205] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:26,293 INFO [Listener at localhost/39205] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/java.io.tmpdir/Jetty_localhost_36879_datanode____.xo8qf6/webapp 2023-02-12 23:03:26,385 INFO [Listener at localhost/39205] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36879 2023-02-12 23:03:26,393 WARN [Listener at localhost/33945] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:26,406 WARN [Listener at localhost/33945] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 23:03:26,408 WARN [Listener at localhost/33945] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:26,409 INFO [Listener at localhost/33945] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:26,414 INFO [Listener at localhost/33945] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/java.io.tmpdir/Jetty_localhost_37263_datanode____.c67swe/webapp 2023-02-12 23:03:26,491 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc062f1c2d93bdcac: Processing first storage report for DS-2ae44c6d-67b5-4c87-b9c8-95ee2c60477a from datanode 068b1369-6a2b-4a54-9cb0-2ce7c914de59 2023-02-12 23:03:26,491 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc062f1c2d93bdcac: from storage DS-2ae44c6d-67b5-4c87-b9c8-95ee2c60477a node DatanodeRegistration(127.0.0.1:37545, datanodeUuid=068b1369-6a2b-4a54-9cb0-2ce7c914de59, infoPort=43535, infoSecurePort=0, ipcPort=33945, storageInfo=lv=-57;cid=testClusterID;nsid=1294572719;c=1676243006056), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:26,491 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc062f1c2d93bdcac: Processing first storage report for DS-f557c83b-dfdf-4812-88ae-813fa059ab65 from datanode 068b1369-6a2b-4a54-9cb0-2ce7c914de59 2023-02-12 23:03:26,491 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc062f1c2d93bdcac: from storage DS-f557c83b-dfdf-4812-88ae-813fa059ab65 node DatanodeRegistration(127.0.0.1:37545, datanodeUuid=068b1369-6a2b-4a54-9cb0-2ce7c914de59, infoPort=43535, infoSecurePort=0, ipcPort=33945, storageInfo=lv=-57;cid=testClusterID;nsid=1294572719;c=1676243006056), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:26,509 INFO [Listener at localhost/33945] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37263 2023-02-12 23:03:26,516 WARN [Listener at localhost/33645] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:26,603 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcb2c1dc21cf1f04b: Processing first storage report for DS-d16808c3-041c-4bf3-9fd2-b55c07aa5ee3 from datanode 7d8cf19e-10dd-485f-8d02-23cef060cb72 2023-02-12 23:03:26,603 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcb2c1dc21cf1f04b: from storage DS-d16808c3-041c-4bf3-9fd2-b55c07aa5ee3 node DatanodeRegistration(127.0.0.1:36015, datanodeUuid=7d8cf19e-10dd-485f-8d02-23cef060cb72, infoPort=39185, infoSecurePort=0, ipcPort=33645, storageInfo=lv=-57;cid=testClusterID;nsid=1294572719;c=1676243006056), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:26,604 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcb2c1dc21cf1f04b: Processing first storage report for DS-4118cd34-dac0-43a3-a309-69393289feda from datanode 7d8cf19e-10dd-485f-8d02-23cef060cb72 2023-02-12 23:03:26,604 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcb2c1dc21cf1f04b: from storage DS-4118cd34-dac0-43a3-a309-69393289feda node DatanodeRegistration(127.0.0.1:36015, datanodeUuid=7d8cf19e-10dd-485f-8d02-23cef060cb72, infoPort=39185, infoSecurePort=0, ipcPort=33645, storageInfo=lv=-57;cid=testClusterID;nsid=1294572719;c=1676243006056), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:26,623 DEBUG [Listener at localhost/33645] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f 2023-02-12 23:03:26,626 INFO [Listener at localhost/33645] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/cluster_ac983163-7479-cf58-97b6-78b83e21f214/zookeeper_0, clientPort=62430, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/cluster_ac983163-7479-cf58-97b6-78b83e21f214/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/cluster_ac983163-7479-cf58-97b6-78b83e21f214/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 23:03:26,628 INFO [Listener at localhost/33645] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62430 2023-02-12 23:03:26,628 INFO [Listener at localhost/33645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:26,629 INFO [Listener at localhost/33645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:26,641 INFO [Listener at localhost/33645] util.FSUtils(479): Created version file at hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae with version=8 2023-02-12 23:03:26,641 INFO [Listener at localhost/33645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:26,642 INFO [Listener at localhost/33645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:26,644 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39205/user/jenkins/test-data/0a8a050b-3e89-ca5c-6341-ec63c4cc7515/hbase-staging 2023-02-12 23:03:26,645 INFO [Listener at localhost/33645] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:26,646 INFO [Listener at localhost/33645] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:26,646 INFO [Listener at localhost/33645] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:26,646 INFO [Listener at localhost/33645] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:26,646 INFO [Listener at localhost/33645] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:26,646 INFO [Listener at localhost/33645] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:26,646 INFO [Listener at localhost/33645] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:26,647 INFO [Listener at localhost/33645] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33707 2023-02-12 23:03:26,648 INFO [Listener at localhost/33645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:26,649 INFO [Listener at localhost/33645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:26,649 INFO [Listener at localhost/33645] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33707 connecting to ZooKeeper ensemble=127.0.0.1:62430 2023-02-12 23:03:26,658 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:337070x0, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:26,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33707-0x1004ac65e660000 connected 2023-02-12 23:03:26,674 DEBUG [Listener at localhost/33645] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:26,674 DEBUG [Listener at localhost/33645] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:26,675 DEBUG [Listener at localhost/33645] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:26,676 DEBUG [Listener at localhost/33645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33707 2023-02-12 23:03:26,677 DEBUG [Listener at localhost/33645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33707 2023-02-12 23:03:26,677 DEBUG [Listener at localhost/33645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33707 2023-02-12 23:03:26,679 DEBUG [Listener at localhost/33645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33707 2023-02-12 23:03:26,680 DEBUG [Listener at localhost/33645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33707 2023-02-12 23:03:26,680 INFO [Listener at localhost/33645] master.HMaster(439): hbase.rootdir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae, hbase.cluster.distributed=false 2023-02-12 23:03:26,692 INFO [Listener at localhost/33645] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:26,692 INFO [Listener at localhost/33645] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:26,692 INFO [Listener at localhost/33645] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:26,692 INFO [Listener at localhost/33645] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:26,692 INFO [Listener at localhost/33645] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:26,692 INFO [Listener at localhost/33645] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:26,692 INFO [Listener at localhost/33645] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:26,695 INFO [Listener at localhost/33645] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34839 2023-02-12 23:03:26,695 INFO [Listener at localhost/33645] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 23:03:26,696 DEBUG [Listener at localhost/33645] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:26,697 INFO [Listener at localhost/33645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:26,698 INFO [Listener at localhost/33645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:26,699 INFO [Listener at localhost/33645] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34839 connecting to ZooKeeper ensemble=127.0.0.1:62430 2023-02-12 23:03:26,704 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:348390x0, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:26,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34839-0x1004ac65e660001 connected 2023-02-12 23:03:26,706 DEBUG [Listener at localhost/33645] zookeeper.ZKUtil(164): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:26,706 DEBUG [Listener at localhost/33645] zookeeper.ZKUtil(164): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:26,707 DEBUG [Listener at localhost/33645] zookeeper.ZKUtil(164): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:26,709 DEBUG [Listener at localhost/33645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34839 2023-02-12 23:03:26,712 DEBUG [Listener at localhost/33645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34839 2023-02-12 23:03:26,712 DEBUG [Listener at localhost/33645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34839 2023-02-12 23:03:26,713 DEBUG [Listener at localhost/33645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34839 2023-02-12 23:03:26,714 DEBUG [Listener at localhost/33645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34839 2023-02-12 23:03:26,724 INFO [Listener at localhost/33645] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:26,724 INFO [Listener at localhost/33645] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:26,724 INFO [Listener at localhost/33645] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:26,724 INFO [Listener at localhost/33645] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:26,725 INFO [Listener at localhost/33645] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:26,725 INFO [Listener at localhost/33645] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:26,725 INFO [Listener at localhost/33645] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:26,730 INFO [Listener at localhost/33645] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41677 2023-02-12 23:03:26,730 INFO [Listener at localhost/33645] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 23:03:26,731 DEBUG [Listener at localhost/33645] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:26,732 INFO [Listener at localhost/33645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:26,732 INFO [Listener at localhost/33645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:26,733 INFO [Listener at localhost/33645] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41677 connecting to ZooKeeper ensemble=127.0.0.1:62430 2023-02-12 23:03:26,736 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:416770x0, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:26,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41677-0x1004ac65e660002 connected 2023-02-12 23:03:26,739 DEBUG [Listener at localhost/33645] zookeeper.ZKUtil(164): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:26,739 DEBUG [Listener at localhost/33645] zookeeper.ZKUtil(164): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:26,740 DEBUG [Listener at localhost/33645] zookeeper.ZKUtil(164): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:26,744 DEBUG [Listener at localhost/33645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41677 2023-02-12 23:03:26,744 DEBUG [Listener at localhost/33645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41677 2023-02-12 23:03:26,748 DEBUG [Listener at localhost/33645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41677 2023-02-12 23:03:26,748 DEBUG [Listener at localhost/33645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41677 2023-02-12 23:03:26,748 DEBUG [Listener at localhost/33645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41677 2023-02-12 23:03:26,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33707,1676243006645 2023-02-12 23:03:26,751 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 23:03:26,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33707,1676243006645 2023-02-12 23:03:26,753 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:26,753 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:26,753 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:26,754 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:26,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 23:03:26,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33707,1676243006645 from backup master directory 2023-02-12 23:03:26,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 23:03:26,757 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33707,1676243006645 2023-02-12 23:03:26,757 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 23:03:26,757 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:26,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,33707,1676243006645 2023-02-12 23:03:26,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/hbase.id with ID: e43c190c-d89a-44a5-8a9c-f93d7e9e4ae7 2023-02-12 23:03:26,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:26,781 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:26,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x20f2fb33 to 127.0.0.1:62430 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:26,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@409ecb5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:26,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:26,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 23:03:26,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:26,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/MasterData/data/master/store-tmp 2023-02-12 23:03:26,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:26,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 23:03:26,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:26,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:26,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 23:03:26,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:26,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:26,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676243006813Disabling compacts and flushes for region at 1676243006813Disabling writes for close at 1676243006813Writing region close event to WAL at 1676243006813Closed at 1676243006813 2023-02-12 23:03:26,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/MasterData/WALs/jenkins-hbase4.apache.org,33707,1676243006645 2023-02-12 23:03:26,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33707%2C1676243006645, suffix=, logDir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/MasterData/WALs/jenkins-hbase4.apache.org,33707,1676243006645, archiveDir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/MasterData/oldWALs, maxLogs=10 2023-02-12 23:03:26,836 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36015,DS-d16808c3-041c-4bf3-9fd2-b55c07aa5ee3,DISK] 2023-02-12 23:03:26,837 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37545,DS-2ae44c6d-67b5-4c87-b9c8-95ee2c60477a,DISK] 2023-02-12 23:03:26,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/MasterData/WALs/jenkins-hbase4.apache.org,33707,1676243006645/jenkins-hbase4.apache.org%2C33707%2C1676243006645.1676243006816 2023-02-12 23:03:26,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36015,DS-d16808c3-041c-4bf3-9fd2-b55c07aa5ee3,DISK], DatanodeInfoWithStorage[127.0.0.1:37545,DS-2ae44c6d-67b5-4c87-b9c8-95ee2c60477a,DISK]] 2023-02-12 23:03:26,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:26,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:26,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:26,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:26,844 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:26,845 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 23:03:26,845 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 23:03:26,846 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:26,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:26,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:26,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:26,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:26,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72713951, jitterRate=0.08352230489253998}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 23:03:26,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676243006839Initializing all the Stores at 1676243006840 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243006840Cleaning up temporary data from old regions at 1676243006847 (+7 ms)Cleaning up detritus from prior splits at 1676243006847Region opened successfully at 1676243006852 (+5 ms) 2023-02-12 23:03:26,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 23:03:26,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 23:03:26,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 23:03:26,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 23:03:26,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 23:03:26,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 23:03:26,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 23:03:26,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 23:03:26,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 23:03:26,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 23:03:26,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 23:03:26,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 23:03:26,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 23:03:26,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 23:03:26,869 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:26,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 23:03:26,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 23:03:26,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 23:03:26,873 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:26,873 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:26,873 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:26,873 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:26,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,33707,1676243006645, sessionid=0x1004ac65e660000, setting cluster-up flag (Was=false) 2023-02-12 23:03:26,877 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:26,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 23:03:26,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33707,1676243006645 2023-02-12 23:03:26,885 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:26,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 23:03:26,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33707,1676243006645 2023-02-12 23:03:26,890 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.hbase-snapshot/.tmp 2023-02-12 23:03:26,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:26,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:26,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:26,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:26,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:26,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 23:03:26,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:26,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676243036894 2023-02-12 23:03:26,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 23:03:26,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 23:03:26,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 23:03:26,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 23:03:26,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 23:03:26,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 23:03:26,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:26,895 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:26,895 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 23:03:26,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 23:03:26,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 23:03:26,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 23:03:26,897 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:26,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 23:03:26,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 23:03:26,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676243006903,5,FailOnTimeoutGroup] 2023-02-12 23:03:26,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676243006903,5,FailOnTimeoutGroup] 2023-02-12 23:03:26,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:26,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 23:03:26,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:26,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:26,915 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:26,915 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:26,916 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae 2023-02-12 23:03:26,926 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:26,927 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 23:03:26,928 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/info 2023-02-12 23:03:26,928 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 23:03:26,929 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:26,929 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 23:03:26,930 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:26,930 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 23:03:26,931 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:26,931 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 23:03:26,932 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/table 2023-02-12 23:03:26,932 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 23:03:26,932 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:26,933 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740 2023-02-12 23:03:26,933 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740 2023-02-12 23:03:26,935 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 23:03:26,936 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 23:03:26,938 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:26,938 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62025708, jitterRate=-0.07574492692947388}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 23:03:26,938 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676243006926Initializing all the Stores at 1676243006927 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243006927Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243006927Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243006927Cleaning up temporary data from old regions at 1676243006934 (+7 ms)Cleaning up detritus from prior splits at 1676243006934Region opened successfully at 1676243006938 (+4 ms) 2023-02-12 23:03:26,938 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 23:03:26,938 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 23:03:26,938 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 23:03:26,938 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 23:03:26,938 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 23:03:26,938 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:26,939 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676243006938Disabling compacts and flushes for region at 1676243006938Disabling writes for close at 1676243006938Writing region close event to WAL at 1676243006938Closed at 1676243006938 2023-02-12 23:03:26,939 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:26,939 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 23:03:26,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 23:03:26,941 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 23:03:26,942 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 23:03:26,950 INFO [RS:1;jenkins-hbase4:41677] regionserver.HRegionServer(952): ClusterId : e43c190c-d89a-44a5-8a9c-f93d7e9e4ae7 2023-02-12 23:03:26,950 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(952): ClusterId : e43c190c-d89a-44a5-8a9c-f93d7e9e4ae7 2023-02-12 23:03:26,950 DEBUG [RS:1;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 23:03:26,950 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 23:03:26,952 DEBUG [RS:1;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 23:03:26,952 DEBUG [RS:1;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 23:03:26,952 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 23:03:26,952 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 23:03:26,956 DEBUG [RS:1;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 23:03:26,957 DEBUG [RS:1;jenkins-hbase4:41677] zookeeper.ReadOnlyZKClient(139): Connect 0x411b3662 to 127.0.0.1:62430 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:26,957 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 23:03:26,958 DEBUG [RS:0;jenkins-hbase4:34839] zookeeper.ReadOnlyZKClient(139): Connect 0x373d6317 to 127.0.0.1:62430 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:26,967 DEBUG [RS:1;jenkins-hbase4:41677] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fdcc031, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:26,967 DEBUG [RS:0;jenkins-hbase4:34839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39fa8b80, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:26,968 DEBUG [RS:1;jenkins-hbase4:41677] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4be35d12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:26,968 DEBUG [RS:0;jenkins-hbase4:34839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3dc50867, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:26,976 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34839 2023-02-12 23:03:26,976 DEBUG [RS:1;jenkins-hbase4:41677] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41677 2023-02-12 23:03:26,976 INFO [RS:0;jenkins-hbase4:34839] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 23:03:26,976 INFO [RS:1;jenkins-hbase4:41677] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 23:03:26,976 INFO [RS:1;jenkins-hbase4:41677] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 23:03:26,976 INFO [RS:0;jenkins-hbase4:34839] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 23:03:26,976 DEBUG [RS:1;jenkins-hbase4:41677] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 23:03:26,976 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 23:03:26,977 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33707,1676243006645 with isa=jenkins-hbase4.apache.org/172.31.14.131:34839, startcode=1676243006691 2023-02-12 23:03:26,977 INFO [RS:1;jenkins-hbase4:41677] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33707,1676243006645 with isa=jenkins-hbase4.apache.org/172.31.14.131:41677, startcode=1676243006724 2023-02-12 23:03:26,977 DEBUG [RS:0;jenkins-hbase4:34839] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 23:03:26,977 DEBUG [RS:1;jenkins-hbase4:41677] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 23:03:26,979 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38559, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 23:03:26,979 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54919, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 23:03:26,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33707] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:26,980 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:26,981 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae 2023-02-12 23:03:26,981 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39205 2023-02-12 23:03:26,981 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 23:03:26,981 DEBUG [RS:1;jenkins-hbase4:41677] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae 2023-02-12 23:03:26,981 DEBUG [RS:1;jenkins-hbase4:41677] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39205 2023-02-12 23:03:26,981 DEBUG [RS:1;jenkins-hbase4:41677] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 23:03:26,983 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:26,986 DEBUG [RS:0;jenkins-hbase4:34839] zookeeper.ZKUtil(162): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:26,987 WARN [RS:0;jenkins-hbase4:34839] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:26,987 INFO [RS:0;jenkins-hbase4:34839] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:26,987 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/WALs/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:26,987 DEBUG [RS:1;jenkins-hbase4:41677] zookeeper.ZKUtil(162): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:26,987 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41677,1676243006724] 2023-02-12 23:03:26,987 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34839,1676243006691] 2023-02-12 23:03:26,987 WARN [RS:1;jenkins-hbase4:41677] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:26,987 INFO [RS:1;jenkins-hbase4:41677] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:26,987 DEBUG [RS:1;jenkins-hbase4:41677] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/WALs/jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:26,991 DEBUG [RS:0;jenkins-hbase4:34839] zookeeper.ZKUtil(162): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:26,991 DEBUG [RS:1;jenkins-hbase4:41677] zookeeper.ZKUtil(162): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:26,991 DEBUG [RS:0;jenkins-hbase4:34839] zookeeper.ZKUtil(162): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:26,991 DEBUG [RS:1;jenkins-hbase4:41677] zookeeper.ZKUtil(162): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:26,992 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 23:03:26,992 DEBUG [RS:1;jenkins-hbase4:41677] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 23:03:26,992 INFO [RS:0;jenkins-hbase4:34839] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 23:03:26,992 INFO [RS:1;jenkins-hbase4:41677] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 23:03:26,994 INFO [RS:0;jenkins-hbase4:34839] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 23:03:26,994 INFO [RS:0;jenkins-hbase4:34839] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 23:03:26,995 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:26,995 INFO [RS:1;jenkins-hbase4:41677] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 23:03:26,996 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 23:03:26,996 INFO [RS:1;jenkins-hbase4:41677] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 23:03:26,996 INFO [RS:1;jenkins-hbase4:41677] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:26,997 INFO [RS:1;jenkins-hbase4:41677] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 23:03:26,997 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:26,998 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,998 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,998 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,998 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,998 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,998 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:26,998 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,998 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,998 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,998 INFO [RS:1;jenkins-hbase4:41677] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:26,998 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,998 DEBUG [RS:1;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,998 DEBUG [RS:1;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,998 DEBUG [RS:1;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,999 DEBUG [RS:1;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,999 DEBUG [RS:1;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,999 DEBUG [RS:1;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:26,999 DEBUG [RS:1;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,999 DEBUG [RS:1;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,999 DEBUG [RS:1;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:26,999 DEBUG [RS:1;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:27,000 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:27,000 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:27,000 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:27,003 INFO [RS:1;jenkins-hbase4:41677] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:27,003 INFO [RS:1;jenkins-hbase4:41677] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:27,003 INFO [RS:1;jenkins-hbase4:41677] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:27,013 INFO [RS:0;jenkins-hbase4:34839] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 23:03:27,013 INFO [RS:1;jenkins-hbase4:41677] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 23:03:27,013 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34839,1676243006691-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:27,013 INFO [RS:1;jenkins-hbase4:41677] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41677,1676243006724-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:27,026 INFO [RS:0;jenkins-hbase4:34839] regionserver.Replication(203): jenkins-hbase4.apache.org,34839,1676243006691 started 2023-02-12 23:03:27,026 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34839,1676243006691, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34839, sessionid=0x1004ac65e660001 2023-02-12 23:03:27,026 INFO [RS:1;jenkins-hbase4:41677] regionserver.Replication(203): jenkins-hbase4.apache.org,41677,1676243006724 started 2023-02-12 23:03:27,026 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 23:03:27,026 DEBUG [RS:0;jenkins-hbase4:34839] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:27,026 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34839,1676243006691' 2023-02-12 23:03:27,026 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:27,026 INFO [RS:1;jenkins-hbase4:41677] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41677,1676243006724, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41677, sessionid=0x1004ac65e660002 2023-02-12 23:03:27,026 DEBUG [RS:1;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 23:03:27,026 DEBUG [RS:1;jenkins-hbase4:41677] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:27,026 DEBUG [RS:1;jenkins-hbase4:41677] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41677,1676243006724' 2023-02-12 23:03:27,026 DEBUG [RS:1;jenkins-hbase4:41677] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:27,026 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:27,026 DEBUG [RS:1;jenkins-hbase4:41677] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:27,026 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 23:03:27,027 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 23:03:27,027 DEBUG [RS:0;jenkins-hbase4:34839] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:27,027 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34839,1676243006691' 2023-02-12 23:03:27,027 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:27,027 DEBUG [RS:1;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 23:03:27,027 DEBUG [RS:1;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 23:03:27,027 DEBUG [RS:1;jenkins-hbase4:41677] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:27,027 DEBUG [RS:1;jenkins-hbase4:41677] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41677,1676243006724' 2023-02-12 23:03:27,027 DEBUG [RS:1;jenkins-hbase4:41677] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:27,027 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:27,027 DEBUG [RS:1;jenkins-hbase4:41677] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:27,027 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 23:03:27,027 INFO [RS:0;jenkins-hbase4:34839] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 23:03:27,027 INFO [RS:0;jenkins-hbase4:34839] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 23:03:27,027 DEBUG [RS:1;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 23:03:27,027 INFO [RS:1;jenkins-hbase4:41677] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 23:03:27,027 INFO [RS:1;jenkins-hbase4:41677] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 23:03:27,093 DEBUG [jenkins-hbase4:33707] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 23:03:27,093 DEBUG [jenkins-hbase4:33707] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:27,094 DEBUG [jenkins-hbase4:33707] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:27,094 DEBUG [jenkins-hbase4:33707] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:27,094 DEBUG [jenkins-hbase4:33707] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:27,095 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34839,1676243006691, state=OPENING 2023-02-12 23:03:27,097 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 23:03:27,099 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:27,099 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 23:03:27,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34839,1676243006691}] 2023-02-12 23:03:27,253 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:27,253 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 23:03:27,255 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46778, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 23:03:27,260 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 23:03:27,260 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:27,262 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34839%2C1676243006691.meta, suffix=.meta, logDir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/WALs/jenkins-hbase4.apache.org,34839,1676243006691, archiveDir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/oldWALs, maxLogs=32 2023-02-12 23:03:27,281 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36015,DS-d16808c3-041c-4bf3-9fd2-b55c07aa5ee3,DISK] 2023-02-12 23:03:27,281 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37545,DS-2ae44c6d-67b5-4c87-b9c8-95ee2c60477a,DISK] 2023-02-12 23:03:27,283 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/WALs/jenkins-hbase4.apache.org,34839,1676243006691/jenkins-hbase4.apache.org%2C34839%2C1676243006691.meta.1676243007263.meta 2023-02-12 23:03:27,284 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36015,DS-d16808c3-041c-4bf3-9fd2-b55c07aa5ee3,DISK], DatanodeInfoWithStorage[127.0.0.1:37545,DS-2ae44c6d-67b5-4c87-b9c8-95ee2c60477a,DISK]] 2023-02-12 23:03:27,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:27,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 23:03:27,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 23:03:27,285 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 23:03:27,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 23:03:27,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:27,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 23:03:27,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 23:03:27,288 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 23:03:27,289 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/info 2023-02-12 23:03:27,289 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/info 2023-02-12 23:03:27,289 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 23:03:27,289 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:27,290 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 23:03:27,290 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:27,290 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:27,291 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 23:03:27,291 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:27,291 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 23:03:27,292 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/table 2023-02-12 23:03:27,292 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/table 2023-02-12 23:03:27,292 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 23:03:27,293 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:27,293 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740 2023-02-12 23:03:27,294 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740 2023-02-12 23:03:27,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 23:03:27,298 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 23:03:27,298 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71671212, jitterRate=0.06798428297042847}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 23:03:27,298 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676243007285Writing region info on filesystem at 1676243007285Initializing all the Stores at 1676243007286 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243007286Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243007287 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243007287Cleaning up temporary data from old regions at 1676243007295 (+8 ms)Cleaning up detritus from prior splits at 1676243007296 (+1 ms)Running coprocessor post-open hooks at 1676243007298 (+2 ms)Region opened successfully at 1676243007298 2023-02-12 23:03:27,299 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676243007253 2023-02-12 23:03:27,303 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 23:03:27,303 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 23:03:27,304 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34839,1676243006691, state=OPEN 2023-02-12 23:03:27,305 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 23:03:27,305 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 23:03:27,306 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 23:03:27,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34839,1676243006691 in 206 msec 2023-02-12 23:03:27,308 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 23:03:27,308 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 368 msec 2023-02-12 23:03:27,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 418 msec 2023-02-12 23:03:27,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676243006752, completionTime=-1 2023-02-12 23:03:27,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 23:03:27,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 23:03:27,313 DEBUG [hconnection-0x21b0da88-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:27,316 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46784, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:27,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 23:03:27,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676243067318 2023-02-12 23:03:27,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676243127318 2023-02-12 23:03:27,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 8 msec 2023-02-12 23:03:27,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33707,1676243006645-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:27,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33707,1676243006645-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:27,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33707,1676243006645-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:27,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33707, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:27,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:27,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 23:03:27,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:27,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 23:03:27,329 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 23:03:27,329 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 23:03:27,330 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 23:03:27,331 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/hbase/namespace/3f31ba3f8519b6add427f7ed7553133c 2023-02-12 23:03:27,332 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/hbase/namespace/3f31ba3f8519b6add427f7ed7553133c empty. 2023-02-12 23:03:27,332 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/hbase/namespace/3f31ba3f8519b6add427f7ed7553133c 2023-02-12 23:03:27,332 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 23:03:27,343 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:27,344 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3f31ba3f8519b6add427f7ed7553133c, NAME => 'hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp 2023-02-12 23:03:27,351 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:27,351 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 3f31ba3f8519b6add427f7ed7553133c, disabling compactions & flushes 2023-02-12 23:03:27,351 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c. 2023-02-12 23:03:27,351 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c. 2023-02-12 23:03:27,351 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c. after waiting 0 ms 2023-02-12 23:03:27,351 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c. 2023-02-12 23:03:27,351 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c. 2023-02-12 23:03:27,351 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 3f31ba3f8519b6add427f7ed7553133c: Waiting for close lock at 1676243007351Disabling compacts and flushes for region at 1676243007351Disabling writes for close at 1676243007351Writing region close event to WAL at 1676243007351Closed at 1676243007351 2023-02-12 23:03:27,353 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 23:03:27,354 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676243007354"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243007354"}]},"ts":"1676243007354"} 2023-02-12 23:03:27,356 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 23:03:27,357 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 23:03:27,357 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243007357"}]},"ts":"1676243007357"} 2023-02-12 23:03:27,358 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 23:03:27,362 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:27,362 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:27,362 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:27,362 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:27,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3f31ba3f8519b6add427f7ed7553133c, ASSIGN}] 2023-02-12 23:03:27,364 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3f31ba3f8519b6add427f7ed7553133c, ASSIGN 2023-02-12 23:03:27,365 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3f31ba3f8519b6add427f7ed7553133c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34839,1676243006691; forceNewPlan=false, retain=false 2023-02-12 23:03:27,515 INFO [jenkins-hbase4:33707] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 23:03:27,516 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3f31ba3f8519b6add427f7ed7553133c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:27,517 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676243007516"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243007516"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243007516"}]},"ts":"1676243007516"} 2023-02-12 23:03:27,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3f31ba3f8519b6add427f7ed7553133c, server=jenkins-hbase4.apache.org,34839,1676243006691}] 2023-02-12 23:03:27,673 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c. 2023-02-12 23:03:27,675 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34839%2C1676243006691, suffix=, logDir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/WALs/jenkins-hbase4.apache.org,34839,1676243006691, archiveDir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/oldWALs, maxLogs=32 2023-02-12 23:03:27,690 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37545,DS-2ae44c6d-67b5-4c87-b9c8-95ee2c60477a,DISK] 2023-02-12 23:03:27,690 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36015,DS-d16808c3-041c-4bf3-9fd2-b55c07aa5ee3,DISK] 2023-02-12 23:03:27,692 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/WALs/jenkins-hbase4.apache.org,34839,1676243006691/jenkins-hbase4.apache.org%2C34839%2C1676243006691.1676243007675 2023-02-12 23:03:27,696 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36015,DS-d16808c3-041c-4bf3-9fd2-b55c07aa5ee3,DISK], DatanodeInfoWithStorage[127.0.0.1:37545,DS-2ae44c6d-67b5-4c87-b9c8-95ee2c60477a,DISK]] 2023-02-12 23:03:27,696 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3f31ba3f8519b6add427f7ed7553133c, NAME => 'hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:27,696 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3f31ba3f8519b6add427f7ed7553133c 2023-02-12 23:03:27,696 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:27,696 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3f31ba3f8519b6add427f7ed7553133c 2023-02-12 23:03:27,696 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3f31ba3f8519b6add427f7ed7553133c 2023-02-12 23:03:27,699 INFO [StoreOpener-3f31ba3f8519b6add427f7ed7553133c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3f31ba3f8519b6add427f7ed7553133c 2023-02-12 23:03:27,700 DEBUG [StoreOpener-3f31ba3f8519b6add427f7ed7553133c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/namespace/3f31ba3f8519b6add427f7ed7553133c/info 2023-02-12 23:03:27,700 DEBUG [StoreOpener-3f31ba3f8519b6add427f7ed7553133c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/namespace/3f31ba3f8519b6add427f7ed7553133c/info 2023-02-12 23:03:27,701 INFO [StoreOpener-3f31ba3f8519b6add427f7ed7553133c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f31ba3f8519b6add427f7ed7553133c columnFamilyName info 2023-02-12 23:03:27,701 INFO [StoreOpener-3f31ba3f8519b6add427f7ed7553133c-1] regionserver.HStore(310): Store=3f31ba3f8519b6add427f7ed7553133c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:27,702 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/namespace/3f31ba3f8519b6add427f7ed7553133c 2023-02-12 23:03:27,702 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/namespace/3f31ba3f8519b6add427f7ed7553133c 2023-02-12 23:03:27,704 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3f31ba3f8519b6add427f7ed7553133c 2023-02-12 23:03:27,706 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/namespace/3f31ba3f8519b6add427f7ed7553133c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:27,706 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3f31ba3f8519b6add427f7ed7553133c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62900761, jitterRate=-0.0627056211233139}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 23:03:27,706 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3f31ba3f8519b6add427f7ed7553133c: Running coprocessor pre-open hook at 1676243007696Writing region info on filesystem at 1676243007696Initializing all the Stores at 1676243007697 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243007697Cleaning up temporary data from old regions at 1676243007702 (+5 ms)Cleaning up detritus from prior splits at 1676243007703 (+1 ms)Running coprocessor post-open hooks at 1676243007706 (+3 ms)Region opened successfully at 1676243007706 2023-02-12 23:03:27,707 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c., pid=6, masterSystemTime=1676243007670 2023-02-12 23:03:27,708 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c. 2023-02-12 23:03:27,708 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c. 2023-02-12 23:03:27,709 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3f31ba3f8519b6add427f7ed7553133c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:27,709 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676243007709"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243007709"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243007709"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243007709"}]},"ts":"1676243007709"} 2023-02-12 23:03:27,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 23:03:27,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3f31ba3f8519b6add427f7ed7553133c, server=jenkins-hbase4.apache.org,34839,1676243006691 in 192 msec 2023-02-12 23:03:27,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 23:03:27,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3f31ba3f8519b6add427f7ed7553133c, ASSIGN in 350 msec 2023-02-12 23:03:27,713 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 23:03:27,714 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243007713"}]},"ts":"1676243007713"} 2023-02-12 23:03:27,715 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 23:03:27,717 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 23:03:27,718 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 390 msec 2023-02-12 23:03:27,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 23:03:27,730 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:27,730 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:27,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 23:03:27,744 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:27,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-12 23:03:27,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 23:03:27,761 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:27,764 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-12 23:03:27,770 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 23:03:27,771 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 23:03:27,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.013sec 2023-02-12 23:03:27,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 23:03:27,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 23:03:27,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 23:03:27,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33707,1676243006645-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 23:03:27,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33707,1676243006645-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 23:03:27,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 23:03:27,851 DEBUG [Listener at localhost/33645] zookeeper.ReadOnlyZKClient(139): Connect 0x05b845c0 to 127.0.0.1:62430 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:27,857 DEBUG [Listener at localhost/33645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f7e60a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:27,858 DEBUG [hconnection-0x92528c6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:27,861 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46792, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:27,863 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33707,1676243006645 2023-02-12 23:03:27,863 DEBUG [Listener at localhost/33645] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 23:03:27,865 DEBUG [Listener at localhost/33645] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 23:03:27,867 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50182, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 23:03:27,867 INFO [Listener at localhost/33645] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:27,868 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:27,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 23:03:27,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:50182 deadline: 1676243067868, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:27,868 INFO [Listener at localhost/33645] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-12 23:03:27,871 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:27,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:27,873 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 23:03:27,874 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-12 23:03:27,874 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 23:03:27,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:27,876 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013 2023-02-12 23:03:27,876 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013 empty. 2023-02-12 23:03:27,877 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013 2023-02-12 23:03:27,877 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-12 23:03:27,886 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:27,894 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6bb4a3b24d73174c2ea882f7c4228013, NAME => 'testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp 2023-02-12 23:03:27,903 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:27,903 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 6bb4a3b24d73174c2ea882f7c4228013, disabling compactions & flushes 2023-02-12 23:03:27,903 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:27,903 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:27,903 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. after waiting 0 ms 2023-02-12 23:03:27,903 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:27,903 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:27,903 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 6bb4a3b24d73174c2ea882f7c4228013: Waiting for close lock at 1676243007903Disabling compacts and flushes for region at 1676243007903Disabling writes for close at 1676243007903Writing region close event to WAL at 1676243007903Closed at 1676243007903 2023-02-12 23:03:27,905 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 23:03:27,906 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676243007906"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243007906"}]},"ts":"1676243007906"} 2023-02-12 23:03:27,908 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 23:03:27,909 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 23:03:27,909 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243007909"}]},"ts":"1676243007909"} 2023-02-12 23:03:27,910 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-12 23:03:27,913 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:27,914 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:27,914 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:27,914 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:27,914 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=6bb4a3b24d73174c2ea882f7c4228013, ASSIGN}] 2023-02-12 23:03:27,916 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=6bb4a3b24d73174c2ea882f7c4228013, ASSIGN 2023-02-12 23:03:27,916 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=6bb4a3b24d73174c2ea882f7c4228013, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34839,1676243006691; forceNewPlan=false, retain=false 2023-02-12 23:03:27,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:28,029 INFO [RS:1;jenkins-hbase4:41677] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41677%2C1676243006724, suffix=, logDir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/WALs/jenkins-hbase4.apache.org,41677,1676243006724, archiveDir=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/oldWALs, maxLogs=32 2023-02-12 23:03:28,044 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36015,DS-d16808c3-041c-4bf3-9fd2-b55c07aa5ee3,DISK] 2023-02-12 23:03:28,045 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37545,DS-2ae44c6d-67b5-4c87-b9c8-95ee2c60477a,DISK] 2023-02-12 23:03:28,046 INFO [RS:1;jenkins-hbase4:41677] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/WALs/jenkins-hbase4.apache.org,41677,1676243006724/jenkins-hbase4.apache.org%2C41677%2C1676243006724.1676243008030 2023-02-12 23:03:28,046 DEBUG [RS:1;jenkins-hbase4:41677] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36015,DS-d16808c3-041c-4bf3-9fd2-b55c07aa5ee3,DISK], DatanodeInfoWithStorage[127.0.0.1:37545,DS-2ae44c6d-67b5-4c87-b9c8-95ee2c60477a,DISK]] 2023-02-12 23:03:28,067 INFO [jenkins-hbase4:33707] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 23:03:28,067 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=6bb4a3b24d73174c2ea882f7c4228013, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,068 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676243008067"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243008067"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243008067"}]},"ts":"1676243008067"} 2023-02-12 23:03:28,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 6bb4a3b24d73174c2ea882f7c4228013, server=jenkins-hbase4.apache.org,34839,1676243006691}] 2023-02-12 23:03:28,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:28,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:28,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6bb4a3b24d73174c2ea882f7c4228013, NAME => 'testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:28,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 6bb4a3b24d73174c2ea882f7c4228013 2023-02-12 23:03:28,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:28,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6bb4a3b24d73174c2ea882f7c4228013 2023-02-12 23:03:28,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6bb4a3b24d73174c2ea882f7c4228013 2023-02-12 23:03:28,226 INFO [StoreOpener-6bb4a3b24d73174c2ea882f7c4228013-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6bb4a3b24d73174c2ea882f7c4228013 2023-02-12 23:03:28,227 DEBUG [StoreOpener-6bb4a3b24d73174c2ea882f7c4228013-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f1 2023-02-12 23:03:28,227 DEBUG [StoreOpener-6bb4a3b24d73174c2ea882f7c4228013-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f1 2023-02-12 23:03:28,227 INFO [StoreOpener-6bb4a3b24d73174c2ea882f7c4228013-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bb4a3b24d73174c2ea882f7c4228013 columnFamilyName f1 2023-02-12 23:03:28,228 INFO [StoreOpener-6bb4a3b24d73174c2ea882f7c4228013-1] regionserver.HStore(310): Store=6bb4a3b24d73174c2ea882f7c4228013/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:28,228 INFO [StoreOpener-6bb4a3b24d73174c2ea882f7c4228013-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6bb4a3b24d73174c2ea882f7c4228013 2023-02-12 23:03:28,229 DEBUG [StoreOpener-6bb4a3b24d73174c2ea882f7c4228013-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f2 2023-02-12 23:03:28,229 DEBUG [StoreOpener-6bb4a3b24d73174c2ea882f7c4228013-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f2 2023-02-12 23:03:28,229 INFO [StoreOpener-6bb4a3b24d73174c2ea882f7c4228013-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bb4a3b24d73174c2ea882f7c4228013 columnFamilyName f2 2023-02-12 23:03:28,230 INFO [StoreOpener-6bb4a3b24d73174c2ea882f7c4228013-1] regionserver.HStore(310): Store=6bb4a3b24d73174c2ea882f7c4228013/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:28,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013 2023-02-12 23:03:28,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013 2023-02-12 23:03:28,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:28,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6bb4a3b24d73174c2ea882f7c4228013 2023-02-12 23:03:28,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:28,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6bb4a3b24d73174c2ea882f7c4228013; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65394006, jitterRate=-0.025553375482559204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:28,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6bb4a3b24d73174c2ea882f7c4228013: Running coprocessor pre-open hook at 1676243008225Writing region info on filesystem at 1676243008225Initializing all the Stores at 1676243008226 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243008226Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243008226Cleaning up temporary data from old regions at 1676243008231 (+5 ms)Cleaning up detritus from prior splits at 1676243008231Running coprocessor post-open hooks at 1676243008235 (+4 ms)Region opened successfully at 1676243008235 2023-02-12 23:03:28,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013., pid=12, masterSystemTime=1676243008221 2023-02-12 23:03:28,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:28,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:28,238 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=6bb4a3b24d73174c2ea882f7c4228013, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,238 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676243008238"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243008238"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243008238"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243008238"}]},"ts":"1676243008238"} 2023-02-12 23:03:28,241 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 23:03:28,241 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 6bb4a3b24d73174c2ea882f7c4228013, server=jenkins-hbase4.apache.org,34839,1676243006691 in 170 msec 2023-02-12 23:03:28,242 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 23:03:28,242 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=6bb4a3b24d73174c2ea882f7c4228013, ASSIGN in 327 msec 2023-02-12 23:03:28,243 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 23:03:28,243 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243008243"}]},"ts":"1676243008243"} 2023-02-12 23:03:28,244 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-12 23:03:28,246 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 23:03:28,247 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 375 msec 2023-02-12 23:03:28,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:28,480 INFO [Listener at localhost/33645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-12 23:03:28,480 DEBUG [Listener at localhost/33645] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-12 23:03:28,480 INFO [Listener at localhost/33645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 23:03:28,482 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-12 23:03:28,482 INFO [Listener at localhost/33645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 23:03:28,482 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-12 23:03:28,482 INFO [Listener at localhost/33645] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 23:03:28,523 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34839] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:28,611 INFO [Listener at localhost/33645] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 23:03:28,611 INFO [Listener at localhost/33645] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 23:03:28,612 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-12 23:03:28,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676243008612 (current time:1676243008612). 2023-02-12 23:03:28,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 23:03:28,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] zookeeper.ReadOnlyZKClient(139): Connect 0x75296e53 to 127.0.0.1:62430 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:28,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b842f6d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:28,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:28,622 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46798, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:28,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75296e53 to 127.0.0.1:62430 2023-02-12 23:03:28,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:28,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 23:03:28,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-12 23:03:28,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-12 23:03:28,628 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-12 23:03:28,628 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676243608628 2023-02-12 23:03:28,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-12 23:03:28,629 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:28,630 DEBUG [Listener at localhost/33645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 23:03:28,630 DEBUG [Listener at localhost/33645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 23:03:28,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-12 23:03:28,631 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-12 23:03:28,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 5 msec 2023-02-12 23:03:28,632 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-12 23:03:28,633 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676243608633 2023-02-12 23:03:28,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-12 23:03:28,643 INFO [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-12 23:03:28,643 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:28,644 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-12 23:03:28,644 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-12 23:03:28,644 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 23:03:28,644 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-12 23:03:28,645 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:28,645 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,645 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:28,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:28,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:28,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:28,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:28,646 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,646 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 23:03:28,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 23:03:28,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 23:03:28,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 23:03:28,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 23:03:28,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-12 23:03:28,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-12 23:03:28,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 23:03:28,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 23:03:28,647 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-12 23:03:28,647 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-12 23:03:28,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 23:03:28,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 23:03:28,654 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 23:03:28,654 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:28,654 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 23:03:28,655 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:28,655 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 23:03:28,655 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 23:03:28,656 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 23:03:28,656 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1676243006691' joining acquired barrier for procedure (foo) in zk 2023-02-12 23:03:28,656 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 23:03:28,656 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41677,1676243006724' joining acquired barrier for procedure (foo) in zk 2023-02-12 23:03:28,658 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,658 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 23:03:28,658 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 23:03:28,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:28,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:28,658 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 23:03:28,658 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:28,658 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 23:03:28,658 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:28,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:28,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:28,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 23:03:28,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:28,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:28,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1676243006691' joining acquired barrier for procedure 'foo' on coordinator 2023-02-12 23:03:28,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77ef8692[Count = 0] remaining members to acquire global barrier 2023-02-12 23:03:28,660 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-12 23:03:28,660 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-12 23:03:28,662 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 23:03:28,663 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 23:03:28,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 23:03:28,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 23:03:28,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 23:03:28,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 23:03:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 23:03:28,663 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,663 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 23:03:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 23:03:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 23:03:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 23:03:28,663 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,41677,1676243006724' in zk 2023-02-12 23:03:28,663 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. started... 2023-02-12 23:03:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 23:03:28,664 INFO [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 6bb4a3b24d73174c2ea882f7c4228013 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 23:03:28,665 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 23:03:28,666 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:28,666 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 23:03:28,687 INFO [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/.tmp/f1/0383fe34940d4a92b46f32a221205fdf 2023-02-12 23:03:28,713 INFO [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/.tmp/f2/2931778d1a5747d08245f1a6c35d1214 2023-02-12 23:03:28,718 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/.tmp/f1/0383fe34940d4a92b46f32a221205fdf as hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f1/0383fe34940d4a92b46f32a221205fdf 2023-02-12 23:03:28,724 INFO [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f1/0383fe34940d4a92b46f32a221205fdf, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 23:03:28,725 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/.tmp/f2/2931778d1a5747d08245f1a6c35d1214 as hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f2/2931778d1a5747d08245f1a6c35d1214 2023-02-12 23:03:28,730 DEBUG [Listener at localhost/33645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:28,730 INFO [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f2/2931778d1a5747d08245f1a6c35d1214, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 23:03:28,731 INFO [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 6bb4a3b24d73174c2ea882f7c4228013 in 67ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:28,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-12 23:03:28,731 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-12 23:03:28,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-12 23:03:28,732 DEBUG [Listener at localhost/33645] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 23:03:28,732 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 6bb4a3b24d73174c2ea882f7c4228013: 2023-02-12 23:03:28,732 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013.' region-info for snapshot=foo 2023-02-12 23:03:28,732 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:28,732 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f1/0383fe34940d4a92b46f32a221205fdf] hfiles 2023-02-12 23:03:28,732 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f1/0383fe34940d4a92b46f32a221205fdf for snapshot=foo 2023-02-12 23:03:28,732 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f2/2931778d1a5747d08245f1a6c35d1214] hfiles 2023-02-12 23:03:28,732 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f2/2931778d1a5747d08245f1a6c35d1214 for snapshot=foo 2023-02-12 23:03:28,742 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. completed. 2023-02-12 23:03:28,742 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:28,742 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 23:03:28,742 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 23:03:28,742 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,742 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 23:03:28,742 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,34839,1676243006691' in zk 2023-02-12 23:03:28,744 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,744 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 23:03:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:28,744 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:28,744 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 23:03:28,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:28,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:28,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 23:03:28,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:28,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:28,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 23:03:28,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:28,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,34839,1676243006691': 2023-02-12 23:03:28,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1676243006691' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-12 23:03:28,748 INFO [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-12 23:03:28,748 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 23:03:28,748 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 23:03:28,748 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-12 23:03:28,748 INFO [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 23:03:28,750 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 23:03:28,750 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 23:03:28,750 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:28,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 23:03:28,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-12 23:03:28,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:28,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:28,750 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 23:03:28,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 23:03:28,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 23:03:28,750 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:28,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 23:03:28,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:28,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:28,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:28,751 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:28,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:28,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 23:03:28,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 23:03:28,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 23:03:28,751 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:28,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:28,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 23:03:28,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:28,753 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:28,753 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:28,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 23:03:28,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:28,762 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:28,762 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 23:03:28,762 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:28,762 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:28,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:28,762 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:28,762 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:28,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:28,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:28,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:28,762 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:28,762 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,763 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 23:03:28,763 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:28,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:28,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:28,762 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-12 23:03:28,763 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-12 23:03:28,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:28,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:28,763 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 23:03:28,764 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:28,764 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 23:03:28,764 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 23:03:28,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.hbase-snapshot/.tmp/foo 2023-02-12 23:03:28,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.hbase-snapshot/.tmp/foo to hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.hbase-snapshot/foo 2023-02-12 23:03:28,805 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-12 23:03:28,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.hbase-snapshot/.tmp/foo 2023-02-12 23:03:28,805 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.hbase-snapshot/.tmp/foo 2023-02-12 23:03:28,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676243008629Consolidate snapshot: foo at 1676243008763 (+134 ms)Loading Region manifests for foo at 1676243008763Writing data manifest for foo at 1676243008767 (+4 ms)Verifying snapshot: foo at 1676243008779 (+12 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676243008805 (+26 ms) 2023-02-12 23:03:28,807 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-12 23:03:28,809 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 177 msec 2023-02-12 23:03:28,932 DEBUG [Listener at localhost/33645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:28,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-12 23:03:28,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 23:03:28,934 INFO [Listener at localhost/33645] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 23:03:28,938 INFO [Listener at localhost/33645] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 23:03:28,943 INFO [Listener at localhost/33645] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 23:03:28,984 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34839] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:29,085 INFO [Listener at localhost/33645] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 23:03:29,091 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 23:03:29,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,093 INFO [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-12 23:03:29,093 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:29,094 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-12 23:03:29,094 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-12 23:03:29,095 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,095 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,096 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:29,096 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:29,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:29,096 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,097 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,097 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 23:03:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 23:03:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,098 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 23:03:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,098 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,103 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-12 23:03:29,103 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:29,105 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-12 23:03:29,105 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-12 23:03:29,105 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 23:03:29,105 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 23:03:29,105 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:29,105 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:29,105 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. started... 2023-02-12 23:03:29,106 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-12 23:03:29,106 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-12 23:03:29,106 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41677,1676243006724' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-12 23:03:29,106 INFO [rs(jenkins-hbase4.apache.org,34839,1676243006691)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6bb4a3b24d73174c2ea882f7c4228013 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 23:03:29,108 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,108 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,108 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:29,124 INFO [rs(jenkins-hbase4.apache.org,34839,1676243006691)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/.tmp/f1/afed597b152048e3924a9cb36004713b 2023-02-12 23:03:29,151 INFO [rs(jenkins-hbase4.apache.org,34839,1676243006691)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/.tmp/f2/a4049f7ad83d428ba6219db8be22981f 2023-02-12 23:03:29,155 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/.tmp/f1/afed597b152048e3924a9cb36004713b as hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f1/afed597b152048e3924a9cb36004713b 2023-02-12 23:03:29,159 INFO [rs(jenkins-hbase4.apache.org,34839,1676243006691)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f1/afed597b152048e3924a9cb36004713b, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 23:03:29,160 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/.tmp/f2/a4049f7ad83d428ba6219db8be22981f as hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f2/a4049f7ad83d428ba6219db8be22981f 2023-02-12 23:03:29,165 INFO [rs(jenkins-hbase4.apache.org,34839,1676243006691)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f2/a4049f7ad83d428ba6219db8be22981f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 23:03:29,166 INFO [rs(jenkins-hbase4.apache.org,34839,1676243006691)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 6bb4a3b24d73174c2ea882f7c4228013 in 60ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:29,167 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6bb4a3b24d73174c2ea882f7c4228013: 2023-02-12 23:03:29,167 DEBUG [rs(jenkins-hbase4.apache.org,34839,1676243006691)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:29,167 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 23:03:29,167 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 23:03:29,167 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,167 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-12 23:03:29,167 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1676243006691' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-12 23:03:29,169 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,169 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:29,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:29,169 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,170 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:29,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:29,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:29,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:29,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:29,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1676243006691' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-12 23:03:29,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73d00cb7[Count = 0] remaining members to acquire global barrier 2023-02-12 23:03:29,171 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-12 23:03:29,171 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,174 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,174 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,174 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-12 23:03:29,174 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-12 23:03:29,174 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-12 23:03:29,174 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-12 23:03:29,174 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,41677,1676243006724' in zk 2023-02-12 23:03:29,174 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,174 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 23:03:29,174 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,34839,1676243006691' in zk 2023-02-12 23:03:29,176 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-12 23:03:29,176 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:29,176 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,176 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-12 23:03:29,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:29,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:29,176 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676243006724' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-12 23:03:29,177 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:29,177 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1676243006691' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-12 23:03:29,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:29,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:29,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:29,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:29,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:29,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,34839,1676243006691': 2023-02-12 23:03:29,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1676243006691' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-12 23:03:29,181 INFO [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-12 23:03:29,181 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 23:03:29,181 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 23:03:29,181 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,181 INFO [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 23:03:29,182 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,183 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,183 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:29,183 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:29,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,183 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:29,183 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,184 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:29,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:29,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:29,185 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:29,186 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:29,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:29,188 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:29,188 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:29,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:29,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:29,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:29,188 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:29,188 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:29,188 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:29,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:29,188 DEBUG [(jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:29,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:29,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:29,188 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,188 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-12 23:03:29,189 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 23:03:29,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:29,189 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:29,190 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,190 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:29,190 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,190 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,190 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,190 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,190 DEBUG [Listener at localhost/33645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-12 23:03:29,190 DEBUG [Listener at localhost/33645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 23:03:29,290 DEBUG [Listener at localhost/33645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 23:03:29,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 23:03:29,296 INFO [Listener at localhost/33645] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676243008612 type: FLUSH version: 2 ttl: 0 2023-02-12 23:03:29,296 DEBUG [Listener at localhost/33645] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39205/user/jenkins/test-data/0a8a050b-3e89-ca5c-6341-ec63c4cc7515/foo/0fc82e14-d315-4838-be25-d1eac3be48f3/data/default/testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,296 INFO [Listener at localhost/33645] snapshot.RestoreSnapshotHelper(239): region to add: 6bb4a3b24d73174c2ea882f7c4228013 2023-02-12 23:03:29,296 INFO [Listener at localhost/33645] snapshot.RestoreSnapshotHelper(585): clone region=6bb4a3b24d73174c2ea882f7c4228013 as 6bb4a3b24d73174c2ea882f7c4228013 in snapshot foo 2023-02-12 23:03:29,297 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6bb4a3b24d73174c2ea882f7c4228013, NAME => 'testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39205/user/jenkins/test-data/0a8a050b-3e89-ca5c-6341-ec63c4cc7515/foo/0fc82e14-d315-4838-be25-d1eac3be48f3 2023-02-12 23:03:29,309 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:29,309 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0383fe34940d4a92b46f32a221205fdf from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,311 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2931778d1a5747d08245f1a6c35d1214 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,313 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 6bb4a3b24d73174c2ea882f7c4228013, disabling compactions & flushes 2023-02-12 23:03:29,313 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:29,313 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:29,313 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. after waiting 0 ms 2023-02-12 23:03:29,313 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:29,313 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:29,313 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 6bb4a3b24d73174c2ea882f7c4228013: Waiting for close lock at 1676243009313Disabling compacts and flushes for region at 1676243009313Disabling writes for close at 1676243009313Writing region close event to WAL at 1676243009313Closed at 1676243009313 2023-02-12 23:03:29,313 INFO [Listener at localhost/33645] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676243008612 type: FLUSH version: 2 ttl: 0 2023-02-12 23:03:29,314 DEBUG [Listener at localhost/33645] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:39205/user/jenkins/test-data/0a8a050b-3e89-ca5c-6341-ec63c4cc7515/foo/0fc82e14-d315-4838-be25-d1eac3be48f3 2023-02-12 23:03:29,314 DEBUG [Listener at localhost/33645] util.CommonFSUtils(682): File system contents for path hdfs://localhost:39205/user/jenkins/test-data/0a8a050b-3e89-ca5c-6341-ec63c4cc7515/foo/0fc82e14-d315-4838-be25-d1eac3be48f3 2023-02-12 23:03:29,314 DEBUG [Listener at localhost/33645] util.CommonFSUtils(699): |-data/ 2023-02-12 23:03:29,315 DEBUG [Listener at localhost/33645] util.CommonFSUtils(699): |----default/ 2023-02-12 23:03:29,315 DEBUG [Listener at localhost/33645] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-12 23:03:29,315 DEBUG [Listener at localhost/33645] util.CommonFSUtils(699): |----------6bb4a3b24d73174c2ea882f7c4228013/ 2023-02-12 23:03:29,316 DEBUG [Listener at localhost/33645] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:29,316 DEBUG [Listener at localhost/33645] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:29,316 DEBUG [Listener at localhost/33645] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=6bb4a3b24d73174c2ea882f7c4228013-0383fe34940d4a92b46f32a221205fdf 2023-02-12 23:03:29,316 DEBUG [Listener at localhost/33645] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:29,317 DEBUG [Listener at localhost/33645] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=6bb4a3b24d73174c2ea882f7c4228013-2931778d1a5747d08245f1a6c35d1214 2023-02-12 23:03:29,318 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-12 23:03:29,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-12 23:03:29,321 INFO [Listener at localhost/33645] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,321 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 23:03:29,324 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243009324"}]},"ts":"1676243009324"} 2023-02-12 23:03:29,326 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-12 23:03:29,328 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-12 23:03:29,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=6bb4a3b24d73174c2ea882f7c4228013, UNASSIGN}] 2023-02-12 23:03:29,330 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=6bb4a3b24d73174c2ea882f7c4228013, UNASSIGN 2023-02-12 23:03:29,331 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6bb4a3b24d73174c2ea882f7c4228013, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,331 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676243009331"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243009331"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243009331"}]},"ts":"1676243009331"} 2023-02-12 23:03:29,332 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 6bb4a3b24d73174c2ea882f7c4228013, server=jenkins-hbase4.apache.org,34839,1676243006691}] 2023-02-12 23:03:29,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 23:03:29,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6bb4a3b24d73174c2ea882f7c4228013 2023-02-12 23:03:29,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6bb4a3b24d73174c2ea882f7c4228013, disabling compactions & flushes 2023-02-12 23:03:29,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:29,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:29,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. after waiting 0 ms 2023-02-12 23:03:29,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:29,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:29,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013. 2023-02-12 23:03:29,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6bb4a3b24d73174c2ea882f7c4228013: Waiting for close lock at 1676243009485Running coprocessor pre-close hooks at 1676243009485Disabling compacts and flushes for region at 1676243009485Disabling writes for close at 1676243009485Writing region close event to WAL at 1676243009485Running coprocessor post-close hooks at 1676243009489 (+4 ms)Closed at 1676243009489 2023-02-12 23:03:29,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6bb4a3b24d73174c2ea882f7c4228013 2023-02-12 23:03:29,493 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6bb4a3b24d73174c2ea882f7c4228013, regionState=CLOSED 2023-02-12 23:03:29,493 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676243009493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243009493"}]},"ts":"1676243009493"} 2023-02-12 23:03:29,496 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 23:03:29,496 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 6bb4a3b24d73174c2ea882f7c4228013, server=jenkins-hbase4.apache.org,34839,1676243006691 in 163 msec 2023-02-12 23:03:29,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 23:03:29,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=6bb4a3b24d73174c2ea882f7c4228013, UNASSIGN in 167 msec 2023-02-12 23:03:29,498 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243009498"}]},"ts":"1676243009498"} 2023-02-12 23:03:29,499 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-12 23:03:29,500 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-12 23:03:29,502 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 180 msec 2023-02-12 23:03:29,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 23:03:29,628 INFO [Listener at localhost/33645] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-12 23:03:29,629 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,631 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,631 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 23:03:29,634 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013 2023-02-12 23:03:29,636 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f1, FileablePath, hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f2, FileablePath, hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/recovered.edits] 2023-02-12 23:03:29,639 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f1/0383fe34940d4a92b46f32a221205fdf to hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/archive/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f1/0383fe34940d4a92b46f32a221205fdf 2023-02-12 23:03:29,641 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f1/afed597b152048e3924a9cb36004713b to hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/archive/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f1/afed597b152048e3924a9cb36004713b 2023-02-12 23:03:29,643 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f2/2931778d1a5747d08245f1a6c35d1214 to hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/archive/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f2/2931778d1a5747d08245f1a6c35d1214 2023-02-12 23:03:29,644 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f2/a4049f7ad83d428ba6219db8be22981f to hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/archive/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/f2/a4049f7ad83d428ba6219db8be22981f 2023-02-12 23:03:29,646 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/recovered.edits/12.seqid to hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/archive/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013/recovered.edits/12.seqid 2023-02-12 23:03:29,647 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6bb4a3b24d73174c2ea882f7c4228013 2023-02-12 23:03:29,647 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-12 23:03:29,649 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,651 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-12 23:03:29,652 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-12 23:03:29,653 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,654 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-12 23:03:29,654 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676243009654"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:29,655 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 23:03:29,655 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6bb4a3b24d73174c2ea882f7c4228013, NAME => 'testInitTableSnapshotMapperJobConfig,,1676243007871.6bb4a3b24d73174c2ea882f7c4228013.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 23:03:29,655 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-12 23:03:29,655 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676243009655"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:29,658 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-12 23:03:29,660 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 23:03:29,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 31 msec 2023-02-12 23:03:29,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33707] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 23:03:29,733 INFO [Listener at localhost/33645] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-12 23:03:29,734 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 23:03:29,734 INFO [Listener at localhost/33645] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 23:03:29,734 DEBUG [Listener at localhost/33645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05b845c0 to 127.0.0.1:62430 2023-02-12 23:03:29,734 DEBUG [Listener at localhost/33645] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:29,734 DEBUG [Listener at localhost/33645] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 23:03:29,734 DEBUG [Listener at localhost/33645] util.JVMClusterUtil(257): Found active master hash=2004315023, stopped=false 2023-02-12 23:03:29,734 INFO [Listener at localhost/33645] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33707,1676243006645 2023-02-12 23:03:29,740 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:29,740 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:29,740 INFO [Listener at localhost/33645] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 23:03:29,740 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:29,740 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:29,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:29,742 DEBUG [Listener at localhost/33645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20f2fb33 to 127.0.0.1:62430 2023-02-12 23:03:29,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:29,742 DEBUG [Listener at localhost/33645] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:29,742 INFO [Listener at localhost/33645] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34839,1676243006691' ***** 2023-02-12 23:03:29,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:29,742 INFO [Listener at localhost/33645] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 23:03:29,742 INFO [Listener at localhost/33645] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41677,1676243006724' ***** 2023-02-12 23:03:29,743 INFO [Listener at localhost/33645] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 23:03:29,743 INFO [RS:0;jenkins-hbase4:34839] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 23:03:29,743 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 23:03:29,743 INFO [RS:0;jenkins-hbase4:34839] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 23:03:29,743 INFO [RS:1;jenkins-hbase4:41677] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 23:03:29,743 INFO [RS:0;jenkins-hbase4:34839] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 23:03:29,744 INFO [RS:1;jenkins-hbase4:41677] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 23:03:29,744 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(3304): Received CLOSE for 3f31ba3f8519b6add427f7ed7553133c 2023-02-12 23:03:29,744 INFO [RS:1;jenkins-hbase4:41677] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 23:03:29,744 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 23:03:29,744 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,744 INFO [RS:1;jenkins-hbase4:41677] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:29,745 DEBUG [RS:0;jenkins-hbase4:34839] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x373d6317 to 127.0.0.1:62430 2023-02-12 23:03:29,745 DEBUG [RS:1;jenkins-hbase4:41677] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x411b3662 to 127.0.0.1:62430 2023-02-12 23:03:29,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3f31ba3f8519b6add427f7ed7553133c, disabling compactions & flushes 2023-02-12 23:03:29,745 DEBUG [RS:0;jenkins-hbase4:34839] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:29,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c. 2023-02-12 23:03:29,745 DEBUG [RS:1;jenkins-hbase4:41677] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:29,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c. 2023-02-12 23:03:29,746 INFO [RS:0;jenkins-hbase4:34839] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 23:03:29,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c. after waiting 0 ms 2023-02-12 23:03:29,746 INFO [RS:1;jenkins-hbase4:41677] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41677,1676243006724; all regions closed. 2023-02-12 23:03:29,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c. 2023-02-12 23:03:29,746 INFO [RS:0;jenkins-hbase4:34839] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 23:03:29,746 INFO [RS:0;jenkins-hbase4:34839] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 23:03:29,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 3f31ba3f8519b6add427f7ed7553133c 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 23:03:29,746 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 23:03:29,747 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-12 23:03:29,747 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1479): Online Regions={3f31ba3f8519b6add427f7ed7553133c=hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c., 1588230740=hbase:meta,,1.1588230740} 2023-02-12 23:03:29,747 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 23:03:29,747 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1505): Waiting on 1588230740, 3f31ba3f8519b6add427f7ed7553133c 2023-02-12 23:03:29,747 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 23:03:29,747 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 23:03:29,747 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 23:03:29,747 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 23:03:29,748 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-12 23:03:29,753 DEBUG [RS:1;jenkins-hbase4:41677] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/oldWALs 2023-02-12 23:03:29,753 INFO [RS:1;jenkins-hbase4:41677] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41677%2C1676243006724:(num 1676243008030) 2023-02-12 23:03:29,753 DEBUG [RS:1;jenkins-hbase4:41677] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:29,753 INFO [RS:1;jenkins-hbase4:41677] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:29,753 INFO [RS:1;jenkins-hbase4:41677] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 23:03:29,753 INFO [RS:1;jenkins-hbase4:41677] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 23:03:29,753 INFO [RS:1;jenkins-hbase4:41677] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 23:03:29,753 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:29,753 INFO [RS:1;jenkins-hbase4:41677] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 23:03:29,754 INFO [RS:1;jenkins-hbase4:41677] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41677 2023-02-12 23:03:29,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/namespace/3f31ba3f8519b6add427f7ed7553133c/.tmp/info/74e4300b5a3b406c829ccabafe7ad4cf 2023-02-12 23:03:29,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/namespace/3f31ba3f8519b6add427f7ed7553133c/.tmp/info/74e4300b5a3b406c829ccabafe7ad4cf as hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/namespace/3f31ba3f8519b6add427f7ed7553133c/info/74e4300b5a3b406c829ccabafe7ad4cf 2023-02-12 23:03:29,774 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/.tmp/info/48ec2254a89b4e359ea7592b902bfcd0 2023-02-12 23:03:29,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/namespace/3f31ba3f8519b6add427f7ed7553133c/info/74e4300b5a3b406c829ccabafe7ad4cf, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 23:03:29,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3f31ba3f8519b6add427f7ed7553133c in 32ms, sequenceid=6, compaction requested=false 2023-02-12 23:03:29,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48ec2254a89b4e359ea7592b902bfcd0 2023-02-12 23:03:29,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/namespace/3f31ba3f8519b6add427f7ed7553133c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 23:03:29,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c. 2023-02-12 23:03:29,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3f31ba3f8519b6add427f7ed7553133c: Waiting for close lock at 1676243009745Running coprocessor pre-close hooks at 1676243009745Disabling compacts and flushes for region at 1676243009745Disabling writes for close at 1676243009746 (+1 ms)Obtaining lock to block concurrent updates at 1676243009746Preparing flush snapshotting stores in 3f31ba3f8519b6add427f7ed7553133c at 1676243009746Finished memstore snapshotting hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676243009746Flushing stores of hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c. at 1676243009747 (+1 ms)Flushing 3f31ba3f8519b6add427f7ed7553133c/info: creating writer at 1676243009747Flushing 3f31ba3f8519b6add427f7ed7553133c/info: appending metadata at 1676243009752 (+5 ms)Flushing 3f31ba3f8519b6add427f7ed7553133c/info: closing flushed file at 1676243009752Flushing 3f31ba3f8519b6add427f7ed7553133c/info: reopening flushed file at 1676243009773 (+21 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3f31ba3f8519b6add427f7ed7553133c in 32ms, sequenceid=6, compaction requested=false at 1676243009778 (+5 ms)Writing region close event to WAL at 1676243009779 (+1 ms)Running coprocessor post-close hooks at 1676243009786 (+7 ms)Closed at 1676243009786 2023-02-12 23:03:29,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676243007327.3f31ba3f8519b6add427f7ed7553133c. 2023-02-12 23:03:29,798 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/.tmp/rep_barrier/728f7b304c9b4e06a28bd2ffe79bab14 2023-02-12 23:03:29,802 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 728f7b304c9b4e06a28bd2ffe79bab14 2023-02-12 23:03:29,806 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:29,807 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:29,811 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/.tmp/table/5805161e38514ce69600c35d58f8dd5a 2023-02-12 23:03:29,814 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5805161e38514ce69600c35d58f8dd5a 2023-02-12 23:03:29,815 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/.tmp/info/48ec2254a89b4e359ea7592b902bfcd0 as hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/info/48ec2254a89b4e359ea7592b902bfcd0 2023-02-12 23:03:29,819 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48ec2254a89b4e359ea7592b902bfcd0 2023-02-12 23:03:29,819 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/info/48ec2254a89b4e359ea7592b902bfcd0, entries=12, sequenceid=21, filesize=6.3 K 2023-02-12 23:03:29,819 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/.tmp/rep_barrier/728f7b304c9b4e06a28bd2ffe79bab14 as hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/rep_barrier/728f7b304c9b4e06a28bd2ffe79bab14 2023-02-12 23:03:29,823 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 728f7b304c9b4e06a28bd2ffe79bab14 2023-02-12 23:03:29,824 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/rep_barrier/728f7b304c9b4e06a28bd2ffe79bab14, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 23:03:29,824 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/.tmp/table/5805161e38514ce69600c35d58f8dd5a as hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/table/5805161e38514ce69600c35d58f8dd5a 2023-02-12 23:03:29,828 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5805161e38514ce69600c35d58f8dd5a 2023-02-12 23:03:29,828 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/table/5805161e38514ce69600c35d58f8dd5a, entries=4, sequenceid=21, filesize=5.1 K 2023-02-12 23:03:29,829 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 81ms, sequenceid=21, compaction requested=false 2023-02-12 23:03:29,838 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 23:03:29,838 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 23:03:29,839 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:29,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676243009747Running coprocessor pre-close hooks at 1676243009747Disabling compacts and flushes for region at 1676243009747Disabling writes for close at 1676243009747Obtaining lock to block concurrent updates at 1676243009748 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676243009748Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1676243009749 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676243009750 (+1 ms)Flushing 1588230740/info: creating writer at 1676243009751 (+1 ms)Flushing 1588230740/info: appending metadata at 1676243009755 (+4 ms)Flushing 1588230740/info: closing flushed file at 1676243009755Flushing 1588230740/rep_barrier: creating writer at 1676243009779 (+24 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676243009785 (+6 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676243009785Flushing 1588230740/table: creating writer at 1676243009802 (+17 ms)Flushing 1588230740/table: appending metadata at 1676243009804 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676243009804Flushing 1588230740/info: reopening flushed file at 1676243009815 (+11 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676243009820 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676243009825 (+5 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 81ms, sequenceid=21, compaction requested=false at 1676243009829 (+4 ms)Writing region close event to WAL at 1676243009834 (+5 ms)Running coprocessor post-close hooks at 1676243009838 (+4 ms)Closed at 1676243009838 2023-02-12 23:03:29,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:29,849 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:29,849 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:29,849 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:29,849 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41677,1676243006724 2023-02-12 23:03:29,849 ERROR [Listener at localhost/33645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4289bb4b rejected from java.util.concurrent.ThreadPoolExecutor@46b627c2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:29,850 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:29,850 ERROR [Listener at localhost/33645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3da15668 rejected from java.util.concurrent.ThreadPoolExecutor@46b627c2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:29,850 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41677,1676243006724] 2023-02-12 23:03:29,851 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41677,1676243006724; numProcessing=1 2023-02-12 23:03:29,853 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41677,1676243006724 already deleted, retry=false 2023-02-12 23:03:29,853 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41677,1676243006724 expired; onlineServers=1 2023-02-12 23:03:29,947 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34839,1676243006691; all regions closed. 2023-02-12 23:03:29,953 DEBUG [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/oldWALs 2023-02-12 23:03:29,953 INFO [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34839%2C1676243006691.meta:.meta(num 1676243007263) 2023-02-12 23:03:29,958 DEBUG [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/oldWALs 2023-02-12 23:03:29,958 INFO [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34839%2C1676243006691:(num 1676243007675) 2023-02-12 23:03:29,958 DEBUG [RS:0;jenkins-hbase4:34839] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:29,958 INFO [RS:0;jenkins-hbase4:34839] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:29,958 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 23:03:29,958 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:29,959 INFO [RS:0;jenkins-hbase4:34839] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34839 2023-02-12 23:03:29,960 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34839,1676243006691 2023-02-12 23:03:29,960 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:29,960 ERROR [Listener at localhost/33645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@699bab5d rejected from java.util.concurrent.ThreadPoolExecutor@6da422b6[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:29,961 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34839,1676243006691] 2023-02-12 23:03:29,961 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34839,1676243006691; numProcessing=2 2023-02-12 23:03:29,964 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34839,1676243006691 already deleted, retry=false 2023-02-12 23:03:29,964 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34839,1676243006691 expired; onlineServers=0 2023-02-12 23:03:29,964 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33707,1676243006645' ***** 2023-02-12 23:03:29,964 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 23:03:29,964 DEBUG [M:0;jenkins-hbase4:33707] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7348f1b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:29,964 INFO [M:0;jenkins-hbase4:33707] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33707,1676243006645 2023-02-12 23:03:29,965 INFO [M:0;jenkins-hbase4:33707] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33707,1676243006645; all regions closed. 2023-02-12 23:03:29,965 DEBUG [M:0;jenkins-hbase4:33707] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:29,965 DEBUG [M:0;jenkins-hbase4:33707] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 23:03:29,965 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 23:03:29,965 DEBUG [M:0;jenkins-hbase4:33707] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 23:03:29,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676243006903] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676243006903,5,FailOnTimeoutGroup] 2023-02-12 23:03:29,965 INFO [M:0;jenkins-hbase4:33707] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 23:03:29,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676243006903] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676243006903,5,FailOnTimeoutGroup] 2023-02-12 23:03:29,966 INFO [M:0;jenkins-hbase4:33707] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 23:03:29,966 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:29,966 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:29,966 INFO [M:0;jenkins-hbase4:33707] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 23:03:29,966 DEBUG [M:0;jenkins-hbase4:33707] master.HMaster(1502): Stopping service threads 2023-02-12 23:03:29,966 INFO [M:0;jenkins-hbase4:33707] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 23:03:29,967 ERROR [M:0;jenkins-hbase4:33707] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 23:03:29,967 INFO [M:0;jenkins-hbase4:33707] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 23:03:29,967 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 23:03:29,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:29,968 DEBUG [M:0;jenkins-hbase4:33707] zookeeper.ZKUtil(398): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 23:03:29,968 WARN [M:0;jenkins-hbase4:33707] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 23:03:29,968 INFO [M:0;jenkins-hbase4:33707] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 23:03:29,968 INFO [M:0;jenkins-hbase4:33707] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 23:03:29,969 DEBUG [M:0;jenkins-hbase4:33707] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 23:03:29,969 INFO [M:0;jenkins-hbase4:33707] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:29,969 DEBUG [M:0;jenkins-hbase4:33707] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:29,969 DEBUG [M:0;jenkins-hbase4:33707] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 23:03:29,969 DEBUG [M:0;jenkins-hbase4:33707] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:29,969 INFO [M:0;jenkins-hbase4:33707] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.87 KB heapSize=66.80 KB 2023-02-12 23:03:29,978 INFO [M:0;jenkins-hbase4:33707] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.87 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/dbe219161254457ab24d9e0f8a716895 2023-02-12 23:03:29,982 DEBUG [M:0;jenkins-hbase4:33707] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/dbe219161254457ab24d9e0f8a716895 as hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/dbe219161254457ab24d9e0f8a716895 2023-02-12 23:03:29,986 INFO [M:0;jenkins-hbase4:33707] regionserver.HStore(1080): Added hdfs://localhost:39205/user/jenkins/test-data/e389cd6f-ff25-602c-4500-e662588df4ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/dbe219161254457ab24d9e0f8a716895, entries=17, sequenceid=132, filesize=8.7 K 2023-02-12 23:03:29,986 INFO [M:0;jenkins-hbase4:33707] regionserver.HRegion(2947): Finished flush of dataSize ~55.87 KB/57209, heapSize ~66.79 KB/68392, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-12 23:03:29,987 INFO [M:0;jenkins-hbase4:33707] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:29,987 DEBUG [M:0;jenkins-hbase4:33707] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676243009968Disabling compacts and flushes for region at 1676243009968Disabling writes for close at 1676243009969 (+1 ms)Obtaining lock to block concurrent updates at 1676243009969Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676243009969Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57209, getHeapSize=68392, getOffHeapSize=0, getCellsCount=145 at 1676243009969Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676243009970 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676243009971 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676243009973 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676243009973Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676243009983 (+10 ms)Finished flush of dataSize ~55.87 KB/57209, heapSize ~66.79 KB/68392, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1676243009987 (+4 ms)Writing region close event to WAL at 1676243009987Closed at 1676243009987 2023-02-12 23:03:29,990 INFO [M:0;jenkins-hbase4:33707] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 23:03:29,990 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:29,991 INFO [M:0;jenkins-hbase4:33707] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33707 2023-02-12 23:03:29,992 DEBUG [M:0;jenkins-hbase4:33707] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33707,1676243006645 already deleted, retry=false 2023-02-12 23:03:30,136 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:30,136 INFO [M:0;jenkins-hbase4:33707] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33707,1676243006645; zookeeper connection closed. 2023-02-12 23:03:30,136 ERROR [Listener at localhost/33645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56059172 rejected from java.util.concurrent.ThreadPoolExecutor@523a1f6a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:30,137 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): master:33707-0x1004ac65e660000, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:30,137 ERROR [Listener at localhost/33645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c915f10 rejected from java.util.concurrent.ThreadPoolExecutor@523a1f6a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:30,236 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:30,236 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34839,1676243006691; zookeeper connection closed. 2023-02-12 23:03:30,237 ERROR [Listener at localhost/33645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2db1cfcd rejected from java.util.concurrent.ThreadPoolExecutor@6da422b6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:30,237 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x1004ac65e660001, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:30,237 ERROR [Listener at localhost/33645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@55397879 rejected from java.util.concurrent.ThreadPoolExecutor@6da422b6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:30,237 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@657b3c94] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@657b3c94 2023-02-12 23:03:30,337 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:30,337 INFO [RS:1;jenkins-hbase4:41677] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41677,1676243006724; zookeeper connection closed. 2023-02-12 23:03:30,337 ERROR [Listener at localhost/33645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@458248ce rejected from java.util.concurrent.ThreadPoolExecutor@46b627c2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:30,337 DEBUG [Listener at localhost/33645-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1004ac65e660002, quorum=127.0.0.1:62430, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:30,337 ERROR [Listener at localhost/33645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@543e4632 rejected from java.util.concurrent.ThreadPoolExecutor@46b627c2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:30,337 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2e133bf4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2e133bf4 2023-02-12 23:03:30,337 INFO [Listener at localhost/33645] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 23:03:30,337 WARN [Listener at localhost/33645] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 23:03:30,342 INFO [Listener at localhost/33645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:30,445 WARN [BP-1103223092-172.31.14.131-1676243006056 heartbeating to localhost/127.0.0.1:39205] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 23:03:30,445 WARN [BP-1103223092-172.31.14.131-1676243006056 heartbeating to localhost/127.0.0.1:39205] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1103223092-172.31.14.131-1676243006056 (Datanode Uuid 7d8cf19e-10dd-485f-8d02-23cef060cb72) service to localhost/127.0.0.1:39205 2023-02-12 23:03:30,446 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/cluster_ac983163-7479-cf58-97b6-78b83e21f214/dfs/data/data3/current/BP-1103223092-172.31.14.131-1676243006056] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:30,447 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/cluster_ac983163-7479-cf58-97b6-78b83e21f214/dfs/data/data4/current/BP-1103223092-172.31.14.131-1676243006056] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:30,448 WARN [Listener at localhost/33645] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 23:03:30,452 INFO [Listener at localhost/33645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:30,556 WARN [BP-1103223092-172.31.14.131-1676243006056 heartbeating to localhost/127.0.0.1:39205] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 23:03:30,558 WARN [BP-1103223092-172.31.14.131-1676243006056 heartbeating to localhost/127.0.0.1:39205] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1103223092-172.31.14.131-1676243006056 (Datanode Uuid 068b1369-6a2b-4a54-9cb0-2ce7c914de59) service to localhost/127.0.0.1:39205 2023-02-12 23:03:30,558 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/cluster_ac983163-7479-cf58-97b6-78b83e21f214/dfs/data/data1/current/BP-1103223092-172.31.14.131-1676243006056] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:30,559 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/cluster_ac983163-7479-cf58-97b6-78b83e21f214/dfs/data/data2/current/BP-1103223092-172.31.14.131-1676243006056] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:30,569 INFO [Listener at localhost/33645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:30,683 INFO [Listener at localhost/33645] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 23:03:30,703 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 23:03:30,715 INFO [Listener at localhost/33645] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=179 (was 154) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33707,1676243006645)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33645 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:39205 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:39205 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:39205 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:39205 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:39205 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:39205 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:39205 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=564 (was 531) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 209), ProcessCount=166 (was 166), AvailableMemoryMB=4013 (was 4063) 2023-02-12 23:03:30,719 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 23:03:30,723 INFO [Listener at localhost/33645] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=179, OpenFileDescriptor=564, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=166, AvailableMemoryMB=4012 2023-02-12 23:03:30,733 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/hadoop.log.dir so I do NOT create it in target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf 2023-02-12 23:03:30,733 WARN [Listener at localhost/33645] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 23:03:30,733 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/hadoop.tmp.dir so I do NOT create it in target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf 2023-02-12 23:03:30,733 WARN [Listener at localhost/33645] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/53879042-72e8-4e5a-4e00-d8beabd0dd8f/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 23:03:30,733 DEBUG [Listener at localhost/33645] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf 2023-02-12 23:03:30,734 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 23:03:30,734 INFO [Listener at localhost/33645] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/cluster_b3c77a6c-332c-f8c9-38b3-7970cc896390, deleteOnExit=true 2023-02-12 23:03:30,734 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 23:03:30,734 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/test.cache.data in system properties and HBase conf 2023-02-12 23:03:30,734 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 23:03:30,734 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/hadoop.log.dir in system properties and HBase conf 2023-02-12 23:03:30,734 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 23:03:30,734 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 23:03:30,734 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 23:03:30,734 DEBUG [Listener at localhost/33645] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 23:03:30,735 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 23:03:30,735 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 23:03:30,735 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 23:03:30,735 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 23:03:30,735 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 23:03:30,735 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 23:03:30,735 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 23:03:30,735 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 23:03:30,735 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 23:03:30,735 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/nfs.dump.dir in system properties and HBase conf 2023-02-12 23:03:30,736 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/java.io.tmpdir in system properties and HBase conf 2023-02-12 23:03:30,736 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 23:03:30,736 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 23:03:30,736 INFO [Listener at localhost/33645] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 23:03:30,740 WARN [Listener at localhost/33645] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 23:03:30,740 WARN [Listener at localhost/33645] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 23:03:30,777 WARN [Listener at localhost/33645] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:30,779 INFO [Listener at localhost/33645] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:30,784 INFO [Listener at localhost/33645] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/java.io.tmpdir/Jetty_localhost_41727_hdfs____.lxf0af/webapp 2023-02-12 23:03:30,875 INFO [Listener at localhost/33645] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41727 2023-02-12 23:03:30,879 WARN [Listener at localhost/33645] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 23:03:30,879 WARN [Listener at localhost/33645] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 23:03:30,918 WARN [Listener at localhost/36899] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:30,935 WARN [Listener at localhost/36899] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 23:03:30,937 WARN [Listener at localhost/36899] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:30,938 INFO [Listener at localhost/36899] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:30,943 INFO [Listener at localhost/36899] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/java.io.tmpdir/Jetty_localhost_39663_datanode____.d0mks/webapp 2023-02-12 23:03:31,041 INFO [Listener at localhost/36899] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39663 2023-02-12 23:03:31,052 WARN [Listener at localhost/40933] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:31,070 WARN [Listener at localhost/40933] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 23:03:31,072 WARN [Listener at localhost/40933] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:31,073 INFO [Listener at localhost/40933] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:31,079 INFO [Listener at localhost/40933] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/java.io.tmpdir/Jetty_localhost_34021_datanode____6fwevp/webapp 2023-02-12 23:03:31,155 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8b3ab389f5c577d1: Processing first storage report for DS-0e582295-8321-45a0-8116-49fa301c57e5 from datanode f1ae33bc-a1cf-426c-9e32-6afe31acc638 2023-02-12 23:03:31,156 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8b3ab389f5c577d1: from storage DS-0e582295-8321-45a0-8116-49fa301c57e5 node DatanodeRegistration(127.0.0.1:43187, datanodeUuid=f1ae33bc-a1cf-426c-9e32-6afe31acc638, infoPort=46121, infoSecurePort=0, ipcPort=40933, storageInfo=lv=-57;cid=testClusterID;nsid=1381554170;c=1676243010742), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-12 23:03:31,156 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8b3ab389f5c577d1: Processing first storage report for DS-f59ebcd9-6ee3-4793-b0d2-a962e78b3dd0 from datanode f1ae33bc-a1cf-426c-9e32-6afe31acc638 2023-02-12 23:03:31,156 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8b3ab389f5c577d1: from storage DS-f59ebcd9-6ee3-4793-b0d2-a962e78b3dd0 node DatanodeRegistration(127.0.0.1:43187, datanodeUuid=f1ae33bc-a1cf-426c-9e32-6afe31acc638, infoPort=46121, infoSecurePort=0, ipcPort=40933, storageInfo=lv=-57;cid=testClusterID;nsid=1381554170;c=1676243010742), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:31,176 INFO [Listener at localhost/40933] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34021 2023-02-12 23:03:31,187 WARN [Listener at localhost/33219] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:31,291 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x396ad75638d67fc9: Processing first storage report for DS-091d83fe-36b1-409f-9ee6-b5a849a5d208 from datanode 98fdaec2-8d38-44a4-8bdb-d257f7786b6e 2023-02-12 23:03:31,291 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x396ad75638d67fc9: from storage DS-091d83fe-36b1-409f-9ee6-b5a849a5d208 node DatanodeRegistration(127.0.0.1:35249, datanodeUuid=98fdaec2-8d38-44a4-8bdb-d257f7786b6e, infoPort=32799, infoSecurePort=0, ipcPort=33219, storageInfo=lv=-57;cid=testClusterID;nsid=1381554170;c=1676243010742), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:31,291 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x396ad75638d67fc9: Processing first storage report for DS-af59dea6-23ec-41a5-a9d3-ec01c8a88da4 from datanode 98fdaec2-8d38-44a4-8bdb-d257f7786b6e 2023-02-12 23:03:31,291 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x396ad75638d67fc9: from storage DS-af59dea6-23ec-41a5-a9d3-ec01c8a88da4 node DatanodeRegistration(127.0.0.1:35249, datanodeUuid=98fdaec2-8d38-44a4-8bdb-d257f7786b6e, infoPort=32799, infoSecurePort=0, ipcPort=33219, storageInfo=lv=-57;cid=testClusterID;nsid=1381554170;c=1676243010742), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:31,296 DEBUG [Listener at localhost/33219] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf 2023-02-12 23:03:31,298 INFO [Listener at localhost/33219] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/cluster_b3c77a6c-332c-f8c9-38b3-7970cc896390/zookeeper_0, clientPort=57099, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/cluster_b3c77a6c-332c-f8c9-38b3-7970cc896390/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/cluster_b3c77a6c-332c-f8c9-38b3-7970cc896390/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 23:03:31,299 INFO [Listener at localhost/33219] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57099 2023-02-12 23:03:31,299 INFO [Listener at localhost/33219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:31,300 INFO [Listener at localhost/33219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:31,314 INFO [Listener at localhost/33219] util.FSUtils(479): Created version file at hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91 with version=8 2023-02-12 23:03:31,314 INFO [Listener at localhost/33219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:31,315 INFO [Listener at localhost/33219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:31,316 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/hbase-staging 2023-02-12 23:03:31,317 INFO [Listener at localhost/33219] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:31,318 INFO [Listener at localhost/33219] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:31,318 INFO [Listener at localhost/33219] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:31,318 INFO [Listener at localhost/33219] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:31,318 INFO [Listener at localhost/33219] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:31,318 INFO [Listener at localhost/33219] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:31,318 INFO [Listener at localhost/33219] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:31,319 INFO [Listener at localhost/33219] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43775 2023-02-12 23:03:31,319 INFO [Listener at localhost/33219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:31,320 INFO [Listener at localhost/33219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:31,320 INFO [Listener at localhost/33219] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43775 connecting to ZooKeeper ensemble=127.0.0.1:57099 2023-02-12 23:03:31,328 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:437750x0, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:31,329 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43775-0x1004ac670a60000 connected 2023-02-12 23:03:31,344 DEBUG [Listener at localhost/33219] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:31,345 DEBUG [Listener at localhost/33219] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:31,345 DEBUG [Listener at localhost/33219] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:31,348 DEBUG [Listener at localhost/33219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43775 2023-02-12 23:03:31,348 DEBUG [Listener at localhost/33219] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43775 2023-02-12 23:03:31,349 DEBUG [Listener at localhost/33219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43775 2023-02-12 23:03:31,350 DEBUG [Listener at localhost/33219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43775 2023-02-12 23:03:31,350 DEBUG [Listener at localhost/33219] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43775 2023-02-12 23:03:31,350 INFO [Listener at localhost/33219] master.HMaster(439): hbase.rootdir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91, hbase.cluster.distributed=false 2023-02-12 23:03:31,362 INFO [Listener at localhost/33219] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:31,362 INFO [Listener at localhost/33219] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:31,362 INFO [Listener at localhost/33219] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:31,362 INFO [Listener at localhost/33219] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:31,362 INFO [Listener at localhost/33219] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:31,362 INFO [Listener at localhost/33219] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:31,362 INFO [Listener at localhost/33219] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:31,364 INFO [Listener at localhost/33219] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38255 2023-02-12 23:03:31,364 INFO [Listener at localhost/33219] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 23:03:31,366 DEBUG [Listener at localhost/33219] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:31,366 INFO [Listener at localhost/33219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:31,367 INFO [Listener at localhost/33219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:31,368 INFO [Listener at localhost/33219] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38255 connecting to ZooKeeper ensemble=127.0.0.1:57099 2023-02-12 23:03:31,371 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:382550x0, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:31,373 DEBUG [Listener at localhost/33219] zookeeper.ZKUtil(164): regionserver:382550x0, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:31,373 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38255-0x1004ac670a60001 connected 2023-02-12 23:03:31,373 DEBUG [Listener at localhost/33219] zookeeper.ZKUtil(164): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:31,374 DEBUG [Listener at localhost/33219] zookeeper.ZKUtil(164): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:31,376 DEBUG [Listener at localhost/33219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38255 2023-02-12 23:03:31,376 DEBUG [Listener at localhost/33219] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38255 2023-02-12 23:03:31,376 DEBUG [Listener at localhost/33219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38255 2023-02-12 23:03:31,379 DEBUG [Listener at localhost/33219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38255 2023-02-12 23:03:31,380 DEBUG [Listener at localhost/33219] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38255 2023-02-12 23:03:31,390 INFO [Listener at localhost/33219] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:31,390 INFO [Listener at localhost/33219] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:31,390 INFO [Listener at localhost/33219] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:31,390 INFO [Listener at localhost/33219] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:31,390 INFO [Listener at localhost/33219] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:31,390 INFO [Listener at localhost/33219] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:31,391 INFO [Listener at localhost/33219] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:31,392 INFO [Listener at localhost/33219] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43427 2023-02-12 23:03:31,392 INFO [Listener at localhost/33219] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 23:03:31,393 DEBUG [Listener at localhost/33219] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:31,394 INFO [Listener at localhost/33219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:31,394 INFO [Listener at localhost/33219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:31,395 INFO [Listener at localhost/33219] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43427 connecting to ZooKeeper ensemble=127.0.0.1:57099 2023-02-12 23:03:31,398 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:434270x0, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:31,400 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43427-0x1004ac670a60002 connected 2023-02-12 23:03:31,400 DEBUG [Listener at localhost/33219] zookeeper.ZKUtil(164): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:31,400 DEBUG [Listener at localhost/33219] zookeeper.ZKUtil(164): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:31,400 DEBUG [Listener at localhost/33219] zookeeper.ZKUtil(164): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:31,404 DEBUG [Listener at localhost/33219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43427 2023-02-12 23:03:31,404 DEBUG [Listener at localhost/33219] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43427 2023-02-12 23:03:31,407 DEBUG [Listener at localhost/33219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43427 2023-02-12 23:03:31,407 DEBUG [Listener at localhost/33219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43427 2023-02-12 23:03:31,407 DEBUG [Listener at localhost/33219] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43427 2023-02-12 23:03:31,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43775,1676243011317 2023-02-12 23:03:31,410 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 23:03:31,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43775,1676243011317 2023-02-12 23:03:31,411 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:31,411 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:31,411 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:31,411 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:31,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 23:03:31,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 23:03:31,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43775,1676243011317 from backup master directory 2023-02-12 23:03:31,416 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43775,1676243011317 2023-02-12 23:03:31,416 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 23:03:31,416 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:31,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,43775,1676243011317 2023-02-12 23:03:31,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/hbase.id with ID: 5001973f-8d35-4e58-9272-35e86e4feb4e 2023-02-12 23:03:31,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:31,445 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:31,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x614a032e to 127.0.0.1:57099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:31,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ce6fc69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:31,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:31,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 23:03:31,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:31,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/MasterData/data/master/store-tmp 2023-02-12 23:03:31,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:31,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 23:03:31,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:31,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:31,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 23:03:31,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:31,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:31,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676243011470Disabling compacts and flushes for region at 1676243011470Disabling writes for close at 1676243011470Writing region close event to WAL at 1676243011470Closed at 1676243011470 2023-02-12 23:03:31,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/MasterData/WALs/jenkins-hbase4.apache.org,43775,1676243011317 2023-02-12 23:03:31,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43775%2C1676243011317, suffix=, logDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/MasterData/WALs/jenkins-hbase4.apache.org,43775,1676243011317, archiveDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/MasterData/oldWALs, maxLogs=10 2023-02-12 23:03:31,487 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35249,DS-091d83fe-36b1-409f-9ee6-b5a849a5d208,DISK] 2023-02-12 23:03:31,488 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43187,DS-0e582295-8321-45a0-8116-49fa301c57e5,DISK] 2023-02-12 23:03:31,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/MasterData/WALs/jenkins-hbase4.apache.org,43775,1676243011317/jenkins-hbase4.apache.org%2C43775%2C1676243011317.1676243011473 2023-02-12 23:03:31,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35249,DS-091d83fe-36b1-409f-9ee6-b5a849a5d208,DISK], DatanodeInfoWithStorage[127.0.0.1:43187,DS-0e582295-8321-45a0-8116-49fa301c57e5,DISK]] 2023-02-12 23:03:31,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:31,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:31,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:31,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:31,492 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:31,493 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 23:03:31,493 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 23:03:31,494 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:31,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:31,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:31,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:31,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:31,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69248082, jitterRate=0.031876832246780396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 23:03:31,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676243011490Initializing all the Stores at 1676243011491 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243011491Cleaning up temporary data from old regions at 1676243011495 (+4 ms)Cleaning up detritus from prior splits at 1676243011496 (+1 ms)Region opened successfully at 1676243011501 (+5 ms) 2023-02-12 23:03:31,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 23:03:31,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 23:03:31,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 23:03:31,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 23:03:31,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 23:03:31,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 23:03:31,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 23:03:31,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 23:03:31,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 23:03:31,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 23:03:31,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 23:03:31,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 23:03:31,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 23:03:31,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 23:03:31,520 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:31,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 23:03:31,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 23:03:31,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 23:03:31,524 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:31,524 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:31,524 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:31,524 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:31,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,43775,1676243011317, sessionid=0x1004ac670a60000, setting cluster-up flag (Was=false) 2023-02-12 23:03:31,528 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:31,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 23:03:31,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43775,1676243011317 2023-02-12 23:03:31,537 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:31,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 23:03:31,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43775,1676243011317 2023-02-12 23:03:31,546 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.hbase-snapshot/.tmp 2023-02-12 23:03:31,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:31,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:31,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:31,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:31,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:31,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 23:03:31,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:31,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676243041556 2023-02-12 23:03:31,556 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:31,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 23:03:31,556 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 23:03:31,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 23:03:31,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 23:03:31,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 23:03:31,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 23:03:31,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 23:03:31,557 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:31,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 23:03:31,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 23:03:31,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 23:03:31,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 23:03:31,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 23:03:31,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676243011568,5,FailOnTimeoutGroup] 2023-02-12 23:03:31,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676243011568,5,FailOnTimeoutGroup] 2023-02-12 23:03:31,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 23:03:31,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,576 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:31,576 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:31,576 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91 2023-02-12 23:03:31,583 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:31,585 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 23:03:31,586 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/info 2023-02-12 23:03:31,587 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 23:03:31,587 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:31,587 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 23:03:31,589 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:31,589 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 23:03:31,589 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:31,590 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 23:03:31,591 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/table 2023-02-12 23:03:31,591 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 23:03:31,591 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:31,592 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740 2023-02-12 23:03:31,592 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740 2023-02-12 23:03:31,594 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 23:03:31,595 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 23:03:31,597 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:31,597 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70597195, jitterRate=0.05198018252849579}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 23:03:31,597 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676243011584Initializing all the Stores at 1676243011584Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243011584Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243011585 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243011585Cleaning up temporary data from old regions at 1676243011593 (+8 ms)Cleaning up detritus from prior splits at 1676243011594 (+1 ms)Region opened successfully at 1676243011597 (+3 ms) 2023-02-12 23:03:31,597 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 23:03:31,597 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 23:03:31,597 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 23:03:31,597 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 23:03:31,597 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 23:03:31,598 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:31,598 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676243011597Disabling compacts and flushes for region at 1676243011597Disabling writes for close at 1676243011597Writing region close event to WAL at 1676243011598 (+1 ms)Closed at 1676243011598 2023-02-12 23:03:31,598 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:31,599 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 23:03:31,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 23:03:31,600 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 23:03:31,602 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 23:03:31,609 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(952): ClusterId : 5001973f-8d35-4e58-9272-35e86e4feb4e 2023-02-12 23:03:31,609 INFO [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer(952): ClusterId : 5001973f-8d35-4e58-9272-35e86e4feb4e 2023-02-12 23:03:31,609 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 23:03:31,609 DEBUG [RS:1;jenkins-hbase4:43427] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 23:03:31,612 DEBUG [RS:1;jenkins-hbase4:43427] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 23:03:31,612 DEBUG [RS:1;jenkins-hbase4:43427] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 23:03:31,613 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 23:03:31,613 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 23:03:31,614 DEBUG [RS:1;jenkins-hbase4:43427] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 23:03:31,616 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 23:03:31,616 DEBUG [RS:1;jenkins-hbase4:43427] zookeeper.ReadOnlyZKClient(139): Connect 0x35c61840 to 127.0.0.1:57099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:31,617 DEBUG [RS:0;jenkins-hbase4:38255] zookeeper.ReadOnlyZKClient(139): Connect 0x4a0de644 to 127.0.0.1:57099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:31,626 DEBUG [RS:1;jenkins-hbase4:43427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b01f088, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:31,626 DEBUG [RS:0;jenkins-hbase4:38255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44ca0175, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:31,626 DEBUG [RS:1;jenkins-hbase4:43427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f3e7330, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:31,626 DEBUG [RS:0;jenkins-hbase4:38255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40f58d34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:31,635 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38255 2023-02-12 23:03:31,635 INFO [RS:0;jenkins-hbase4:38255] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 23:03:31,635 INFO [RS:0;jenkins-hbase4:38255] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 23:03:31,635 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 23:03:31,635 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43775,1676243011317 with isa=jenkins-hbase4.apache.org/172.31.14.131:38255, startcode=1676243011361 2023-02-12 23:03:31,635 DEBUG [RS:0;jenkins-hbase4:38255] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 23:03:31,637 DEBUG [RS:1;jenkins-hbase4:43427] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43427 2023-02-12 23:03:31,637 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49345, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 23:03:31,637 INFO [RS:1;jenkins-hbase4:43427] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 23:03:31,638 INFO [RS:1;jenkins-hbase4:43427] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 23:03:31,638 DEBUG [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 23:03:31,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:31,639 INFO [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43775,1676243011317 with isa=jenkins-hbase4.apache.org/172.31.14.131:43427, startcode=1676243011390 2023-02-12 23:03:31,639 DEBUG [RS:1;jenkins-hbase4:43427] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 23:03:31,640 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91 2023-02-12 23:03:31,640 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36899 2023-02-12 23:03:31,640 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 23:03:31,641 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:31,642 DEBUG [RS:0;jenkins-hbase4:38255] zookeeper.ZKUtil(162): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:31,642 WARN [RS:0;jenkins-hbase4:38255] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:31,642 INFO [RS:0;jenkins-hbase4:38255] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:31,642 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/WALs/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:31,645 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38255,1676243011361] 2023-02-12 23:03:31,645 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59331, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 23:03:31,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:31,648 DEBUG [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91 2023-02-12 23:03:31,648 DEBUG [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36899 2023-02-12 23:03:31,648 DEBUG [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 23:03:31,652 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:31,652 DEBUG [RS:1;jenkins-hbase4:43427] zookeeper.ZKUtil(162): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:31,652 DEBUG [RS:0;jenkins-hbase4:38255] zookeeper.ZKUtil(162): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:31,652 WARN [RS:1;jenkins-hbase4:43427] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:31,652 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43427,1676243011390] 2023-02-12 23:03:31,652 INFO [RS:1;jenkins-hbase4:43427] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:31,652 DEBUG [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/WALs/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:31,652 DEBUG [RS:0;jenkins-hbase4:38255] zookeeper.ZKUtil(162): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:31,654 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 23:03:31,655 INFO [RS:0;jenkins-hbase4:38255] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 23:03:31,656 DEBUG [RS:1;jenkins-hbase4:43427] zookeeper.ZKUtil(162): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:31,656 DEBUG [RS:1;jenkins-hbase4:43427] zookeeper.ZKUtil(162): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:31,657 DEBUG [RS:1;jenkins-hbase4:43427] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 23:03:31,657 INFO [RS:1;jenkins-hbase4:43427] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 23:03:31,657 INFO [RS:0;jenkins-hbase4:38255] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 23:03:31,660 INFO [RS:0;jenkins-hbase4:38255] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 23:03:31,660 INFO [RS:1;jenkins-hbase4:43427] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 23:03:31,660 INFO [RS:0;jenkins-hbase4:38255] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,660 INFO [RS:1;jenkins-hbase4:43427] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 23:03:31,660 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 23:03:31,660 INFO [RS:1;jenkins-hbase4:43427] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,661 INFO [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 23:03:31,662 INFO [RS:0;jenkins-hbase4:38255] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,662 INFO [RS:1;jenkins-hbase4:43427] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,662 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,662 DEBUG [RS:1;jenkins-hbase4:43427] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,662 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,662 DEBUG [RS:1;jenkins-hbase4:43427] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,662 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,662 DEBUG [RS:1;jenkins-hbase4:43427] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,662 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,662 DEBUG [RS:1;jenkins-hbase4:43427] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,662 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,662 DEBUG [RS:1;jenkins-hbase4:43427] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,662 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:31,662 DEBUG [RS:1;jenkins-hbase4:43427] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:31,662 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,662 DEBUG [RS:1;jenkins-hbase4:43427] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,663 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,663 DEBUG [RS:1;jenkins-hbase4:43427] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,663 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,663 DEBUG [RS:1;jenkins-hbase4:43427] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,663 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,663 DEBUG [RS:1;jenkins-hbase4:43427] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:31,668 INFO [RS:0;jenkins-hbase4:38255] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,668 INFO [RS:1;jenkins-hbase4:43427] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,668 INFO [RS:0;jenkins-hbase4:38255] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,668 INFO [RS:1;jenkins-hbase4:43427] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,668 INFO [RS:0;jenkins-hbase4:38255] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,668 INFO [RS:1;jenkins-hbase4:43427] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,679 INFO [RS:0;jenkins-hbase4:38255] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 23:03:31,679 INFO [RS:1;jenkins-hbase4:43427] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 23:03:31,679 INFO [RS:0;jenkins-hbase4:38255] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38255,1676243011361-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,679 INFO [RS:1;jenkins-hbase4:43427] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43427,1676243011390-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,689 INFO [RS:0;jenkins-hbase4:38255] regionserver.Replication(203): jenkins-hbase4.apache.org,38255,1676243011361 started 2023-02-12 23:03:31,689 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38255,1676243011361, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38255, sessionid=0x1004ac670a60001 2023-02-12 23:03:31,690 INFO [RS:1;jenkins-hbase4:43427] regionserver.Replication(203): jenkins-hbase4.apache.org,43427,1676243011390 started 2023-02-12 23:03:31,690 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 23:03:31,690 INFO [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43427,1676243011390, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43427, sessionid=0x1004ac670a60002 2023-02-12 23:03:31,690 DEBUG [RS:0;jenkins-hbase4:38255] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:31,690 DEBUG [RS:1;jenkins-hbase4:43427] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 23:03:31,690 DEBUG [RS:1;jenkins-hbase4:43427] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:31,690 DEBUG [RS:1;jenkins-hbase4:43427] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43427,1676243011390' 2023-02-12 23:03:31,690 DEBUG [RS:1;jenkins-hbase4:43427] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:31,690 DEBUG [RS:0;jenkins-hbase4:38255] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38255,1676243011361' 2023-02-12 23:03:31,690 DEBUG [RS:0;jenkins-hbase4:38255] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:31,691 DEBUG [RS:1;jenkins-hbase4:43427] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:31,691 DEBUG [RS:0;jenkins-hbase4:38255] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:31,691 DEBUG [RS:1;jenkins-hbase4:43427] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 23:03:31,691 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 23:03:31,691 DEBUG [RS:1;jenkins-hbase4:43427] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 23:03:31,691 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 23:03:31,691 DEBUG [RS:1;jenkins-hbase4:43427] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:31,691 DEBUG [RS:1;jenkins-hbase4:43427] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43427,1676243011390' 2023-02-12 23:03:31,691 DEBUG [RS:1;jenkins-hbase4:43427] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:31,691 DEBUG [RS:0;jenkins-hbase4:38255] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:31,691 DEBUG [RS:0;jenkins-hbase4:38255] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38255,1676243011361' 2023-02-12 23:03:31,691 DEBUG [RS:0;jenkins-hbase4:38255] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:31,691 DEBUG [RS:1;jenkins-hbase4:43427] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:31,691 DEBUG [RS:0;jenkins-hbase4:38255] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:31,692 DEBUG [RS:1;jenkins-hbase4:43427] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 23:03:31,692 INFO [RS:1;jenkins-hbase4:43427] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 23:03:31,692 INFO [RS:1;jenkins-hbase4:43427] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 23:03:31,692 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 23:03:31,692 INFO [RS:0;jenkins-hbase4:38255] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 23:03:31,692 INFO [RS:0;jenkins-hbase4:38255] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 23:03:31,752 DEBUG [jenkins-hbase4:43775] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 23:03:31,752 DEBUG [jenkins-hbase4:43775] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:31,754 DEBUG [jenkins-hbase4:43775] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:31,754 DEBUG [jenkins-hbase4:43775] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:31,754 DEBUG [jenkins-hbase4:43775] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:31,755 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38255,1676243011361, state=OPENING 2023-02-12 23:03:31,757 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 23:03:31,758 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:31,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38255,1676243011361}] 2023-02-12 23:03:31,758 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 23:03:31,913 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:31,913 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 23:03:31,915 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47756, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 23:03:31,919 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 23:03:31,919 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:31,921 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38255%2C1676243011361.meta, suffix=.meta, logDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/WALs/jenkins-hbase4.apache.org,38255,1676243011361, archiveDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/oldWALs, maxLogs=32 2023-02-12 23:03:31,935 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43187,DS-0e582295-8321-45a0-8116-49fa301c57e5,DISK] 2023-02-12 23:03:31,935 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35249,DS-091d83fe-36b1-409f-9ee6-b5a849a5d208,DISK] 2023-02-12 23:03:31,937 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/WALs/jenkins-hbase4.apache.org,38255,1676243011361/jenkins-hbase4.apache.org%2C38255%2C1676243011361.meta.1676243011921.meta 2023-02-12 23:03:31,937 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43187,DS-0e582295-8321-45a0-8116-49fa301c57e5,DISK], DatanodeInfoWithStorage[127.0.0.1:35249,DS-091d83fe-36b1-409f-9ee6-b5a849a5d208,DISK]] 2023-02-12 23:03:31,937 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:31,938 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 23:03:31,938 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 23:03:31,938 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 23:03:31,938 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 23:03:31,938 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:31,938 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 23:03:31,938 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 23:03:31,939 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 23:03:31,940 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/info 2023-02-12 23:03:31,940 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/info 2023-02-12 23:03:31,940 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 23:03:31,941 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:31,941 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 23:03:31,941 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:31,941 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:31,942 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 23:03:31,942 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:31,942 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 23:03:31,943 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/table 2023-02-12 23:03:31,943 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/table 2023-02-12 23:03:31,943 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 23:03:31,943 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:31,944 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740 2023-02-12 23:03:31,945 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740 2023-02-12 23:03:31,946 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 23:03:31,947 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 23:03:31,948 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71270105, jitterRate=0.062007322907447815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 23:03:31,948 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676243011938Writing region info on filesystem at 1676243011938Initializing all the Stores at 1676243011939 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243011939Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243011939Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243011939Cleaning up temporary data from old regions at 1676243011945 (+6 ms)Cleaning up detritus from prior splits at 1676243011946 (+1 ms)Running coprocessor post-open hooks at 1676243011948 (+2 ms)Region opened successfully at 1676243011948 2023-02-12 23:03:31,948 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676243011913 2023-02-12 23:03:31,953 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 23:03:31,953 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38255,1676243011361, state=OPEN 2023-02-12 23:03:31,955 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 23:03:31,955 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 23:03:31,956 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 23:03:31,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 23:03:31,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38255,1676243011361 in 197 msec 2023-02-12 23:03:31,958 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 23:03:31,958 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 358 msec 2023-02-12 23:03:31,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 412 msec 2023-02-12 23:03:31,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676243011410, completionTime=-1 2023-02-12 23:03:31,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 23:03:31,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 23:03:31,962 DEBUG [hconnection-0x3a45b05c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:31,964 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47758, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:31,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 23:03:31,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676243071965 2023-02-12 23:03:31,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676243131965 2023-02-12 23:03:31,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-12 23:03:31,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43775,1676243011317-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43775,1676243011317-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43775,1676243011317-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43775, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:31,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 23:03:31,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:31,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 23:03:31,977 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 23:03:31,978 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 23:03:31,979 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 23:03:31,980 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/hbase/namespace/ca6233a40fca5e27127fec6bcdd7c7b6 2023-02-12 23:03:31,980 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/hbase/namespace/ca6233a40fca5e27127fec6bcdd7c7b6 empty. 2023-02-12 23:03:31,981 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/hbase/namespace/ca6233a40fca5e27127fec6bcdd7c7b6 2023-02-12 23:03:31,981 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 23:03:31,992 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:31,993 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => ca6233a40fca5e27127fec6bcdd7c7b6, NAME => 'hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp 2023-02-12 23:03:32,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:32,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing ca6233a40fca5e27127fec6bcdd7c7b6, disabling compactions & flushes 2023-02-12 23:03:32,007 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6. 2023-02-12 23:03:32,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6. 2023-02-12 23:03:32,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6. after waiting 0 ms 2023-02-12 23:03:32,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6. 2023-02-12 23:03:32,007 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6. 2023-02-12 23:03:32,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for ca6233a40fca5e27127fec6bcdd7c7b6: Waiting for close lock at 1676243012007Disabling compacts and flushes for region at 1676243012007Disabling writes for close at 1676243012007Writing region close event to WAL at 1676243012007Closed at 1676243012007 2023-02-12 23:03:32,010 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 23:03:32,011 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676243012011"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243012011"}]},"ts":"1676243012011"} 2023-02-12 23:03:32,013 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 23:03:32,014 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 23:03:32,014 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243012014"}]},"ts":"1676243012014"} 2023-02-12 23:03:32,015 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 23:03:32,019 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:32,020 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:32,020 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:32,020 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:32,022 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ca6233a40fca5e27127fec6bcdd7c7b6, ASSIGN}] 2023-02-12 23:03:32,026 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ca6233a40fca5e27127fec6bcdd7c7b6, ASSIGN 2023-02-12 23:03:32,027 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ca6233a40fca5e27127fec6bcdd7c7b6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43427,1676243011390; forceNewPlan=false, retain=false 2023-02-12 23:03:32,178 INFO [jenkins-hbase4:43775] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 23:03:32,179 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ca6233a40fca5e27127fec6bcdd7c7b6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:32,179 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676243012179"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243012179"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243012179"}]},"ts":"1676243012179"} 2023-02-12 23:03:32,181 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ca6233a40fca5e27127fec6bcdd7c7b6, server=jenkins-hbase4.apache.org,43427,1676243011390}] 2023-02-12 23:03:32,334 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:32,334 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 23:03:32,336 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44772, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 23:03:32,340 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6. 2023-02-12 23:03:32,345 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43427%2C1676243011390, suffix=, logDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/WALs/jenkins-hbase4.apache.org,43427,1676243011390, archiveDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/oldWALs, maxLogs=32 2023-02-12 23:03:32,361 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35249,DS-091d83fe-36b1-409f-9ee6-b5a849a5d208,DISK] 2023-02-12 23:03:32,361 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43187,DS-0e582295-8321-45a0-8116-49fa301c57e5,DISK] 2023-02-12 23:03:32,367 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/WALs/jenkins-hbase4.apache.org,43427,1676243011390/jenkins-hbase4.apache.org%2C43427%2C1676243011390.1676243012345 2023-02-12 23:03:32,367 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35249,DS-091d83fe-36b1-409f-9ee6-b5a849a5d208,DISK], DatanodeInfoWithStorage[127.0.0.1:43187,DS-0e582295-8321-45a0-8116-49fa301c57e5,DISK]] 2023-02-12 23:03:32,367 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ca6233a40fca5e27127fec6bcdd7c7b6, NAME => 'hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:32,367 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ca6233a40fca5e27127fec6bcdd7c7b6 2023-02-12 23:03:32,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:32,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ca6233a40fca5e27127fec6bcdd7c7b6 2023-02-12 23:03:32,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ca6233a40fca5e27127fec6bcdd7c7b6 2023-02-12 23:03:32,372 INFO [StoreOpener-ca6233a40fca5e27127fec6bcdd7c7b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ca6233a40fca5e27127fec6bcdd7c7b6 2023-02-12 23:03:32,373 DEBUG [StoreOpener-ca6233a40fca5e27127fec6bcdd7c7b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/namespace/ca6233a40fca5e27127fec6bcdd7c7b6/info 2023-02-12 23:03:32,373 DEBUG [StoreOpener-ca6233a40fca5e27127fec6bcdd7c7b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/namespace/ca6233a40fca5e27127fec6bcdd7c7b6/info 2023-02-12 23:03:32,374 INFO [StoreOpener-ca6233a40fca5e27127fec6bcdd7c7b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca6233a40fca5e27127fec6bcdd7c7b6 columnFamilyName info 2023-02-12 23:03:32,374 INFO [StoreOpener-ca6233a40fca5e27127fec6bcdd7c7b6-1] regionserver.HStore(310): Store=ca6233a40fca5e27127fec6bcdd7c7b6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:32,375 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/namespace/ca6233a40fca5e27127fec6bcdd7c7b6 2023-02-12 23:03:32,375 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/namespace/ca6233a40fca5e27127fec6bcdd7c7b6 2023-02-12 23:03:32,378 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ca6233a40fca5e27127fec6bcdd7c7b6 2023-02-12 23:03:32,380 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/namespace/ca6233a40fca5e27127fec6bcdd7c7b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:32,381 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ca6233a40fca5e27127fec6bcdd7c7b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60745770, jitterRate=-0.09481748938560486}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 23:03:32,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ca6233a40fca5e27127fec6bcdd7c7b6: Running coprocessor pre-open hook at 1676243012368Writing region info on filesystem at 1676243012368Initializing all the Stores at 1676243012369 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243012369Cleaning up temporary data from old regions at 1676243012376 (+7 ms)Cleaning up detritus from prior splits at 1676243012376Running coprocessor post-open hooks at 1676243012381 (+5 ms)Region opened successfully at 1676243012381 2023-02-12 23:03:32,381 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6., pid=6, masterSystemTime=1676243012334 2023-02-12 23:03:32,387 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6. 2023-02-12 23:03:32,388 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6. 2023-02-12 23:03:32,388 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ca6233a40fca5e27127fec6bcdd7c7b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:32,388 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676243012388"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243012388"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243012388"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243012388"}]},"ts":"1676243012388"} 2023-02-12 23:03:32,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 23:03:32,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ca6233a40fca5e27127fec6bcdd7c7b6, server=jenkins-hbase4.apache.org,43427,1676243011390 in 208 msec 2023-02-12 23:03:32,393 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 23:03:32,393 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ca6233a40fca5e27127fec6bcdd7c7b6, ASSIGN in 371 msec 2023-02-12 23:03:32,393 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 23:03:32,393 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243012393"}]},"ts":"1676243012393"} 2023-02-12 23:03:32,395 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 23:03:32,397 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 23:03:32,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 422 msec 2023-02-12 23:03:32,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 23:03:32,480 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:32,480 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:32,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:32,484 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44778, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:32,486 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 23:03:32,495 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:32,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-12 23:03:32,508 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 23:03:32,517 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:32,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-02-12 23:03:32,533 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 23:03:32,535 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 23:03:32,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.118sec 2023-02-12 23:03:32,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 23:03:32,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 23:03:32,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 23:03:32,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43775,1676243011317-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 23:03:32,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43775,1676243011317-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 23:03:32,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 23:03:32,610 DEBUG [Listener at localhost/33219] zookeeper.ReadOnlyZKClient(139): Connect 0x26587e08 to 127.0.0.1:57099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:32,615 DEBUG [Listener at localhost/33219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@728f52ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:32,616 DEBUG [hconnection-0x2a6947ac-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:32,618 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47770, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:32,619 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43775,1676243011317 2023-02-12 23:03:32,619 DEBUG [Listener at localhost/33219] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 23:03:32,621 DEBUG [Listener at localhost/33219] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 23:03:32,622 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53738, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 23:03:32,623 INFO [Listener at localhost/33219] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-12 23:03:32,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-12 23:03:32,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 23:03:32,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:53738 deadline: 1676243072623, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-12 23:03:32,624 INFO [Listener at localhost/33219] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-12 23:03:32,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:32,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:32,628 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 23:03:32,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-12 23:03:32,629 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 23:03:32,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:32,635 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:32,635 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:32,635 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:32,635 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d 2023-02-12 23:03:32,635 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:32,635 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:32,635 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:32,635 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:32,636 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3 empty. 2023-02-12 23:03:32,636 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033 empty. 2023-02-12 23:03:32,636 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb empty. 2023-02-12 23:03:32,636 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238 empty. 2023-02-12 23:03:32,636 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d empty. 2023-02-12 23:03:32,636 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:32,636 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:32,636 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:32,636 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:32,636 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb empty. 2023-02-12 23:03:32,636 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f empty. 2023-02-12 23:03:32,637 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55 empty. 2023-02-12 23:03:32,637 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:32,637 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d 2023-02-12 23:03:32,637 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602 empty. 2023-02-12 23:03:32,637 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006 empty. 2023-02-12 23:03:32,637 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:32,637 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:32,637 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:32,637 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:32,637 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:32,637 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:32,637 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-12 23:03:32,646 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:32,648 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 255f26913e54145c6d5d7715ff69352f, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp 2023-02-12 23:03:32,648 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 427c9bd94355639bcfaa338199010ecb, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp 2023-02-12 23:03:32,648 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 55fb2b8f1ac8b47848e354e0e6897bb3, NAME => 'testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp 2023-02-12 23:03:32,660 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:32,660 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:32,660 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 255f26913e54145c6d5d7715ff69352f, disabling compactions & flushes 2023-02-12 23:03:32,660 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:32,660 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:32,660 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 427c9bd94355639bcfaa338199010ecb, disabling compactions & flushes 2023-02-12 23:03:32,660 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. after waiting 0 ms 2023-02-12 23:03:32,660 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:32,660 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:32,660 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:32,660 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:32,660 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. after waiting 0 ms 2023-02-12 23:03:32,660 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:32,660 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 255f26913e54145c6d5d7715ff69352f: Waiting for close lock at 1676243012660Disabling compacts and flushes for region at 1676243012660Disabling writes for close at 1676243012660Writing region close event to WAL at 1676243012660Closed at 1676243012660 2023-02-12 23:03:32,660 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 55fb2b8f1ac8b47848e354e0e6897bb3, disabling compactions & flushes 2023-02-12 23:03:32,660 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:32,661 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:32,661 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 427c9bd94355639bcfaa338199010ecb: Waiting for close lock at 1676243012660Disabling compacts and flushes for region at 1676243012660Disabling writes for close at 1676243012660Writing region close event to WAL at 1676243012661 (+1 ms)Closed at 1676243012661 2023-02-12 23:03:32,661 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => b73c6c0b74cbd1b10bb1518dd12c20fb, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp 2023-02-12 23:03:32,698 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3cf12bce3359ee882a269ccd1199fb55, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp 2023-02-12 23:03:32,698 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:32,698 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:32,698 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. after waiting 0 ms 2023-02-12 23:03:32,698 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:32,701 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:32,701 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 55fb2b8f1ac8b47848e354e0e6897bb3: Waiting for close lock at 1676243012660Disabling compacts and flushes for region at 1676243012660Disabling writes for close at 1676243012698 (+38 ms)Writing region close event to WAL at 1676243012701 (+3 ms)Closed at 1676243012701 2023-02-12 23:03:32,703 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => b0d590d5f4bbfca780b0295e86761238, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp 2023-02-12 23:03:32,705 INFO [RS:0;jenkins-hbase4:38255] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38255%2C1676243011361, suffix=, logDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/WALs/jenkins-hbase4.apache.org,38255,1676243011361, archiveDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/oldWALs, maxLogs=32 2023-02-12 23:03:32,719 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43187,DS-0e582295-8321-45a0-8116-49fa301c57e5,DISK] 2023-02-12 23:03:32,719 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35249,DS-091d83fe-36b1-409f-9ee6-b5a849a5d208,DISK] 2023-02-12 23:03:32,722 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:32,722 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 3cf12bce3359ee882a269ccd1199fb55, disabling compactions & flushes 2023-02-12 23:03:32,722 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:32,722 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:32,722 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. after waiting 0 ms 2023-02-12 23:03:32,722 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:32,722 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:32,722 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 3cf12bce3359ee882a269ccd1199fb55: Waiting for close lock at 1676243012722Disabling compacts and flushes for region at 1676243012722Disabling writes for close at 1676243012722Writing region close event to WAL at 1676243012722Closed at 1676243012722 2023-02-12 23:03:32,723 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => a67157f758d5013ff72d7e85b49d9033, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp 2023-02-12 23:03:32,723 INFO [RS:0;jenkins-hbase4:38255] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/WALs/jenkins-hbase4.apache.org,38255,1676243011361/jenkins-hbase4.apache.org%2C38255%2C1676243011361.1676243012705 2023-02-12 23:03:32,723 DEBUG [RS:0;jenkins-hbase4:38255] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43187,DS-0e582295-8321-45a0-8116-49fa301c57e5,DISK], DatanodeInfoWithStorage[127.0.0.1:35249,DS-091d83fe-36b1-409f-9ee6-b5a849a5d208,DISK]] 2023-02-12 23:03:32,725 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:32,725 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing b0d590d5f4bbfca780b0295e86761238, disabling compactions & flushes 2023-02-12 23:03:32,726 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:32,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:32,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. after waiting 0 ms 2023-02-12 23:03:32,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:32,726 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:32,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for b0d590d5f4bbfca780b0295e86761238: Waiting for close lock at 1676243012725Disabling compacts and flushes for region at 1676243012725Disabling writes for close at 1676243012726 (+1 ms)Writing region close event to WAL at 1676243012726Closed at 1676243012726 2023-02-12 23:03:32,726 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3118215613336d661d6901cc41de476d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp 2023-02-12 23:03:32,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:32,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:32,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing a67157f758d5013ff72d7e85b49d9033, disabling compactions & flushes 2023-02-12 23:03:32,742 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:32,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:32,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. after waiting 0 ms 2023-02-12 23:03:32,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:32,742 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:32,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for a67157f758d5013ff72d7e85b49d9033: Waiting for close lock at 1676243012742Disabling compacts and flushes for region at 1676243012742Disabling writes for close at 1676243012742Writing region close event to WAL at 1676243012742Closed at 1676243012742 2023-02-12 23:03:32,743 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => e128cbc418893503ff50d6c088a6d006, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp 2023-02-12 23:03:32,743 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:32,743 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 3118215613336d661d6901cc41de476d, disabling compactions & flushes 2023-02-12 23:03:32,743 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:32,744 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:32,744 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. after waiting 0 ms 2023-02-12 23:03:32,744 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:32,744 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:32,744 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 3118215613336d661d6901cc41de476d: Waiting for close lock at 1676243012743Disabling compacts and flushes for region at 1676243012743Disabling writes for close at 1676243012744 (+1 ms)Writing region close event to WAL at 1676243012744Closed at 1676243012744 2023-02-12 23:03:32,744 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => df920b05b5c05a2bf111eb40ef564602, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp 2023-02-12 23:03:32,752 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:32,752 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing e128cbc418893503ff50d6c088a6d006, disabling compactions & flushes 2023-02-12 23:03:32,752 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:32,752 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:32,752 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. after waiting 0 ms 2023-02-12 23:03:32,752 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:32,752 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:32,752 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for e128cbc418893503ff50d6c088a6d006: Waiting for close lock at 1676243012752Disabling compacts and flushes for region at 1676243012752Disabling writes for close at 1676243012752Writing region close event to WAL at 1676243012752Closed at 1676243012752 2023-02-12 23:03:32,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:32,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing df920b05b5c05a2bf111eb40ef564602, disabling compactions & flushes 2023-02-12 23:03:32,754 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:32,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:32,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. after waiting 0 ms 2023-02-12 23:03:32,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:32,754 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:32,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for df920b05b5c05a2bf111eb40ef564602: Waiting for close lock at 1676243012754Disabling compacts and flushes for region at 1676243012754Disabling writes for close at 1676243012754Writing region close event to WAL at 1676243012754Closed at 1676243012754 2023-02-12 23:03:32,787 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 23:03:32,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:33,119 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:33,119 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing b73c6c0b74cbd1b10bb1518dd12c20fb, disabling compactions & flushes 2023-02-12 23:03:33,119 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:33,119 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:33,119 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. after waiting 0 ms 2023-02-12 23:03:33,119 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:33,119 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:33,119 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for b73c6c0b74cbd1b10bb1518dd12c20fb: Waiting for close lock at 1676243013119Disabling compacts and flushes for region at 1676243013119Disabling writes for close at 1676243013119Writing region close event to WAL at 1676243013119Closed at 1676243013119 2023-02-12 23:03:33,122 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 23:03:33,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676243012625.255f26913e54145c6d5d7715ff69352f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243013123"}]},"ts":"1676243013123"} 2023-02-12 23:03:33,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243013123"}]},"ts":"1676243013123"} 2023-02-12 23:03:33,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676243013123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243013123"}]},"ts":"1676243013123"} 2023-02-12 23:03:33,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243013123"}]},"ts":"1676243013123"} 2023-02-12 23:03:33,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243013123"}]},"ts":"1676243013123"} 2023-02-12 23:03:33,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243013123"}]},"ts":"1676243013123"} 2023-02-12 23:03:33,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243013123"}]},"ts":"1676243013123"} 2023-02-12 23:03:33,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243013123"}]},"ts":"1676243013123"} 2023-02-12 23:03:33,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676243013123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243013123"}]},"ts":"1676243013123"} 2023-02-12 23:03:33,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243013123"}]},"ts":"1676243013123"} 2023-02-12 23:03:33,125 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-12 23:03:33,126 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 23:03:33,126 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243013126"}]},"ts":"1676243013126"} 2023-02-12 23:03:33,127 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-12 23:03:33,130 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:33,136 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:33,136 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:33,136 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:33,136 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55fb2b8f1ac8b47848e354e0e6897bb3, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=427c9bd94355639bcfaa338199010ecb, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=255f26913e54145c6d5d7715ff69352f, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b73c6c0b74cbd1b10bb1518dd12c20fb, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3cf12bce3359ee882a269ccd1199fb55, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0d590d5f4bbfca780b0295e86761238, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a67157f758d5013ff72d7e85b49d9033, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3118215613336d661d6901cc41de476d, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e128cbc418893503ff50d6c088a6d006, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=df920b05b5c05a2bf111eb40ef564602, ASSIGN}] 2023-02-12 23:03:33,138 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55fb2b8f1ac8b47848e354e0e6897bb3, ASSIGN 2023-02-12 23:03:33,138 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b73c6c0b74cbd1b10bb1518dd12c20fb, ASSIGN 2023-02-12 23:03:33,138 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=255f26913e54145c6d5d7715ff69352f, ASSIGN 2023-02-12 23:03:33,138 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=427c9bd94355639bcfaa338199010ecb, ASSIGN 2023-02-12 23:03:33,139 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55fb2b8f1ac8b47848e354e0e6897bb3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38255,1676243011361; forceNewPlan=false, retain=false 2023-02-12 23:03:33,139 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b73c6c0b74cbd1b10bb1518dd12c20fb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43427,1676243011390; forceNewPlan=false, retain=false 2023-02-12 23:03:33,139 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=255f26913e54145c6d5d7715ff69352f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38255,1676243011361; forceNewPlan=false, retain=false 2023-02-12 23:03:33,139 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=427c9bd94355639bcfaa338199010ecb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43427,1676243011390; forceNewPlan=false, retain=false 2023-02-12 23:03:33,139 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=df920b05b5c05a2bf111eb40ef564602, ASSIGN 2023-02-12 23:03:33,140 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e128cbc418893503ff50d6c088a6d006, ASSIGN 2023-02-12 23:03:33,140 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=df920b05b5c05a2bf111eb40ef564602, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38255,1676243011361; forceNewPlan=false, retain=false 2023-02-12 23:03:33,140 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3118215613336d661d6901cc41de476d, ASSIGN 2023-02-12 23:03:33,140 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a67157f758d5013ff72d7e85b49d9033, ASSIGN 2023-02-12 23:03:33,140 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0d590d5f4bbfca780b0295e86761238, ASSIGN 2023-02-12 23:03:33,141 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e128cbc418893503ff50d6c088a6d006, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43427,1676243011390; forceNewPlan=false, retain=false 2023-02-12 23:03:33,141 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a67157f758d5013ff72d7e85b49d9033, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43427,1676243011390; forceNewPlan=false, retain=false 2023-02-12 23:03:33,141 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3118215613336d661d6901cc41de476d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38255,1676243011361; forceNewPlan=false, retain=false 2023-02-12 23:03:33,141 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3cf12bce3359ee882a269ccd1199fb55, ASSIGN 2023-02-12 23:03:33,141 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0d590d5f4bbfca780b0295e86761238, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38255,1676243011361; forceNewPlan=false, retain=false 2023-02-12 23:03:33,142 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3cf12bce3359ee882a269ccd1199fb55, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43427,1676243011390; forceNewPlan=false, retain=false 2023-02-12 23:03:33,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:33,289 INFO [jenkins-hbase4:43775] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-12 23:03:33,295 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=a67157f758d5013ff72d7e85b49d9033, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,295 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3cf12bce3359ee882a269ccd1199fb55, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,295 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=e128cbc418893503ff50d6c088a6d006, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,295 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243013295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243013295"}]},"ts":"1676243013295"} 2023-02-12 23:03:33,295 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=427c9bd94355639bcfaa338199010ecb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,295 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b73c6c0b74cbd1b10bb1518dd12c20fb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,295 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243013295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243013295"}]},"ts":"1676243013295"} 2023-02-12 23:03:33,295 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243013295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243013295"}]},"ts":"1676243013295"} 2023-02-12 23:03:33,295 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243013295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243013295"}]},"ts":"1676243013295"} 2023-02-12 23:03:33,295 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243013295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243013295"}]},"ts":"1676243013295"} 2023-02-12 23:03:33,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=15, state=RUNNABLE; OpenRegionProcedure 3cf12bce3359ee882a269ccd1199fb55, server=jenkins-hbase4.apache.org,43427,1676243011390}] 2023-02-12 23:03:33,297 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE; OpenRegionProcedure e128cbc418893503ff50d6c088a6d006, server=jenkins-hbase4.apache.org,43427,1676243011390}] 2023-02-12 23:03:33,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=14, state=RUNNABLE; OpenRegionProcedure b73c6c0b74cbd1b10bb1518dd12c20fb, server=jenkins-hbase4.apache.org,43427,1676243011390}] 2023-02-12 23:03:33,298 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=17, state=RUNNABLE; OpenRegionProcedure a67157f758d5013ff72d7e85b49d9033, server=jenkins-hbase4.apache.org,43427,1676243011390}] 2023-02-12 23:03:33,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=12, state=RUNNABLE; OpenRegionProcedure 427c9bd94355639bcfaa338199010ecb, server=jenkins-hbase4.apache.org,43427,1676243011390}] 2023-02-12 23:03:33,300 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3118215613336d661d6901cc41de476d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,300 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=55fb2b8f1ac8b47848e354e0e6897bb3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,300 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013300"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243013300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243013300"}]},"ts":"1676243013300"} 2023-02-12 23:03:33,300 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676243013300"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243013300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243013300"}]},"ts":"1676243013300"} 2023-02-12 23:03:33,301 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=df920b05b5c05a2bf111eb40ef564602, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,301 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676243013301"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243013301"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243013301"}]},"ts":"1676243013301"} 2023-02-12 23:03:33,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure 3118215613336d661d6901cc41de476d, server=jenkins-hbase4.apache.org,38255,1676243011361}] 2023-02-12 23:03:33,302 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b0d590d5f4bbfca780b0295e86761238, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,302 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013302"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243013302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243013302"}]},"ts":"1676243013302"} 2023-02-12 23:03:33,302 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=11, state=RUNNABLE; OpenRegionProcedure 55fb2b8f1ac8b47848e354e0e6897bb3, server=jenkins-hbase4.apache.org,38255,1676243011361}] 2023-02-12 23:03:33,303 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=255f26913e54145c6d5d7715ff69352f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,303 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676243012625.255f26913e54145c6d5d7715ff69352f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013303"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243013303"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243013303"}]},"ts":"1676243013303"} 2023-02-12 23:03:33,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=20, state=RUNNABLE; OpenRegionProcedure df920b05b5c05a2bf111eb40ef564602, server=jenkins-hbase4.apache.org,38255,1676243011361}] 2023-02-12 23:03:33,304 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=16, state=RUNNABLE; OpenRegionProcedure b0d590d5f4bbfca780b0295e86761238, server=jenkins-hbase4.apache.org,38255,1676243011361}] 2023-02-12 23:03:33,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=13, state=RUNNABLE; OpenRegionProcedure 255f26913e54145c6d5d7715ff69352f, server=jenkins-hbase4.apache.org,38255,1676243011361}] 2023-02-12 23:03:33,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:33,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3cf12bce3359ee882a269ccd1199fb55, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-12 23:03:33,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:33,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:33,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:33,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:33,454 INFO [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:33,455 DEBUG [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f1 2023-02-12 23:03:33,455 DEBUG [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f1 2023-02-12 23:03:33,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:33,455 INFO [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3cf12bce3359ee882a269ccd1199fb55 columnFamilyName f1 2023-02-12 23:03:33,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b0d590d5f4bbfca780b0295e86761238, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-12 23:03:33,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:33,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:33,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:33,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:33,456 INFO [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] regionserver.HStore(310): Store=3cf12bce3359ee882a269ccd1199fb55/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,456 INFO [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:33,457 INFO [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:33,457 DEBUG [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f2 2023-02-12 23:03:33,457 DEBUG [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f2 2023-02-12 23:03:33,457 INFO [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3cf12bce3359ee882a269ccd1199fb55 columnFamilyName f2 2023-02-12 23:03:33,458 DEBUG [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f1 2023-02-12 23:03:33,458 INFO [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] regionserver.HStore(310): Store=3cf12bce3359ee882a269ccd1199fb55/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,458 DEBUG [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f1 2023-02-12 23:03:33,458 INFO [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0d590d5f4bbfca780b0295e86761238 columnFamilyName f1 2023-02-12 23:03:33,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:33,458 INFO [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] regionserver.HStore(310): Store=b0d590d5f4bbfca780b0295e86761238/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,459 INFO [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:33,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:33,460 DEBUG [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f2 2023-02-12 23:03:33,460 DEBUG [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f2 2023-02-12 23:03:33,460 INFO [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0d590d5f4bbfca780b0295e86761238 columnFamilyName f2 2023-02-12 23:03:33,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:33,460 INFO [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] regionserver.HStore(310): Store=b0d590d5f4bbfca780b0295e86761238/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:33,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:33,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:33,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:33,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:33,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3cf12bce3359ee882a269ccd1199fb55; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61896527, jitterRate=-0.07766987383365631}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:33,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3cf12bce3359ee882a269ccd1199fb55: Running coprocessor pre-open hook at 1676243013453Writing region info on filesystem at 1676243013453Initializing all the Stores at 1676243013453Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013453Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013454 (+1 ms)Cleaning up temporary data from old regions at 1676243013459 (+5 ms)Cleaning up detritus from prior splits at 1676243013460 (+1 ms)Running coprocessor post-open hooks at 1676243013463 (+3 ms)Region opened successfully at 1676243013463 2023-02-12 23:03:33,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55., pid=21, masterSystemTime=1676243013449 2023-02-12 23:03:33,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:33,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:33,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:33,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:33,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e128cbc418893503ff50d6c088a6d006, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-12 23:03:33,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:33,466 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3cf12bce3359ee882a269ccd1199fb55, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:33,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:33,466 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013466"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243013466"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243013466"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243013466"}]},"ts":"1676243013466"} 2023-02-12 23:03:33,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:33,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:33,467 INFO [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:33,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b0d590d5f4bbfca780b0295e86761238; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65622166, jitterRate=-0.022153526544570923}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:33,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b0d590d5f4bbfca780b0295e86761238: Running coprocessor pre-open hook at 1676243013456Writing region info on filesystem at 1676243013456Initializing all the Stores at 1676243013457 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013457Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013457Cleaning up temporary data from old regions at 1676243013462 (+5 ms)Cleaning up detritus from prior splits at 1676243013462Running coprocessor post-open hooks at 1676243013468 (+6 ms)Region opened successfully at 1676243013468 2023-02-12 23:03:33,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238., pid=29, masterSystemTime=1676243013453 2023-02-12 23:03:33,469 DEBUG [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f1 2023-02-12 23:03:33,469 DEBUG [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f1 2023-02-12 23:03:33,469 INFO [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e128cbc418893503ff50d6c088a6d006 columnFamilyName f1 2023-02-12 23:03:33,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=15 2023-02-12 23:03:33,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=15, state=SUCCESS; OpenRegionProcedure 3cf12bce3359ee882a269ccd1199fb55, server=jenkins-hbase4.apache.org,43427,1676243011390 in 171 msec 2023-02-12 23:03:33,470 INFO [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] regionserver.HStore(310): Store=e128cbc418893503ff50d6c088a6d006/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,470 INFO [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:33,471 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3cf12bce3359ee882a269ccd1199fb55, ASSIGN in 333 msec 2023-02-12 23:03:33,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:33,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:33,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:33,471 DEBUG [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f2 2023-02-12 23:03:33,471 DEBUG [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f2 2023-02-12 23:03:33,471 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b0d590d5f4bbfca780b0295e86761238, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 255f26913e54145c6d5d7715ff69352f, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-12 23:03:33,471 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013471"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243013471"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243013471"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243013471"}]},"ts":"1676243013471"} 2023-02-12 23:03:33,471 INFO [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e128cbc418893503ff50d6c088a6d006 columnFamilyName f2 2023-02-12 23:03:33,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:33,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:33,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:33,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:33,472 INFO [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] regionserver.HStore(310): Store=e128cbc418893503ff50d6c088a6d006/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:33,473 INFO [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:33,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:33,474 DEBUG [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f1 2023-02-12 23:03:33,474 DEBUG [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f1 2023-02-12 23:03:33,474 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=16 2023-02-12 23:03:33,474 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=16, state=SUCCESS; OpenRegionProcedure b0d590d5f4bbfca780b0295e86761238, server=jenkins-hbase4.apache.org,38255,1676243011361 in 169 msec 2023-02-12 23:03:33,474 INFO [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 255f26913e54145c6d5d7715ff69352f columnFamilyName f1 2023-02-12 23:03:33,475 INFO [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] regionserver.HStore(310): Store=255f26913e54145c6d5d7715ff69352f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:33,475 INFO [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:33,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0d590d5f4bbfca780b0295e86761238, ASSIGN in 338 msec 2023-02-12 23:03:33,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:33,476 DEBUG [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f2 2023-02-12 23:03:33,476 DEBUG [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f2 2023-02-12 23:03:33,476 INFO [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 255f26913e54145c6d5d7715ff69352f columnFamilyName f2 2023-02-12 23:03:33,477 INFO [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] regionserver.HStore(310): Store=255f26913e54145c6d5d7715ff69352f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:33,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:33,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:33,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e128cbc418893503ff50d6c088a6d006; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70967600, jitterRate=0.05749964714050293}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:33,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e128cbc418893503ff50d6c088a6d006: Running coprocessor pre-open hook at 1676243013466Writing region info on filesystem at 1676243013466Initializing all the Stores at 1676243013467 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013467Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013467Cleaning up temporary data from old regions at 1676243013474 (+7 ms)Cleaning up detritus from prior splits at 1676243013474Running coprocessor post-open hooks at 1676243013478 (+4 ms)Region opened successfully at 1676243013478 2023-02-12 23:03:33,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006., pid=22, masterSystemTime=1676243013449 2023-02-12 23:03:33,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:33,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:33,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:33,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:33,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b73c6c0b74cbd1b10bb1518dd12c20fb, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-12 23:03:33,480 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=e128cbc418893503ff50d6c088a6d006, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:33,480 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013480"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243013480"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243013480"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243013480"}]},"ts":"1676243013480"} 2023-02-12 23:03:33,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:33,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:33,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:33,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:33,482 INFO [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:33,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:33,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 255f26913e54145c6d5d7715ff69352f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73316238, jitterRate=0.0924970805644989}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:33,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 255f26913e54145c6d5d7715ff69352f: Running coprocessor pre-open hook at 1676243013472Writing region info on filesystem at 1676243013472Initializing all the Stores at 1676243013473 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013473Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013473Cleaning up temporary data from old regions at 1676243013478 (+5 ms)Cleaning up detritus from prior splits at 1676243013479 (+1 ms)Running coprocessor post-open hooks at 1676243013483 (+4 ms)Region opened successfully at 1676243013483 2023-02-12 23:03:33,483 DEBUG [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f1 2023-02-12 23:03:33,483 DEBUG [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f1 2023-02-12 23:03:33,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=19 2023-02-12 23:03:33,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f., pid=30, masterSystemTime=1676243013453 2023-02-12 23:03:33,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; OpenRegionProcedure e128cbc418893503ff50d6c088a6d006, server=jenkins-hbase4.apache.org,43427,1676243011390 in 185 msec 2023-02-12 23:03:33,483 INFO [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b73c6c0b74cbd1b10bb1518dd12c20fb columnFamilyName f1 2023-02-12 23:03:33,484 INFO [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] regionserver.HStore(310): Store=b73c6c0b74cbd1b10bb1518dd12c20fb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,484 INFO [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:33,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e128cbc418893503ff50d6c088a6d006, ASSIGN in 347 msec 2023-02-12 23:03:33,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:33,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:33,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:33,485 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=255f26913e54145c6d5d7715ff69352f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3118215613336d661d6901cc41de476d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-12 23:03:33,485 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676243012625.255f26913e54145c6d5d7715ff69352f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013485"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243013485"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243013485"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243013485"}]},"ts":"1676243013485"} 2023-02-12 23:03:33,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3118215613336d661d6901cc41de476d 2023-02-12 23:03:33,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:33,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3118215613336d661d6901cc41de476d 2023-02-12 23:03:33,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3118215613336d661d6901cc41de476d 2023-02-12 23:03:33,487 INFO [StoreOpener-3118215613336d661d6901cc41de476d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3118215613336d661d6901cc41de476d 2023-02-12 23:03:33,487 DEBUG [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f2 2023-02-12 23:03:33,487 DEBUG [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f2 2023-02-12 23:03:33,488 INFO [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b73c6c0b74cbd1b10bb1518dd12c20fb columnFamilyName f2 2023-02-12 23:03:33,488 DEBUG [StoreOpener-3118215613336d661d6901cc41de476d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f1 2023-02-12 23:03:33,488 DEBUG [StoreOpener-3118215613336d661d6901cc41de476d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f1 2023-02-12 23:03:33,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=13 2023-02-12 23:03:33,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=13, state=SUCCESS; OpenRegionProcedure 255f26913e54145c6d5d7715ff69352f, server=jenkins-hbase4.apache.org,38255,1676243011361 in 181 msec 2023-02-12 23:03:33,488 INFO [StoreOpener-3118215613336d661d6901cc41de476d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3118215613336d661d6901cc41de476d columnFamilyName f1 2023-02-12 23:03:33,488 INFO [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] regionserver.HStore(310): Store=b73c6c0b74cbd1b10bb1518dd12c20fb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,489 INFO [StoreOpener-3118215613336d661d6901cc41de476d-1] regionserver.HStore(310): Store=3118215613336d661d6901cc41de476d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,489 INFO [StoreOpener-3118215613336d661d6901cc41de476d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3118215613336d661d6901cc41de476d 2023-02-12 23:03:33,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=255f26913e54145c6d5d7715ff69352f, ASSIGN in 352 msec 2023-02-12 23:03:33,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:33,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:33,490 DEBUG [StoreOpener-3118215613336d661d6901cc41de476d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f2 2023-02-12 23:03:33,490 DEBUG [StoreOpener-3118215613336d661d6901cc41de476d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f2 2023-02-12 23:03:33,490 INFO [StoreOpener-3118215613336d661d6901cc41de476d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3118215613336d661d6901cc41de476d columnFamilyName f2 2023-02-12 23:03:33,490 INFO [StoreOpener-3118215613336d661d6901cc41de476d-1] regionserver.HStore(310): Store=3118215613336d661d6901cc41de476d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:33,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d 2023-02-12 23:03:33,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d 2023-02-12 23:03:33,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:33,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:33,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:33,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b73c6c0b74cbd1b10bb1518dd12c20fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67621209, jitterRate=0.0076345354318618774}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:33,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b73c6c0b74cbd1b10bb1518dd12c20fb: Running coprocessor pre-open hook at 1676243013481Writing region info on filesystem at 1676243013481Initializing all the Stores at 1676243013482 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013482Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013482Cleaning up temporary data from old regions at 1676243013490 (+8 ms)Cleaning up detritus from prior splits at 1676243013490Running coprocessor post-open hooks at 1676243013493 (+3 ms)Region opened successfully at 1676243013493 2023-02-12 23:03:33,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3118215613336d661d6901cc41de476d 2023-02-12 23:03:33,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb., pid=23, masterSystemTime=1676243013449 2023-02-12 23:03:33,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:33,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:33,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:33,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:33,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 427c9bd94355639bcfaa338199010ecb, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-12 23:03:33,495 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b73c6c0b74cbd1b10bb1518dd12c20fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,496 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013495"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243013495"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243013495"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243013495"}]},"ts":"1676243013495"} 2023-02-12 23:03:33,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:33,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:33,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:33,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:33,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3118215613336d661d6901cc41de476d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71638033, jitterRate=0.0674898773431778}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:33,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3118215613336d661d6901cc41de476d: Running coprocessor pre-open hook at 1676243013486Writing region info on filesystem at 1676243013486Initializing all the Stores at 1676243013486Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013486Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013487 (+1 ms)Cleaning up temporary data from old regions at 1676243013492 (+5 ms)Cleaning up detritus from prior splits at 1676243013492Running coprocessor post-open hooks at 1676243013496 (+4 ms)Region opened successfully at 1676243013496 2023-02-12 23:03:33,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d., pid=26, masterSystemTime=1676243013453 2023-02-12 23:03:33,497 INFO [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:33,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:33,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:33,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:33,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => df920b05b5c05a2bf111eb40ef564602, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-12 23:03:33,498 DEBUG [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f1 2023-02-12 23:03:33,498 DEBUG [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f1 2023-02-12 23:03:33,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:33,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:33,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:33,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:33,499 INFO [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 427c9bd94355639bcfaa338199010ecb columnFamilyName f1 2023-02-12 23:03:33,499 INFO [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] regionserver.HStore(310): Store=427c9bd94355639bcfaa338199010ecb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,499 INFO [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:33,499 INFO [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:33,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=14 2023-02-12 23:03:33,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=14, state=SUCCESS; OpenRegionProcedure b73c6c0b74cbd1b10bb1518dd12c20fb, server=jenkins-hbase4.apache.org,43427,1676243011390 in 199 msec 2023-02-12 23:03:33,501 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3118215613336d661d6901cc41de476d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,501 DEBUG [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f2 2023-02-12 23:03:33,501 DEBUG [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f2 2023-02-12 23:03:33,501 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013500"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243013500"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243013500"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243013500"}]},"ts":"1676243013500"} 2023-02-12 23:03:33,501 DEBUG [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602/f1 2023-02-12 23:03:33,501 DEBUG [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602/f1 2023-02-12 23:03:33,501 INFO [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 427c9bd94355639bcfaa338199010ecb columnFamilyName f2 2023-02-12 23:03:33,501 INFO [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df920b05b5c05a2bf111eb40ef564602 columnFamilyName f1 2023-02-12 23:03:33,502 INFO [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] regionserver.HStore(310): Store=427c9bd94355639bcfaa338199010ecb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,502 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b73c6c0b74cbd1b10bb1518dd12c20fb, ASSIGN in 365 msec 2023-02-12 23:03:33,502 INFO [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] regionserver.HStore(310): Store=df920b05b5c05a2bf111eb40ef564602/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:33,502 INFO [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:33,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:33,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-12 23:03:33,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure 3118215613336d661d6901cc41de476d, server=jenkins-hbase4.apache.org,38255,1676243011361 in 200 msec 2023-02-12 23:03:33,504 DEBUG [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602/f2 2023-02-12 23:03:33,504 DEBUG [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602/f2 2023-02-12 23:03:33,504 INFO [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df920b05b5c05a2bf111eb40ef564602 columnFamilyName f2 2023-02-12 23:03:33,505 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3118215613336d661d6901cc41de476d, ASSIGN in 368 msec 2023-02-12 23:03:33,505 INFO [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] regionserver.HStore(310): Store=df920b05b5c05a2bf111eb40ef564602/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:33,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:33,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:33,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:33,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:33,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:33,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:33,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 427c9bd94355639bcfaa338199010ecb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66593982, jitterRate=-0.007672339677810669}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:33,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 427c9bd94355639bcfaa338199010ecb: Running coprocessor pre-open hook at 1676243013496Writing region info on filesystem at 1676243013496Initializing all the Stores at 1676243013497 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013497Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013497Cleaning up temporary data from old regions at 1676243013504 (+7 ms)Cleaning up detritus from prior splits at 1676243013505 (+1 ms)Running coprocessor post-open hooks at 1676243013511 (+6 ms)Region opened successfully at 1676243013511 2023-02-12 23:03:33,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:33,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb., pid=25, masterSystemTime=1676243013449 2023-02-12 23:03:33,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened df920b05b5c05a2bf111eb40ef564602; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70522243, jitterRate=0.05086331069469452}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:33,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for df920b05b5c05a2bf111eb40ef564602: Running coprocessor pre-open hook at 1676243013499Writing region info on filesystem at 1676243013499Initializing all the Stores at 1676243013499Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013499Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013499Cleaning up temporary data from old regions at 1676243013507 (+8 ms)Cleaning up detritus from prior splits at 1676243013507Running coprocessor post-open hooks at 1676243013512 (+5 ms)Region opened successfully at 1676243013512 2023-02-12 23:03:33,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602., pid=28, masterSystemTime=1676243013453 2023-02-12 23:03:33,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:33,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:33,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:33,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a67157f758d5013ff72d7e85b49d9033, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-12 23:03:33,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:33,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:33,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:33,514 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=427c9bd94355639bcfaa338199010ecb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:33,514 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013514"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243013514"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243013514"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243013514"}]},"ts":"1676243013514"} 2023-02-12 23:03:33,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:33,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:33,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:33,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 55fb2b8f1ac8b47848e354e0e6897bb3, NAME => 'testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-12 23:03:33,515 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=df920b05b5c05a2bf111eb40ef564602, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:33,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:33,515 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676243013515"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243013515"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243013515"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243013515"}]},"ts":"1676243013515"} 2023-02-12 23:03:33,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:33,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:33,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=12 2023-02-12 23:03:33,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=12, state=SUCCESS; OpenRegionProcedure 427c9bd94355639bcfaa338199010ecb, server=jenkins-hbase4.apache.org,43427,1676243011390 in 216 msec 2023-02-12 23:03:33,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=20 2023-02-12 23:03:33,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=20, state=SUCCESS; OpenRegionProcedure df920b05b5c05a2bf111eb40ef564602, server=jenkins-hbase4.apache.org,38255,1676243011361 in 214 msec 2023-02-12 23:03:33,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=427c9bd94355639bcfaa338199010ecb, ASSIGN in 382 msec 2023-02-12 23:03:33,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=df920b05b5c05a2bf111eb40ef564602, ASSIGN in 382 msec 2023-02-12 23:03:33,523 INFO [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:33,524 INFO [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:33,525 DEBUG [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f1 2023-02-12 23:03:33,525 DEBUG [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3/f1 2023-02-12 23:03:33,525 DEBUG [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3/f1 2023-02-12 23:03:33,525 DEBUG [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f1 2023-02-12 23:03:33,525 INFO [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55fb2b8f1ac8b47848e354e0e6897bb3 columnFamilyName f1 2023-02-12 23:03:33,525 INFO [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a67157f758d5013ff72d7e85b49d9033 columnFamilyName f1 2023-02-12 23:03:33,526 INFO [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] regionserver.HStore(310): Store=55fb2b8f1ac8b47848e354e0e6897bb3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,526 INFO [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:33,526 INFO [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] regionserver.HStore(310): Store=a67157f758d5013ff72d7e85b49d9033/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,526 INFO [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:33,527 DEBUG [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3/f2 2023-02-12 23:03:33,527 DEBUG [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3/f2 2023-02-12 23:03:33,527 DEBUG [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f2 2023-02-12 23:03:33,527 DEBUG [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f2 2023-02-12 23:03:33,527 INFO [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55fb2b8f1ac8b47848e354e0e6897bb3 columnFamilyName f2 2023-02-12 23:03:33,527 INFO [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a67157f758d5013ff72d7e85b49d9033 columnFamilyName f2 2023-02-12 23:03:33,527 INFO [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] regionserver.HStore(310): Store=55fb2b8f1ac8b47848e354e0e6897bb3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,528 INFO [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] regionserver.HStore(310): Store=a67157f758d5013ff72d7e85b49d9033/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:33,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:33,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:33,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:33,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:33,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:33,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:33,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:33,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:33,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:33,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:33,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 55fb2b8f1ac8b47848e354e0e6897bb3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63944116, jitterRate=-0.04715842008590698}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:33,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 55fb2b8f1ac8b47848e354e0e6897bb3: Running coprocessor pre-open hook at 1676243013515Writing region info on filesystem at 1676243013515Initializing all the Stores at 1676243013516 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013516Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013524 (+8 ms)Cleaning up temporary data from old regions at 1676243013529 (+5 ms)Cleaning up detritus from prior splits at 1676243013530 (+1 ms)Running coprocessor post-open hooks at 1676243013536 (+6 ms)Region opened successfully at 1676243013536 2023-02-12 23:03:33,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a67157f758d5013ff72d7e85b49d9033; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59418982, jitterRate=-0.1145881712436676}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:33,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a67157f758d5013ff72d7e85b49d9033: Running coprocessor pre-open hook at 1676243013514Writing region info on filesystem at 1676243013514Initializing all the Stores at 1676243013515 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013515Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243013523 (+8 ms)Cleaning up temporary data from old regions at 1676243013530 (+7 ms)Cleaning up detritus from prior splits at 1676243013530Running coprocessor post-open hooks at 1676243013537 (+7 ms)Region opened successfully at 1676243013537 2023-02-12 23:03:33,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3., pid=27, masterSystemTime=1676243013453 2023-02-12 23:03:33,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033., pid=24, masterSystemTime=1676243013449 2023-02-12 23:03:33,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:33,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:33,539 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=55fb2b8f1ac8b47848e354e0e6897bb3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,539 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676243013539"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243013539"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243013539"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243013539"}]},"ts":"1676243013539"} 2023-02-12 23:03:33,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:33,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:33,540 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=a67157f758d5013ff72d7e85b49d9033, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,540 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243013540"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243013540"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243013540"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243013540"}]},"ts":"1676243013540"} 2023-02-12 23:03:33,542 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=11 2023-02-12 23:03:33,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=11, state=SUCCESS; OpenRegionProcedure 55fb2b8f1ac8b47848e354e0e6897bb3, server=jenkins-hbase4.apache.org,38255,1676243011361 in 239 msec 2023-02-12 23:03:33,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=17 2023-02-12 23:03:33,544 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55fb2b8f1ac8b47848e354e0e6897bb3, ASSIGN in 407 msec 2023-02-12 23:03:33,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=17, state=SUCCESS; OpenRegionProcedure a67157f758d5013ff72d7e85b49d9033, server=jenkins-hbase4.apache.org,43427,1676243011390 in 244 msec 2023-02-12 23:03:33,545 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=10 2023-02-12 23:03:33,545 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a67157f758d5013ff72d7e85b49d9033, ASSIGN in 408 msec 2023-02-12 23:03:33,546 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 23:03:33,546 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243013546"}]},"ts":"1676243013546"} 2023-02-12 23:03:33,547 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-12 23:03:33,550 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 23:03:33,551 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 924 msec 2023-02-12 23:03:33,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:33,735 INFO [Listener at localhost/33219] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-12 23:03:33,736 DEBUG [Listener at localhost/33219] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-12 23:03:33,736 INFO [Listener at localhost/33219] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 23:03:33,739 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-12 23:03:33,739 INFO [Listener at localhost/33219] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 23:03:33,739 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-12 23:03:33,739 INFO [Listener at localhost/33219] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 23:03:33,780 DEBUG [hconnection-0x2a6947ac-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:33,789 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38255] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:33,794 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44434, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:33,805 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43427] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:33,876 INFO [Listener at localhost/33219] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 23:03:33,877 INFO [Listener at localhost/33219] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 23:03:33,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-12 23:03:33,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676243013878 (current time:1676243013878). 2023-02-12 23:03:33,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 23:03:33,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] zookeeper.ReadOnlyZKClient(139): Connect 0x1c185d81 to 127.0.0.1:57099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:33,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bf99350, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:33,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:33,887 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46714, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:33,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c185d81 to 127.0.0.1:57099 2023-02-12 23:03:33,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:33,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 23:03:33,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-12 23:03:33,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-12 23:03:33,892 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-12 23:03:33,892 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676243613892 2023-02-12 23:03:33,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-12 23:03:33,898 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,899 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-12 23:03:33,900 DEBUG [Listener at localhost/33219] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 23:03:33,900 DEBUG [Listener at localhost/33219] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 23:03:33,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-12 23:03:33,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 10 msec 2023-02-12 23:03:33,901 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-12 23:03:33,902 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676243613902 2023-02-12 23:03:33,914 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,914 INFO [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-12 23:03:33,915 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:33,915 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-12 23:03:33,915 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-12 23:03:33,916 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,916 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,917 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:33,917 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:33,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:33,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:33,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:33,917 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:33,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,918 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,918 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,918 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,918 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 23:03:33,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-12 23:03:33,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,918 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-12 23:03:33,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-12 23:03:33,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,919 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-12 23:03:33,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,919 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-12 23:03:33,919 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:33,922 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 23:03:33,922 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 23:03:33,922 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38255,1676243011361' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 23:03:33,922 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-12 23:03:33,922 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:33,922 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 23:03:33,922 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 23:03:33,922 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43427,1676243011390' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 23:03:33,926 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,926 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:33,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:33,927 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,927 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,927 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,928 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:33,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:33,928 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,928 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:33,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:33,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:33,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38255,1676243011361' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 23:03:33,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4de3658d[Count = 1] remaining members to acquire global barrier 2023-02-12 23:03:33,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:33,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:33,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:33,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:33,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:33,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43427,1676243011390' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 23:03:33,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4de3658d[Count = 0] remaining members to acquire global barrier 2023-02-12 23:03:33,931 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-12 23:03:33,931 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,932 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,932 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,932 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 23:03:33,932 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:33,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,932 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 23:03:33,932 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:33,932 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. started... 2023-02-12 23:03:33,932 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 23:03:33,932 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 23:03:33,932 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:33,932 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:33,933 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3cf12bce3359ee882a269ccd1199fb55 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:33,933 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:33,933 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 23:03:33,933 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 23:03:33,933 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:33,932 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. started... 2023-02-12 23:03:33,933 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. started... 2023-02-12 23:03:33,932 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:33,934 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 23:03:33,933 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. started... 2023-02-12 23:03:33,933 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:33,933 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. started... 2023-02-12 23:03:33,935 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for df920b05b5c05a2bf111eb40ef564602: 2023-02-12 23:03:33,935 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. started... 2023-02-12 23:03:33,935 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 255f26913e54145c6d5d7715ff69352f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:33,937 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3118215613336d661d6901cc41de476d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:33,934 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] regionserver.HRegion(2744): Flushing b73c6c0b74cbd1b10bb1518dd12c20fb 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:33,937 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:33,936 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 427c9bd94355639bcfaa338199010ecb 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 23:03:33,937 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:33,937 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 23:03:33,937 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 23:03:33,960 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. completed. 2023-02-12 23:03:33,960 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:33,960 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:33,960 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. started... 2023-02-12 23:03:33,960 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 23:03:33,960 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/.tmp/f1/0f1ee91f58614274a4e3babe88312edd 2023-02-12 23:03:33,969 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] regionserver.HRegion(2744): Flushing b0d590d5f4bbfca780b0295e86761238 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:33,976 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/.tmp/f1/2ba815c60cc34ffdae5cf1b1be4f448a 2023-02-12 23:03:33,977 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/.tmp/f1/bf5dc4657b314d7281fddb82128b3e37 2023-02-12 23:03:33,989 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/.tmp/f1/44a9fe2cae3e427994a05a97004e1931 2023-02-12 23:03:34,000 DEBUG [Listener at localhost/33219] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:34,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 23:03:34,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 23:03:34,002 DEBUG [Listener at localhost/33219] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 23:03:34,009 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/.tmp/f1/7db1c1ae91374979b7614449b0fef0af 2023-02-12 23:03:34,020 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/.tmp/f2/65591026002c4904b324e2163a4e505a 2023-02-12 23:03:34,021 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/.tmp/f2/e4f522070e2246888854af39dfd9790b 2023-02-12 23:03:34,029 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/.tmp/f1/2ba815c60cc34ffdae5cf1b1be4f448a as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f1/2ba815c60cc34ffdae5cf1b1be4f448a 2023-02-12 23:03:34,036 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/.tmp/f1/0f1ee91f58614274a4e3babe88312edd as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f1/0f1ee91f58614274a4e3babe88312edd 2023-02-12 23:03:34,040 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f1/0f1ee91f58614274a4e3babe88312edd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:34,041 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/.tmp/f2/65591026002c4904b324e2163a4e505a as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f2/65591026002c4904b324e2163a4e505a 2023-02-12 23:03:34,048 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/.tmp/f2/cb50f806e93440f1971741c0f0585d35 2023-02-12 23:03:34,051 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f1/2ba815c60cc34ffdae5cf1b1be4f448a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:34,051 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/.tmp/f2/e4f522070e2246888854af39dfd9790b as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f2/e4f522070e2246888854af39dfd9790b 2023-02-12 23:03:34,053 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f2/65591026002c4904b324e2163a4e505a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:34,055 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3cf12bce3359ee882a269ccd1199fb55 in 122ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:34,055 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-12 23:03:34,056 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3cf12bce3359ee882a269ccd1199fb55: 2023-02-12 23:03:34,056 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,057 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:34,057 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f1/0f1ee91f58614274a4e3babe88312edd] hfiles 2023-02-12 23:03:34,057 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f1/0f1ee91f58614274a4e3babe88312edd for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,057 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f2/65591026002c4904b324e2163a4e505a] hfiles 2023-02-12 23:03:34,057 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f2/65591026002c4904b324e2163a4e505a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,059 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/.tmp/f1/bf5dc4657b314d7281fddb82128b3e37 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f1/bf5dc4657b314d7281fddb82128b3e37 2023-02-12 23:03:34,060 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f2/e4f522070e2246888854af39dfd9790b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:34,061 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 255f26913e54145c6d5d7715ff69352f in 126ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:34,064 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f1/bf5dc4657b314d7281fddb82128b3e37, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 23:03:34,066 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/.tmp/f2/7bb1a80d7bd9454aadea2994f51b2ab3 2023-02-12 23:03:34,069 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 255f26913e54145c6d5d7715ff69352f: 2023-02-12 23:03:34,069 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,069 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:34,069 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f1/2ba815c60cc34ffdae5cf1b1be4f448a] hfiles 2023-02-12 23:03:34,069 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f1/2ba815c60cc34ffdae5cf1b1be4f448a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,069 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f2/e4f522070e2246888854af39dfd9790b] hfiles 2023-02-12 23:03:34,069 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f2/e4f522070e2246888854af39dfd9790b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,069 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/.tmp/f2/cb50f806e93440f1971741c0f0585d35 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f2/cb50f806e93440f1971741c0f0585d35 2023-02-12 23:03:34,081 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/.tmp/f1/44a9fe2cae3e427994a05a97004e1931 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f1/44a9fe2cae3e427994a05a97004e1931 2023-02-12 23:03:34,082 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f2/cb50f806e93440f1971741c0f0585d35, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 23:03:34,083 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 427c9bd94355639bcfaa338199010ecb in 147ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:34,083 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 427c9bd94355639bcfaa338199010ecb: 2023-02-12 23:03:34,083 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,083 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:34,083 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f1/bf5dc4657b314d7281fddb82128b3e37] hfiles 2023-02-12 23:03:34,083 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f1/bf5dc4657b314d7281fddb82128b3e37 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,083 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f2/cb50f806e93440f1971741c0f0585d35] hfiles 2023-02-12 23:03:34,083 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f2/cb50f806e93440f1971741c0f0585d35 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,088 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/.tmp/f2/7cd41cab8665498a92f2a7da1c137efb 2023-02-12 23:03:34,104 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f1/44a9fe2cae3e427994a05a97004e1931, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:34,104 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/.tmp/f1/7db1c1ae91374979b7614449b0fef0af as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f1/7db1c1ae91374979b7614449b0fef0af 2023-02-12 23:03:34,105 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/.tmp/f2/7bb1a80d7bd9454aadea2994f51b2ab3 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f2/7bb1a80d7bd9454aadea2994f51b2ab3 2023-02-12 23:03:34,108 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. completed. 2023-02-12 23:03:34,108 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:34,108 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:34,108 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 23:03:34,108 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. started... 2023-02-12 23:03:34,113 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.HRegion(2744): Flushing a67157f758d5013ff72d7e85b49d9033 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 23:03:34,113 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. completed. 2023-02-12 23:03:34,113 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:34,113 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:34,113 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. started... 2023-02-12 23:03:34,113 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 23:03:34,114 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 55fb2b8f1ac8b47848e354e0e6897bb3: 2023-02-12 23:03:34,115 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,115 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:34,115 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 23:03:34,115 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 23:03:34,115 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f1/7db1c1ae91374979b7614449b0fef0af, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:34,116 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f2/7bb1a80d7bd9454aadea2994f51b2ab3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:34,117 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/.tmp/f2/7cd41cab8665498a92f2a7da1c137efb as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f2/7cd41cab8665498a92f2a7da1c137efb 2023-02-12 23:03:34,117 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3118215613336d661d6901cc41de476d in 180ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:34,117 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3118215613336d661d6901cc41de476d: 2023-02-12 23:03:34,117 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,118 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:34,118 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f1/44a9fe2cae3e427994a05a97004e1931] hfiles 2023-02-12 23:03:34,118 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f1/44a9fe2cae3e427994a05a97004e1931 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,118 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f2/7bb1a80d7bd9454aadea2994f51b2ab3] hfiles 2023-02-12 23:03:34,118 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f2/7bb1a80d7bd9454aadea2994f51b2ab3 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,128 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f2/7cd41cab8665498a92f2a7da1c137efb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:34,129 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b0d590d5f4bbfca780b0295e86761238 in 160ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:34,129 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for b0d590d5f4bbfca780b0295e86761238: 2023-02-12 23:03:34,129 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,129 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:34,129 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f1/7db1c1ae91374979b7614449b0fef0af] hfiles 2023-02-12 23:03:34,129 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f1/7db1c1ae91374979b7614449b0fef0af for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,129 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f2/7cd41cab8665498a92f2a7da1c137efb] hfiles 2023-02-12 23:03:34,129 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f2/7cd41cab8665498a92f2a7da1c137efb for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,131 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. completed. 2023-02-12 23:03:34,131 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:34,131 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:34,131 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 23:03:34,131 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. started... 2023-02-12 23:03:34,140 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. completed. 2023-02-12 23:03:34,141 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:34,141 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 23:03:34,141 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e128cbc418893503ff50d6c088a6d006 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 23:03:34,152 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. completed. 2023-02-12 23:03:34,152 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:34,152 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 23:03:34,161 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/.tmp/f1/717dda8f540f427eb03f28501aeb4bca 2023-02-12 23:03:34,176 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/.tmp/f2/20aa6af2a7564e3abf2b3fbcd5b1a3f9 2023-02-12 23:03:34,180 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/.tmp/f1/717dda8f540f427eb03f28501aeb4bca as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f1/717dda8f540f427eb03f28501aeb4bca 2023-02-12 23:03:34,185 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f1/717dda8f540f427eb03f28501aeb4bca, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:34,185 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/.tmp/f2/20aa6af2a7564e3abf2b3fbcd5b1a3f9 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f2/20aa6af2a7564e3abf2b3fbcd5b1a3f9 2023-02-12 23:03:34,189 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f2/20aa6af2a7564e3abf2b3fbcd5b1a3f9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:34,190 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a67157f758d5013ff72d7e85b49d9033 in 77ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:34,190 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for a67157f758d5013ff72d7e85b49d9033: 2023-02-12 23:03:34,190 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,190 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:34,190 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f1/717dda8f540f427eb03f28501aeb4bca] hfiles 2023-02-12 23:03:34,190 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f1/717dda8f540f427eb03f28501aeb4bca for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,190 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f2/20aa6af2a7564e3abf2b3fbcd5b1a3f9] hfiles 2023-02-12 23:03:34,190 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f2/20aa6af2a7564e3abf2b3fbcd5b1a3f9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,196 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. completed. 2023-02-12 23:03:34,196 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:34,196 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 23:03:34,203 DEBUG [Listener at localhost/33219] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:34,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 23:03:34,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 23:03:34,204 DEBUG [Listener at localhost/33219] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 23:03:34,375 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/.tmp/f1/ab06759e346546cc9f92fe26fd59e359 2023-02-12 23:03:34,389 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/.tmp/f2/612bf29bd0fb4e6da4f471b6b892c584 2023-02-12 23:03:34,393 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/.tmp/f1/ab06759e346546cc9f92fe26fd59e359 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f1/ab06759e346546cc9f92fe26fd59e359 2023-02-12 23:03:34,397 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f1/ab06759e346546cc9f92fe26fd59e359, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:34,398 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/.tmp/f2/612bf29bd0fb4e6da4f471b6b892c584 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f2/612bf29bd0fb4e6da4f471b6b892c584 2023-02-12 23:03:34,402 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f2/612bf29bd0fb4e6da4f471b6b892c584, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 23:03:34,403 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b73c6c0b74cbd1b10bb1518dd12c20fb in 469ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:34,403 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for b73c6c0b74cbd1b10bb1518dd12c20fb: 2023-02-12 23:03:34,403 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,403 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:34,403 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f1/ab06759e346546cc9f92fe26fd59e359] hfiles 2023-02-12 23:03:34,403 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f1/ab06759e346546cc9f92fe26fd59e359 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,403 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f2/612bf29bd0fb4e6da4f471b6b892c584] hfiles 2023-02-12 23:03:34,403 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f2/612bf29bd0fb4e6da4f471b6b892c584 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,409 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. completed. 2023-02-12 23:03:34,409 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:34,409 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 23:03:34,504 DEBUG [Listener at localhost/33219] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:34,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 23:03:34,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 23:03:34,506 DEBUG [Listener at localhost/33219] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 23:03:34,562 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/.tmp/f1/b016fc17aa50474681f71b10b036ddae 2023-02-12 23:03:34,562 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. completed. 2023-02-12 23:03:34,562 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:34,562 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 23:03:34,562 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 23:03:34,562 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:34,562 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 23:03:34,562 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38255,1676243011361' in zk 2023-02-12 23:03:34,564 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 23:03:34,564 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:34,564 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:34,564 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 23:03:34,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:34,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:34,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:34,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:34,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:34,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:34,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:34,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38255,1676243011361': 2023-02-12 23:03:34,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38255,1676243011361' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 23:03:34,575 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/.tmp/f2/d2cec9141e1344ccae943aefafd150b3 2023-02-12 23:03:34,579 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/.tmp/f1/b016fc17aa50474681f71b10b036ddae as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f1/b016fc17aa50474681f71b10b036ddae 2023-02-12 23:03:34,583 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f1/b016fc17aa50474681f71b10b036ddae, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 23:03:34,583 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/.tmp/f2/d2cec9141e1344ccae943aefafd150b3 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f2/d2cec9141e1344ccae943aefafd150b3 2023-02-12 23:03:34,587 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f2/d2cec9141e1344ccae943aefafd150b3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 23:03:34,588 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for e128cbc418893503ff50d6c088a6d006 in 447ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:34,588 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e128cbc418893503ff50d6c088a6d006: 2023-02-12 23:03:34,588 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,588 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:34,588 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f1/b016fc17aa50474681f71b10b036ddae] hfiles 2023-02-12 23:03:34,588 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f1/b016fc17aa50474681f71b10b036ddae for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,588 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f2/d2cec9141e1344ccae943aefafd150b3] hfiles 2023-02-12 23:03:34,588 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f2/d2cec9141e1344ccae943aefafd150b3 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,593 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. completed. 2023-02-12 23:03:34,593 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:34,593 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 23:03:34,593 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 23:03:34,593 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:34,593 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 23:03:34,593 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43427,1676243011390' in zk 2023-02-12 23:03:34,597 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 23:03:34,597 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:34,597 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:34,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:34,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:34,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:34,597 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 23:03:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:34,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:34,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:34,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:34,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:34,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43427,1676243011390': 2023-02-12 23:03:34,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43427,1676243011390' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 23:03:34,600 INFO [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-12 23:03:34,600 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 23:03:34,600 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 23:03:34,600 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,600 INFO [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 23:03:34,602 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,602 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:34,602 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,602 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,602 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:34,603 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:34,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:34,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,603 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:34,604 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:34,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:34,605 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:34,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:34,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:34,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:34,615 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:34,615 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:34,615 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:34,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:34,615 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:34,615 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:34,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:34,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:34,615 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:34,615 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:34,615 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,615 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:34,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:34,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:34,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:34,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:34,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,615 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,616 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:34,616 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,616 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:34,616 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,616 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,681 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-12 23:03:34,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,681 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:34,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676243013898Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676243014615 (+717 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676243014616 (+1 ms)Writing data manifest for testWithMockedMapReduceMultiRegion at 1676243014624 (+8 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676243014636 (+12 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676243014681 (+45 ms) 2023-02-12 23:03:34,683 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-12 23:03:34,685 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 784 msec 2023-02-12 23:03:35,006 DEBUG [Listener at localhost/33219] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:35,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 23:03:35,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 23:03:35,008 INFO [Listener at localhost/33219] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 23:03:35,012 INFO [Listener at localhost/33219] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 23:03:35,019 INFO [Listener at localhost/33219] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 23:03:35,041 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38255] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:35,046 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43427] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:35,113 INFO [Listener at localhost/33219] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 23:03:35,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 23:03:35,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,122 INFO [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-12 23:03:35,122 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:35,123 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-12 23:03:35,123 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-12 23:03:35,123 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,124 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,126 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:35,126 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:35,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:35,126 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:35,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:35,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:35,126 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,126 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,126 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,127 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 23:03:35,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 23:03:35,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 23:03:35,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,127 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,127 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,127 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,127 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,128 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-12 23:03:35,128 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-12 23:03:35,128 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:35,128 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:35,129 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 23:03:35,129 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 23:03:35,130 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:35,130 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:35,130 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. started... 2023-02-12 23:03:35,130 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. started... 2023-02-12 23:03:35,130 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 255f26913e54145c6d5d7715ff69352f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:35,130 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3cf12bce3359ee882a269ccd1199fb55 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:35,132 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:35,132 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 23:03:35,133 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 23:03:35,133 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:35,133 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:35,133 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. started... 2023-02-12 23:03:35,133 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. started... 2023-02-12 23:03:35,133 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. started... 2023-02-12 23:03:35,133 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 427c9bd94355639bcfaa338199010ecb 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 23:03:35,133 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3118215613336d661d6901cc41de476d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:35,133 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b73c6c0b74cbd1b10bb1518dd12c20fb 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:35,136 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 23:03:35,136 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 23:03:35,141 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:35,141 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. started... 2023-02-12 23:03:35,142 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for df920b05b5c05a2bf111eb40ef564602: 2023-02-12 23:03:35,142 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:35,142 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:35,142 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 23:03:35,142 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. started... 2023-02-12 23:03:35,142 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b0d590d5f4bbfca780b0295e86761238 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:35,166 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/.tmp/f1/de8d76be29d244aca73162f6c2d60563 2023-02-12 23:03:35,168 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/.tmp/f1/bf5ebea0407f4942b0aa27ca99f9752d 2023-02-12 23:03:35,175 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/.tmp/f1/c1e82f34307143fbb2126a5642a344b8 2023-02-12 23:03:35,176 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/.tmp/f1/3c4712e903174c159398923723a246d2 2023-02-12 23:03:35,184 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/.tmp/f1/e6699d7a7cbb4a4789960fb334fcee3f 2023-02-12 23:03:35,199 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/.tmp/f1/bc9d85117a164a839a502b145a18c1ed 2023-02-12 23:03:35,232 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/.tmp/f2/2c25515b907a4de9a6b7f039cfcc31a3 2023-02-12 23:03:35,236 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/.tmp/f2/d00cd305e50f403bb9e10f9cc52f91f8 2023-02-12 23:03:35,237 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/.tmp/f2/7c68b815db0648efa1edf9a8b2644a49 2023-02-12 23:03:35,240 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/.tmp/f2/15b4168e68f8467f830cae041cacf6ea 2023-02-12 23:03:35,249 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/.tmp/f2/40d24e2c0bcd4f8f92325e98b50034c9 2023-02-12 23:03:35,250 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/.tmp/f1/de8d76be29d244aca73162f6c2d60563 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f1/de8d76be29d244aca73162f6c2d60563 2023-02-12 23:03:35,253 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/.tmp/f1/3c4712e903174c159398923723a246d2 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f1/3c4712e903174c159398923723a246d2 2023-02-12 23:03:35,253 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/.tmp/f1/bf5ebea0407f4942b0aa27ca99f9752d as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f1/bf5ebea0407f4942b0aa27ca99f9752d 2023-02-12 23:03:35,253 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/.tmp/f1/e6699d7a7cbb4a4789960fb334fcee3f as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f1/e6699d7a7cbb4a4789960fb334fcee3f 2023-02-12 23:03:35,256 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/.tmp/f2/ed7b34dfcc2542229e98849c8113ca38 2023-02-12 23:03:35,259 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f1/de8d76be29d244aca73162f6c2d60563, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:35,259 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/.tmp/f1/c1e82f34307143fbb2126a5642a344b8 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f1/c1e82f34307143fbb2126a5642a344b8 2023-02-12 23:03:35,260 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/.tmp/f2/2c25515b907a4de9a6b7f039cfcc31a3 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f2/2c25515b907a4de9a6b7f039cfcc31a3 2023-02-12 23:03:35,264 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/.tmp/f1/bc9d85117a164a839a502b145a18c1ed as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f1/bc9d85117a164a839a502b145a18c1ed 2023-02-12 23:03:35,264 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f1/3c4712e903174c159398923723a246d2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:35,265 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f1/bf5ebea0407f4942b0aa27ca99f9752d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:35,265 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f1/e6699d7a7cbb4a4789960fb334fcee3f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:35,266 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/.tmp/f2/15b4168e68f8467f830cae041cacf6ea as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f2/15b4168e68f8467f830cae041cacf6ea 2023-02-12 23:03:35,266 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/.tmp/f2/d00cd305e50f403bb9e10f9cc52f91f8 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f2/d00cd305e50f403bb9e10f9cc52f91f8 2023-02-12 23:03:35,267 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/.tmp/f2/7c68b815db0648efa1edf9a8b2644a49 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f2/7c68b815db0648efa1edf9a8b2644a49 2023-02-12 23:03:35,268 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f1/c1e82f34307143fbb2126a5642a344b8, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 23:03:35,269 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f2/2c25515b907a4de9a6b7f039cfcc31a3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:35,270 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/.tmp/f2/40d24e2c0bcd4f8f92325e98b50034c9 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f2/40d24e2c0bcd4f8f92325e98b50034c9 2023-02-12 23:03:35,270 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f1/bc9d85117a164a839a502b145a18c1ed, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:35,270 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3cf12bce3359ee882a269ccd1199fb55 in 140ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:35,270 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3cf12bce3359ee882a269ccd1199fb55: 2023-02-12 23:03:35,270 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:35,271 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:35,271 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 23:03:35,271 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. started... 2023-02-12 23:03:35,271 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a67157f758d5013ff72d7e85b49d9033 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 23:03:35,272 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/.tmp/f2/ed7b34dfcc2542229e98849c8113ca38 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f2/ed7b34dfcc2542229e98849c8113ca38 2023-02-12 23:03:35,276 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f2/7c68b815db0648efa1edf9a8b2644a49, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:35,278 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 255f26913e54145c6d5d7715ff69352f in 148ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:35,278 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 255f26913e54145c6d5d7715ff69352f: 2023-02-12 23:03:35,278 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:35,278 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:35,278 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. started... 2023-02-12 23:03:35,278 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 55fb2b8f1ac8b47848e354e0e6897bb3: 2023-02-12 23:03:35,278 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:35,278 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 23:03:35,278 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 23:03:35,281 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f2/40d24e2c0bcd4f8f92325e98b50034c9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 23:03:35,282 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f2/ed7b34dfcc2542229e98849c8113ca38, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:35,282 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 427c9bd94355639bcfaa338199010ecb in 149ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:35,282 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 427c9bd94355639bcfaa338199010ecb: 2023-02-12 23:03:35,282 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f2/15b4168e68f8467f830cae041cacf6ea, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:35,282 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:35,282 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b73c6c0b74cbd1b10bb1518dd12c20fb in 149ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:35,282 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 23:03:35,282 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:35,282 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b73c6c0b74cbd1b10bb1518dd12c20fb: 2023-02-12 23:03:35,283 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:35,283 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 23:03:35,283 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. started... 2023-02-12 23:03:35,283 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3118215613336d661d6901cc41de476d in 150ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:35,283 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing e128cbc418893503ff50d6c088a6d006 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 23:03:35,283 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3118215613336d661d6901cc41de476d: 2023-02-12 23:03:35,283 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:35,283 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 23:03:35,291 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f2/d00cd305e50f403bb9e10f9cc52f91f8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:35,292 INFO [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b0d590d5f4bbfca780b0295e86761238 in 150ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:35,292 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b0d590d5f4bbfca780b0295e86761238: 2023-02-12 23:03:35,292 DEBUG [rs(jenkins-hbase4.apache.org,38255,1676243011361)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:35,292 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 23:03:35,292 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 23:03:35,292 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,292 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 23:03:35,292 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38255,1676243011361' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 23:03:35,294 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,295 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,295 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/.tmp/f1/5ab82a03c2be403592ceca25343eaf5e 2023-02-12 23:03:35,295 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,295 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:35,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:35,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:35,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:35,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:35,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:35,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38255,1676243011361' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 23:03:35,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49dce8e9[Count = 1] remaining members to acquire global barrier 2023-02-12 23:03:35,301 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/.tmp/f1/7d11c3d608df4549b72890c0327c9f94 2023-02-12 23:03:35,311 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/.tmp/f2/de7232fc672b418fad3c27e558b0c4d8 2023-02-12 23:03:35,316 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/.tmp/f1/5ab82a03c2be403592ceca25343eaf5e as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f1/5ab82a03c2be403592ceca25343eaf5e 2023-02-12 23:03:35,320 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f1/5ab82a03c2be403592ceca25343eaf5e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:35,321 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/.tmp/f2/de7232fc672b418fad3c27e558b0c4d8 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f2/de7232fc672b418fad3c27e558b0c4d8 2023-02-12 23:03:35,325 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/.tmp/f2/0b796354e05147388641b52db655d869 2023-02-12 23:03:35,328 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f2/de7232fc672b418fad3c27e558b0c4d8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 23:03:35,329 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a67157f758d5013ff72d7e85b49d9033 in 58ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:35,329 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a67157f758d5013ff72d7e85b49d9033: 2023-02-12 23:03:35,329 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:35,329 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 23:03:35,332 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/.tmp/f1/7d11c3d608df4549b72890c0327c9f94 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f1/7d11c3d608df4549b72890c0327c9f94 2023-02-12 23:03:35,335 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f1/7d11c3d608df4549b72890c0327c9f94, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 23:03:35,336 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/.tmp/f2/0b796354e05147388641b52db655d869 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f2/0b796354e05147388641b52db655d869 2023-02-12 23:03:35,341 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f2/0b796354e05147388641b52db655d869, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 23:03:35,342 INFO [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for e128cbc418893503ff50d6c088a6d006 in 59ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:35,342 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e128cbc418893503ff50d6c088a6d006: 2023-02-12 23:03:35,342 DEBUG [rs(jenkins-hbase4.apache.org,43427,1676243011390)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:35,342 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 23:03:35,342 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 23:03:35,342 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,342 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 23:03:35,342 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43427,1676243011390' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 23:03:35,344 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,344 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:35,344 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,344 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:35,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:35,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:35,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43427,1676243011390' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 23:03:35,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49dce8e9[Count = 0] remaining members to acquire global barrier 2023-02-12 23:03:35,346 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-12 23:03:35,346 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,347 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,347 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,347 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 23:03:35,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,347 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 23:03:35,348 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,348 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43427,1676243011390' in zk 2023-02-12 23:03:35,348 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 23:03:35,348 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 23:03:35,348 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38255,1676243011361' in zk 2023-02-12 23:03:35,348 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,348 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 23:03:35,353 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,353 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 23:03:35,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:35,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:35,353 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:35,353 DEBUG [member: 'jenkins-hbase4.apache.org,43427,1676243011390' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 23:03:35,353 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,353 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 23:03:35,353 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:35,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:35,353 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1676243011361' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 23:03:35,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:35,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:35,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43427,1676243011390': 2023-02-12 23:03:35,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43427,1676243011390' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 23:03:35,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:35,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:35,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:35,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:35,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:35,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38255,1676243011361': 2023-02-12 23:03:35,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38255,1676243011361' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 23:03:35,358 INFO [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-12 23:03:35,358 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 23:03:35,358 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 23:03:35,358 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,358 INFO [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 23:03:35,360 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,360 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,360 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:35,360 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,360 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:35,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:35,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:35,361 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:35,361 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:35,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,363 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,363 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:35,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,366 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,366 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:35,366 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,366 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:35,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:35,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:35,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:35,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:35,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-12 23:03:35,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 23:03:35,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion because node does not exist (not an error) 2023-02-12 23:03:35,366 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:35,366 DEBUG [(jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:35,366 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:35,366 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,367 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,367 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:35,367 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,367 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:35,367 DEBUG [Listener at localhost/33219] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-12 23:03:35,367 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:35,367 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,367 DEBUG [Listener at localhost/33219] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 23:03:35,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:35,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:35,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:35,467 DEBUG [Listener at localhost/33219] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 23:03:35,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 23:03:35,473 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676243013878 type: FLUSH version: 2 ttl: 0 2023-02-12 23:03:35,474 DEBUG [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,474 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(239): region to add: 255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:35,474 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(239): region to add: 3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:35,474 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(239): region to add: 427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:35,474 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(239): region to add: b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:35,474 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(239): region to add: 3118215613336d661d6901cc41de476d 2023-02-12 23:03:35,474 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(239): region to add: df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:35,474 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(239): region to add: a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:35,474 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(239): region to add: 55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:35,474 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(239): region to add: b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:35,474 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(239): region to add: e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:35,475 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(585): clone region=255f26913e54145c6d5d7715ff69352f as 255f26913e54145c6d5d7715ff69352f in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,475 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(585): clone region=3cf12bce3359ee882a269ccd1199fb55 as 3cf12bce3359ee882a269ccd1199fb55 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,475 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(585): clone region=427c9bd94355639bcfaa338199010ecb as 427c9bd94355639bcfaa338199010ecb in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,475 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(585): clone region=b73c6c0b74cbd1b10bb1518dd12c20fb as b73c6c0b74cbd1b10bb1518dd12c20fb in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,475 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(585): clone region=3118215613336d661d6901cc41de476d as 3118215613336d661d6901cc41de476d in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,475 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(585): clone region=df920b05b5c05a2bf111eb40ef564602 as df920b05b5c05a2bf111eb40ef564602 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,475 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(585): clone region=a67157f758d5013ff72d7e85b49d9033 as a67157f758d5013ff72d7e85b49d9033 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,475 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(585): clone region=55fb2b8f1ac8b47848e354e0e6897bb3 as 55fb2b8f1ac8b47848e354e0e6897bb3 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,475 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(585): clone region=b0d590d5f4bbfca780b0295e86761238 as b0d590d5f4bbfca780b0295e86761238 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,475 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(585): clone region=e128cbc418893503ff50d6c088a6d006 as e128cbc418893503ff50d6c088a6d006 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,476 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 55fb2b8f1ac8b47848e354e0e6897bb3, NAME => 'testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a 2023-02-12 23:03:35,476 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 255f26913e54145c6d5d7715ff69352f, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a 2023-02-12 23:03:35,477 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => df920b05b5c05a2bf111eb40ef564602, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a 2023-02-12 23:03:35,477 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 3118215613336d661d6901cc41de476d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a 2023-02-12 23:03:35,477 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => b73c6c0b74cbd1b10bb1518dd12c20fb, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a 2023-02-12 23:03:35,477 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 427c9bd94355639bcfaa338199010ecb, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a 2023-02-12 23:03:35,478 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3cf12bce3359ee882a269ccd1199fb55, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a 2023-02-12 23:03:35,478 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => a67157f758d5013ff72d7e85b49d9033, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a 2023-02-12 23:03:35,500 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:35,500 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2ba815c60cc34ffdae5cf1b1be4f448a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,508 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:35,508 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bf5dc4657b314d7281fddb82128b3e37 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,510 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e4f522070e2246888854af39dfd9790b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,528 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:35,528 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 717dda8f540f427eb03f28501aeb4bca from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,529 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:35,529 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 44a9fe2cae3e427994a05a97004e1931 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,532 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 255f26913e54145c6d5d7715ff69352f, disabling compactions & flushes 2023-02-12 23:03:35,532 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:35,532 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:35,532 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:35,532 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ab06759e346546cc9f92fe26fd59e359 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,532 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. after waiting 0 ms 2023-02-12 23:03:35,532 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:35,533 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:35,533 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 255f26913e54145c6d5d7715ff69352f: Waiting for close lock at 1676243015532Disabling compacts and flushes for region at 1676243015532Disabling writes for close at 1676243015532Writing region close event to WAL at 1676243015533 (+1 ms)Closed at 1676243015533 2023-02-12 23:03:35,533 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b0d590d5f4bbfca780b0295e86761238, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a 2023-02-12 23:03:35,536 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cb50f806e93440f1971741c0f0585d35 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,536 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:35,536 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 55fb2b8f1ac8b47848e354e0e6897bb3, disabling compactions & flushes 2023-02-12 23:03:35,536 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:35,536 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:35,536 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. after waiting 0 ms 2023-02-12 23:03:35,536 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:35,536 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:35,536 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 55fb2b8f1ac8b47848e354e0e6897bb3: Waiting for close lock at 1676243015536Disabling compacts and flushes for region at 1676243015536Disabling writes for close at 1676243015536Writing region close event to WAL at 1676243015536Closed at 1676243015536 2023-02-12 23:03:35,537 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => e128cbc418893503ff50d6c088a6d006, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a 2023-02-12 23:03:35,540 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:35,540 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0f1ee91f58614274a4e3babe88312edd from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,544 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 20aa6af2a7564e3abf2b3fbcd5b1a3f9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,544 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7bb1a80d7bd9454aadea2994f51b2ab3 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,545 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 427c9bd94355639bcfaa338199010ecb, disabling compactions & flushes 2023-02-12 23:03:35,545 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:35,545 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:35,545 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. after waiting 0 ms 2023-02-12 23:03:35,545 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:35,545 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:35,545 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 427c9bd94355639bcfaa338199010ecb: Waiting for close lock at 1676243015545Disabling compacts and flushes for region at 1676243015545Disabling writes for close at 1676243015545Writing region close event to WAL at 1676243015545Closed at 1676243015545 2023-02-12 23:03:35,545 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:35,545 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing df920b05b5c05a2bf111eb40ef564602, disabling compactions & flushes 2023-02-12 23:03:35,545 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:35,545 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:35,545 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. after waiting 0 ms 2023-02-12 23:03:35,545 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:35,545 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:35,545 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for df920b05b5c05a2bf111eb40ef564602: Waiting for close lock at 1676243015545Disabling compacts and flushes for region at 1676243015545Disabling writes for close at 1676243015545Writing region close event to WAL at 1676243015545Closed at 1676243015545 2023-02-12 23:03:35,546 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 612bf29bd0fb4e6da4f471b6b892c584 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,547 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 65591026002c4904b324e2163a4e505a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,547 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing a67157f758d5013ff72d7e85b49d9033, disabling compactions & flushes 2023-02-12 23:03:35,547 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:35,547 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:35,547 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. after waiting 0 ms 2023-02-12 23:03:35,547 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:35,547 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:35,547 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for a67157f758d5013ff72d7e85b49d9033: Waiting for close lock at 1676243015547Disabling compacts and flushes for region at 1676243015547Disabling writes for close at 1676243015547Writing region close event to WAL at 1676243015547Closed at 1676243015547 2023-02-12 23:03:35,548 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 3118215613336d661d6901cc41de476d, disabling compactions & flushes 2023-02-12 23:03:35,548 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:35,548 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:35,548 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. after waiting 0 ms 2023-02-12 23:03:35,548 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:35,548 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:35,548 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 3118215613336d661d6901cc41de476d: Waiting for close lock at 1676243015548Disabling compacts and flushes for region at 1676243015548Disabling writes for close at 1676243015548Writing region close event to WAL at 1676243015548Closed at 1676243015548 2023-02-12 23:03:35,552 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:35,552 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b016fc17aa50474681f71b10b036ddae from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,552 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 3cf12bce3359ee882a269ccd1199fb55, disabling compactions & flushes 2023-02-12 23:03:35,552 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:35,552 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:35,552 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing b73c6c0b74cbd1b10bb1518dd12c20fb, disabling compactions & flushes 2023-02-12 23:03:35,553 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. after waiting 0 ms 2023-02-12 23:03:35,553 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:35,553 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:35,553 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:35,553 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:35,553 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 3cf12bce3359ee882a269ccd1199fb55: Waiting for close lock at 1676243015552Disabling compacts and flushes for region at 1676243015552Disabling writes for close at 1676243015553 (+1 ms)Writing region close event to WAL at 1676243015553Closed at 1676243015553 2023-02-12 23:03:35,553 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. after waiting 0 ms 2023-02-12 23:03:35,553 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:35,553 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:35,553 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for b73c6c0b74cbd1b10bb1518dd12c20fb: Waiting for close lock at 1676243015552Disabling compacts and flushes for region at 1676243015552Disabling writes for close at 1676243015553 (+1 ms)Writing region close event to WAL at 1676243015553Closed at 1676243015553 2023-02-12 23:03:35,555 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d2cec9141e1344ccae943aefafd150b3 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,555 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:35,555 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7db1c1ae91374979b7614449b0fef0af from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,556 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing e128cbc418893503ff50d6c088a6d006, disabling compactions & flushes 2023-02-12 23:03:35,556 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:35,556 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:35,556 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. after waiting 0 ms 2023-02-12 23:03:35,557 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:35,557 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:35,557 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for e128cbc418893503ff50d6c088a6d006: Waiting for close lock at 1676243015556Disabling compacts and flushes for region at 1676243015556Disabling writes for close at 1676243015557 (+1 ms)Writing region close event to WAL at 1676243015557Closed at 1676243015557 2023-02-12 23:03:35,557 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7cd41cab8665498a92f2a7da1c137efb from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:35,558 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b0d590d5f4bbfca780b0295e86761238, disabling compactions & flushes 2023-02-12 23:03:35,558 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:35,558 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:35,558 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. after waiting 0 ms 2023-02-12 23:03:35,558 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:35,558 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:35,559 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b0d590d5f4bbfca780b0295e86761238: Waiting for close lock at 1676243015558Disabling compacts and flushes for region at 1676243015558Disabling writes for close at 1676243015558Writing region close event to WAL at 1676243015558Closed at 1676243015558 2023-02-12 23:03:35,559 INFO [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676243013878 type: FLUSH version: 2 ttl: 0 2023-02-12 23:03:35,559 DEBUG [Listener at localhost/33219] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a 2023-02-12 23:03:35,559 DEBUG [Listener at localhost/33219] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a 2023-02-12 23:03:35,559 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-data/ 2023-02-12 23:03:35,560 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |----default/ 2023-02-12 23:03:35,560 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-12 23:03:35,560 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |----------255f26913e54145c6d5d7715ff69352f/ 2023-02-12 23:03:35,561 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:35,561 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:35,561 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=255f26913e54145c6d5d7715ff69352f-2ba815c60cc34ffdae5cf1b1be4f448a 2023-02-12 23:03:35,561 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:35,561 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=255f26913e54145c6d5d7715ff69352f-e4f522070e2246888854af39dfd9790b 2023-02-12 23:03:35,562 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |----------3118215613336d661d6901cc41de476d/ 2023-02-12 23:03:35,562 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:35,562 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:35,562 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3118215613336d661d6901cc41de476d-44a9fe2cae3e427994a05a97004e1931 2023-02-12 23:03:35,562 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:35,562 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3118215613336d661d6901cc41de476d-7bb1a80d7bd9454aadea2994f51b2ab3 2023-02-12 23:03:35,562 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |----------3cf12bce3359ee882a269ccd1199fb55/ 2023-02-12 23:03:35,563 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:35,563 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:35,563 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3cf12bce3359ee882a269ccd1199fb55-0f1ee91f58614274a4e3babe88312edd 2023-02-12 23:03:35,563 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:35,563 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3cf12bce3359ee882a269ccd1199fb55-65591026002c4904b324e2163a4e505a 2023-02-12 23:03:35,563 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |----------427c9bd94355639bcfaa338199010ecb/ 2023-02-12 23:03:35,564 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:35,564 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:35,564 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=427c9bd94355639bcfaa338199010ecb-bf5dc4657b314d7281fddb82128b3e37 2023-02-12 23:03:35,564 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:35,564 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=427c9bd94355639bcfaa338199010ecb-cb50f806e93440f1971741c0f0585d35 2023-02-12 23:03:35,564 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |----------55fb2b8f1ac8b47848e354e0e6897bb3/ 2023-02-12 23:03:35,565 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:35,565 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |----------a67157f758d5013ff72d7e85b49d9033/ 2023-02-12 23:03:35,565 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:35,565 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:35,565 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=a67157f758d5013ff72d7e85b49d9033-717dda8f540f427eb03f28501aeb4bca 2023-02-12 23:03:35,565 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:35,566 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=a67157f758d5013ff72d7e85b49d9033-20aa6af2a7564e3abf2b3fbcd5b1a3f9 2023-02-12 23:03:35,566 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |----------b0d590d5f4bbfca780b0295e86761238/ 2023-02-12 23:03:35,566 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:35,566 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:35,566 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b0d590d5f4bbfca780b0295e86761238-7db1c1ae91374979b7614449b0fef0af 2023-02-12 23:03:35,566 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:35,566 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b0d590d5f4bbfca780b0295e86761238-7cd41cab8665498a92f2a7da1c137efb 2023-02-12 23:03:35,567 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |----------b73c6c0b74cbd1b10bb1518dd12c20fb/ 2023-02-12 23:03:35,567 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:35,567 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:35,567 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b73c6c0b74cbd1b10bb1518dd12c20fb-ab06759e346546cc9f92fe26fd59e359 2023-02-12 23:03:35,567 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:35,567 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b73c6c0b74cbd1b10bb1518dd12c20fb-612bf29bd0fb4e6da4f471b6b892c584 2023-02-12 23:03:35,567 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |----------df920b05b5c05a2bf111eb40ef564602/ 2023-02-12 23:03:35,568 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:35,568 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |----------e128cbc418893503ff50d6c088a6d006/ 2023-02-12 23:03:35,568 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:35,568 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:35,568 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e128cbc418893503ff50d6c088a6d006-b016fc17aa50474681f71b10b036ddae 2023-02-12 23:03:35,568 DEBUG [Listener at localhost/33219] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:35,569 DEBUG [Listener at localhost/33219] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e128cbc418893503ff50d6c088a6d006-d2cec9141e1344ccae943aefafd150b3 2023-02-12 23:03:35,571 INFO [Listener at localhost/33219] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 23:03:36,085 DEBUG [Listener at localhost/33219] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:36,085 INFO [Listener at localhost/33219] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:36,087 DEBUG [Listener at localhost/33219] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:36,089 INFO [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:36,090 DEBUG [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f1 2023-02-12 23:03:36,090 INFO [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 427c9bd94355639bcfaa338199010ecb columnFamilyName f1 2023-02-12 23:03:36,094 DEBUG [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f1/testWithMockedMapReduceMultiRegion=427c9bd94355639bcfaa338199010ecb-bf5dc4657b314d7281fddb82128b3e37 2023-02-12 23:03:36,094 INFO [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] regionserver.HStore(310): Store=427c9bd94355639bcfaa338199010ecb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,094 INFO [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:36,095 DEBUG [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f2 2023-02-12 23:03:36,095 INFO [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 427c9bd94355639bcfaa338199010ecb columnFamilyName f2 2023-02-12 23:03:36,099 DEBUG [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f2/testWithMockedMapReduceMultiRegion=427c9bd94355639bcfaa338199010ecb-cb50f806e93440f1971741c0f0585d35 2023-02-12 23:03:36,099 INFO [StoreOpener-427c9bd94355639bcfaa338199010ecb-1] regionserver.HStore(310): Store=427c9bd94355639bcfaa338199010ecb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,099 DEBUG [Listener at localhost/33219] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:36,099 INFO [Listener at localhost/33219] regionserver.HRegion(1071): Opened 427c9bd94355639bcfaa338199010ecb; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71520143, jitterRate=0.0657331794500351}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:36,099 DEBUG [Listener at localhost/33219] regionserver.HRegion(964): Region open journal for 427c9bd94355639bcfaa338199010ecb: Writing region info on filesystem at 1676243016087Initializing all the Stores at 1676243016088 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016088Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016088Region opened successfully at 1676243016099 (+11 ms) 2023-02-12 23:03:36,109 DEBUG [Listener at localhost/33219] regionserver.HRegion(1603): Closing 427c9bd94355639bcfaa338199010ecb, disabling compactions & flushes 2023-02-12 23:03:36,110 INFO [Listener at localhost/33219] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:36,110 DEBUG [Listener at localhost/33219] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:36,110 DEBUG [Listener at localhost/33219] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. after waiting 0 ms 2023-02-12 23:03:36,110 DEBUG [Listener at localhost/33219] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:36,111 INFO [Listener at localhost/33219] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:36,111 DEBUG [Listener at localhost/33219] regionserver.HRegion(1557): Region close journal for 427c9bd94355639bcfaa338199010ecb: Waiting for close lock at 1676243016109Disabling compacts and flushes for region at 1676243016109Disabling writes for close at 1676243016110 (+1 ms)Writing region close event to WAL at 1676243016111 (+1 ms)Closed at 1676243016111 2023-02-12 23:03:36,111 DEBUG [Listener at localhost/33219] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:36,112 INFO [Listener at localhost/33219] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:36,114 DEBUG [Listener at localhost/33219] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:36,116 INFO [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:36,117 DEBUG [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f1 2023-02-12 23:03:36,117 INFO [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 255f26913e54145c6d5d7715ff69352f columnFamilyName f1 2023-02-12 23:03:36,121 DEBUG [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f1/testWithMockedMapReduceMultiRegion=255f26913e54145c6d5d7715ff69352f-2ba815c60cc34ffdae5cf1b1be4f448a 2023-02-12 23:03:36,121 INFO [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] regionserver.HStore(310): Store=255f26913e54145c6d5d7715ff69352f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,121 INFO [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:36,122 DEBUG [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f2 2023-02-12 23:03:36,122 INFO [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 255f26913e54145c6d5d7715ff69352f columnFamilyName f2 2023-02-12 23:03:36,126 DEBUG [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f2/testWithMockedMapReduceMultiRegion=255f26913e54145c6d5d7715ff69352f-e4f522070e2246888854af39dfd9790b 2023-02-12 23:03:36,126 INFO [StoreOpener-255f26913e54145c6d5d7715ff69352f-1] regionserver.HStore(310): Store=255f26913e54145c6d5d7715ff69352f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,126 DEBUG [Listener at localhost/33219] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:36,127 INFO [Listener at localhost/33219] regionserver.HRegion(1071): Opened 255f26913e54145c6d5d7715ff69352f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66501195, jitterRate=-0.009054973721504211}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:36,127 DEBUG [Listener at localhost/33219] regionserver.HRegion(964): Region open journal for 255f26913e54145c6d5d7715ff69352f: Writing region info on filesystem at 1676243016114Initializing all the Stores at 1676243016114Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016115 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016115Region opened successfully at 1676243016127 (+12 ms) 2023-02-12 23:03:36,137 DEBUG [Listener at localhost/33219] regionserver.HRegion(1603): Closing 255f26913e54145c6d5d7715ff69352f, disabling compactions & flushes 2023-02-12 23:03:36,138 INFO [Listener at localhost/33219] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:36,138 DEBUG [Listener at localhost/33219] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:36,138 DEBUG [Listener at localhost/33219] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. after waiting 0 ms 2023-02-12 23:03:36,138 DEBUG [Listener at localhost/33219] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:36,139 INFO [Listener at localhost/33219] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:36,139 DEBUG [Listener at localhost/33219] regionserver.HRegion(1557): Region close journal for 255f26913e54145c6d5d7715ff69352f: Waiting for close lock at 1676243016137Disabling compacts and flushes for region at 1676243016137Disabling writes for close at 1676243016138 (+1 ms)Writing region close event to WAL at 1676243016139 (+1 ms)Closed at 1676243016139 2023-02-12 23:03:36,139 DEBUG [Listener at localhost/33219] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:36,139 INFO [Listener at localhost/33219] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:36,141 DEBUG [Listener at localhost/33219] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:36,142 INFO [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:36,143 DEBUG [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f1 2023-02-12 23:03:36,143 INFO [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3cf12bce3359ee882a269ccd1199fb55 columnFamilyName f1 2023-02-12 23:03:36,149 DEBUG [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f1/testWithMockedMapReduceMultiRegion=3cf12bce3359ee882a269ccd1199fb55-0f1ee91f58614274a4e3babe88312edd 2023-02-12 23:03:36,149 INFO [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] regionserver.HStore(310): Store=3cf12bce3359ee882a269ccd1199fb55/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,149 INFO [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:36,150 DEBUG [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f2 2023-02-12 23:03:36,151 INFO [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3cf12bce3359ee882a269ccd1199fb55 columnFamilyName f2 2023-02-12 23:03:36,155 DEBUG [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f2/testWithMockedMapReduceMultiRegion=3cf12bce3359ee882a269ccd1199fb55-65591026002c4904b324e2163a4e505a 2023-02-12 23:03:36,155 INFO [StoreOpener-3cf12bce3359ee882a269ccd1199fb55-1] regionserver.HStore(310): Store=3cf12bce3359ee882a269ccd1199fb55/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,155 DEBUG [Listener at localhost/33219] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:36,155 INFO [Listener at localhost/33219] regionserver.HRegion(1071): Opened 3cf12bce3359ee882a269ccd1199fb55; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72591692, jitterRate=0.08170050382614136}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:36,155 DEBUG [Listener at localhost/33219] regionserver.HRegion(964): Region open journal for 3cf12bce3359ee882a269ccd1199fb55: Writing region info on filesystem at 1676243016141Initializing all the Stores at 1676243016141Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016141Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016141Region opened successfully at 1676243016155 (+14 ms) 2023-02-12 23:03:36,168 DEBUG [Listener at localhost/33219] regionserver.HRegion(1603): Closing 3cf12bce3359ee882a269ccd1199fb55, disabling compactions & flushes 2023-02-12 23:03:36,168 INFO [Listener at localhost/33219] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:36,169 DEBUG [Listener at localhost/33219] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:36,169 DEBUG [Listener at localhost/33219] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. after waiting 0 ms 2023-02-12 23:03:36,169 DEBUG [Listener at localhost/33219] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:36,169 INFO [Listener at localhost/33219] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:36,170 DEBUG [Listener at localhost/33219] regionserver.HRegion(1557): Region close journal for 3cf12bce3359ee882a269ccd1199fb55: Waiting for close lock at 1676243016168Disabling compacts and flushes for region at 1676243016168Disabling writes for close at 1676243016169 (+1 ms)Writing region close event to WAL at 1676243016169Closed at 1676243016169 2023-02-12 23:03:36,170 DEBUG [Listener at localhost/33219] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:36,170 INFO [Listener at localhost/33219] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:36,171 DEBUG [Listener at localhost/33219] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:36,173 INFO [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:36,174 DEBUG [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3/f1 2023-02-12 23:03:36,175 INFO [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55fb2b8f1ac8b47848e354e0e6897bb3 columnFamilyName f1 2023-02-12 23:03:36,175 INFO [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] regionserver.HStore(310): Store=55fb2b8f1ac8b47848e354e0e6897bb3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,176 INFO [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:36,177 DEBUG [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3/f2 2023-02-12 23:03:36,177 INFO [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55fb2b8f1ac8b47848e354e0e6897bb3 columnFamilyName f2 2023-02-12 23:03:36,177 INFO [StoreOpener-55fb2b8f1ac8b47848e354e0e6897bb3-1] regionserver.HStore(310): Store=55fb2b8f1ac8b47848e354e0e6897bb3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,178 DEBUG [Listener at localhost/33219] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:36,178 INFO [Listener at localhost/33219] regionserver.HRegion(1071): Opened 55fb2b8f1ac8b47848e354e0e6897bb3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63300445, jitterRate=-0.0567498654127121}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:36,178 DEBUG [Listener at localhost/33219] regionserver.HRegion(964): Region open journal for 55fb2b8f1ac8b47848e354e0e6897bb3: Writing region info on filesystem at 1676243016172Initializing all the Stores at 1676243016172Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016172Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016172Region opened successfully at 1676243016178 (+6 ms) 2023-02-12 23:03:36,178 DEBUG [Listener at localhost/33219] regionserver.HRegion(1603): Closing 55fb2b8f1ac8b47848e354e0e6897bb3, disabling compactions & flushes 2023-02-12 23:03:36,178 INFO [Listener at localhost/33219] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:36,178 DEBUG [Listener at localhost/33219] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:36,178 DEBUG [Listener at localhost/33219] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. after waiting 0 ms 2023-02-12 23:03:36,178 DEBUG [Listener at localhost/33219] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:36,178 INFO [Listener at localhost/33219] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:36,178 DEBUG [Listener at localhost/33219] regionserver.HRegion(1557): Region close journal for 55fb2b8f1ac8b47848e354e0e6897bb3: Waiting for close lock at 1676243016178Disabling compacts and flushes for region at 1676243016178Disabling writes for close at 1676243016178Writing region close event to WAL at 1676243016178Closed at 1676243016178 2023-02-12 23:03:36,179 DEBUG [Listener at localhost/33219] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:36,179 INFO [Listener at localhost/33219] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:36,180 DEBUG [Listener at localhost/33219] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:36,182 INFO [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:36,182 DEBUG [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f1 2023-02-12 23:03:36,183 INFO [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a67157f758d5013ff72d7e85b49d9033 columnFamilyName f1 2023-02-12 23:03:36,187 DEBUG [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f1/testWithMockedMapReduceMultiRegion=a67157f758d5013ff72d7e85b49d9033-717dda8f540f427eb03f28501aeb4bca 2023-02-12 23:03:36,187 INFO [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] regionserver.HStore(310): Store=a67157f758d5013ff72d7e85b49d9033/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,187 INFO [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:36,188 DEBUG [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f2 2023-02-12 23:03:36,188 INFO [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a67157f758d5013ff72d7e85b49d9033 columnFamilyName f2 2023-02-12 23:03:36,192 DEBUG [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f2/testWithMockedMapReduceMultiRegion=a67157f758d5013ff72d7e85b49d9033-20aa6af2a7564e3abf2b3fbcd5b1a3f9 2023-02-12 23:03:36,192 INFO [StoreOpener-a67157f758d5013ff72d7e85b49d9033-1] regionserver.HStore(310): Store=a67157f758d5013ff72d7e85b49d9033/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,192 DEBUG [Listener at localhost/33219] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:36,192 INFO [Listener at localhost/33219] regionserver.HRegion(1071): Opened a67157f758d5013ff72d7e85b49d9033; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66512977, jitterRate=-0.008879408240318298}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:36,192 DEBUG [Listener at localhost/33219] regionserver.HRegion(964): Region open journal for a67157f758d5013ff72d7e85b49d9033: Writing region info on filesystem at 1676243016180Initializing all the Stores at 1676243016181 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016181Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016181Region opened successfully at 1676243016192 (+11 ms) 2023-02-12 23:03:36,205 DEBUG [Listener at localhost/33219] regionserver.HRegion(1603): Closing a67157f758d5013ff72d7e85b49d9033, disabling compactions & flushes 2023-02-12 23:03:36,205 INFO [Listener at localhost/33219] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:36,205 DEBUG [Listener at localhost/33219] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:36,205 DEBUG [Listener at localhost/33219] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. after waiting 0 ms 2023-02-12 23:03:36,205 DEBUG [Listener at localhost/33219] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:36,208 INFO [Listener at localhost/33219] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:36,208 DEBUG [Listener at localhost/33219] regionserver.HRegion(1557): Region close journal for a67157f758d5013ff72d7e85b49d9033: Waiting for close lock at 1676243016205Disabling compacts and flushes for region at 1676243016205Disabling writes for close at 1676243016205Writing region close event to WAL at 1676243016208 (+3 ms)Closed at 1676243016208 2023-02-12 23:03:36,209 DEBUG [Listener at localhost/33219] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:36,209 INFO [Listener at localhost/33219] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:36,212 DEBUG [Listener at localhost/33219] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:36,213 INFO [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:36,215 DEBUG [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602/f1 2023-02-12 23:03:36,215 INFO [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df920b05b5c05a2bf111eb40ef564602 columnFamilyName f1 2023-02-12 23:03:36,215 INFO [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] regionserver.HStore(310): Store=df920b05b5c05a2bf111eb40ef564602/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,215 INFO [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:36,216 DEBUG [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602/f2 2023-02-12 23:03:36,216 INFO [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df920b05b5c05a2bf111eb40ef564602 columnFamilyName f2 2023-02-12 23:03:36,217 INFO [StoreOpener-df920b05b5c05a2bf111eb40ef564602-1] regionserver.HStore(310): Store=df920b05b5c05a2bf111eb40ef564602/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,217 DEBUG [Listener at localhost/33219] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:36,217 INFO [Listener at localhost/33219] regionserver.HRegion(1071): Opened df920b05b5c05a2bf111eb40ef564602; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66640248, jitterRate=-0.006982922554016113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:36,217 DEBUG [Listener at localhost/33219] regionserver.HRegion(964): Region open journal for df920b05b5c05a2bf111eb40ef564602: Writing region info on filesystem at 1676243016212Initializing all the Stores at 1676243016212Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016212Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016213 (+1 ms)Region opened successfully at 1676243016217 (+4 ms) 2023-02-12 23:03:36,217 DEBUG [Listener at localhost/33219] regionserver.HRegion(1603): Closing df920b05b5c05a2bf111eb40ef564602, disabling compactions & flushes 2023-02-12 23:03:36,217 INFO [Listener at localhost/33219] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:36,217 DEBUG [Listener at localhost/33219] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:36,217 DEBUG [Listener at localhost/33219] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. after waiting 0 ms 2023-02-12 23:03:36,217 DEBUG [Listener at localhost/33219] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:36,218 INFO [Listener at localhost/33219] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:36,218 DEBUG [Listener at localhost/33219] regionserver.HRegion(1557): Region close journal for df920b05b5c05a2bf111eb40ef564602: Waiting for close lock at 1676243016217Disabling compacts and flushes for region at 1676243016217Disabling writes for close at 1676243016217Writing region close event to WAL at 1676243016218 (+1 ms)Closed at 1676243016218 2023-02-12 23:03:36,218 DEBUG [Listener at localhost/33219] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:36,218 INFO [Listener at localhost/33219] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:36,219 DEBUG [Listener at localhost/33219] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:36,221 INFO [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:36,222 DEBUG [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f1 2023-02-12 23:03:36,222 INFO [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0d590d5f4bbfca780b0295e86761238 columnFamilyName f1 2023-02-12 23:03:36,226 DEBUG [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f1/testWithMockedMapReduceMultiRegion=b0d590d5f4bbfca780b0295e86761238-7db1c1ae91374979b7614449b0fef0af 2023-02-12 23:03:36,226 INFO [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] regionserver.HStore(310): Store=b0d590d5f4bbfca780b0295e86761238/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,226 INFO [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:36,227 DEBUG [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f2 2023-02-12 23:03:36,227 INFO [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0d590d5f4bbfca780b0295e86761238 columnFamilyName f2 2023-02-12 23:03:36,231 DEBUG [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f2/testWithMockedMapReduceMultiRegion=b0d590d5f4bbfca780b0295e86761238-7cd41cab8665498a92f2a7da1c137efb 2023-02-12 23:03:36,232 INFO [StoreOpener-b0d590d5f4bbfca780b0295e86761238-1] regionserver.HStore(310): Store=b0d590d5f4bbfca780b0295e86761238/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,232 DEBUG [Listener at localhost/33219] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:36,232 INFO [Listener at localhost/33219] regionserver.HRegion(1071): Opened b0d590d5f4bbfca780b0295e86761238; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69699493, jitterRate=0.03860338032245636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:36,232 DEBUG [Listener at localhost/33219] regionserver.HRegion(964): Region open journal for b0d590d5f4bbfca780b0295e86761238: Writing region info on filesystem at 1676243016220Initializing all the Stores at 1676243016220Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016220Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016220Region opened successfully at 1676243016232 (+12 ms) 2023-02-12 23:03:36,240 DEBUG [Listener at localhost/33219] regionserver.HRegion(1603): Closing b0d590d5f4bbfca780b0295e86761238, disabling compactions & flushes 2023-02-12 23:03:36,240 INFO [Listener at localhost/33219] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:36,240 DEBUG [Listener at localhost/33219] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:36,240 DEBUG [Listener at localhost/33219] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. after waiting 0 ms 2023-02-12 23:03:36,240 DEBUG [Listener at localhost/33219] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:36,241 INFO [Listener at localhost/33219] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:36,241 DEBUG [Listener at localhost/33219] regionserver.HRegion(1557): Region close journal for b0d590d5f4bbfca780b0295e86761238: Waiting for close lock at 1676243016240Disabling compacts and flushes for region at 1676243016240Disabling writes for close at 1676243016240Writing region close event to WAL at 1676243016241 (+1 ms)Closed at 1676243016241 2023-02-12 23:03:36,242 DEBUG [Listener at localhost/33219] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:36,242 INFO [Listener at localhost/33219] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:36,243 DEBUG [Listener at localhost/33219] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:36,245 INFO [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:36,246 DEBUG [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f1 2023-02-12 23:03:36,246 INFO [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e128cbc418893503ff50d6c088a6d006 columnFamilyName f1 2023-02-12 23:03:36,251 DEBUG [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f1/testWithMockedMapReduceMultiRegion=e128cbc418893503ff50d6c088a6d006-b016fc17aa50474681f71b10b036ddae 2023-02-12 23:03:36,251 INFO [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] regionserver.HStore(310): Store=e128cbc418893503ff50d6c088a6d006/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,251 INFO [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:36,252 DEBUG [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f2 2023-02-12 23:03:36,252 INFO [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e128cbc418893503ff50d6c088a6d006 columnFamilyName f2 2023-02-12 23:03:36,255 DEBUG [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f2/testWithMockedMapReduceMultiRegion=e128cbc418893503ff50d6c088a6d006-d2cec9141e1344ccae943aefafd150b3 2023-02-12 23:03:36,255 INFO [StoreOpener-e128cbc418893503ff50d6c088a6d006-1] regionserver.HStore(310): Store=e128cbc418893503ff50d6c088a6d006/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,255 DEBUG [Listener at localhost/33219] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:36,256 INFO [Listener at localhost/33219] regionserver.HRegion(1071): Opened e128cbc418893503ff50d6c088a6d006; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64279297, jitterRate=-0.04216383397579193}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:36,256 DEBUG [Listener at localhost/33219] regionserver.HRegion(964): Region open journal for e128cbc418893503ff50d6c088a6d006: Writing region info on filesystem at 1676243016243Initializing all the Stores at 1676243016244 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016244Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016244Region opened successfully at 1676243016256 (+12 ms) 2023-02-12 23:03:36,266 DEBUG [Listener at localhost/33219] regionserver.HRegion(1603): Closing e128cbc418893503ff50d6c088a6d006, disabling compactions & flushes 2023-02-12 23:03:36,266 INFO [Listener at localhost/33219] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:36,266 DEBUG [Listener at localhost/33219] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:36,266 DEBUG [Listener at localhost/33219] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. after waiting 0 ms 2023-02-12 23:03:36,266 DEBUG [Listener at localhost/33219] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:36,267 INFO [Listener at localhost/33219] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:36,267 DEBUG [Listener at localhost/33219] regionserver.HRegion(1557): Region close journal for e128cbc418893503ff50d6c088a6d006: Waiting for close lock at 1676243016266Disabling compacts and flushes for region at 1676243016266Disabling writes for close at 1676243016266Writing region close event to WAL at 1676243016267 (+1 ms)Closed at 1676243016267 2023-02-12 23:03:36,267 DEBUG [Listener at localhost/33219] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:36,267 INFO [Listener at localhost/33219] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:36,269 DEBUG [Listener at localhost/33219] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:36,270 INFO [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:36,271 DEBUG [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f1 2023-02-12 23:03:36,271 INFO [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b73c6c0b74cbd1b10bb1518dd12c20fb columnFamilyName f1 2023-02-12 23:03:36,275 DEBUG [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f1/testWithMockedMapReduceMultiRegion=b73c6c0b74cbd1b10bb1518dd12c20fb-ab06759e346546cc9f92fe26fd59e359 2023-02-12 23:03:36,275 INFO [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] regionserver.HStore(310): Store=b73c6c0b74cbd1b10bb1518dd12c20fb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,275 INFO [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:36,275 DEBUG [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f2 2023-02-12 23:03:36,276 INFO [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b73c6c0b74cbd1b10bb1518dd12c20fb columnFamilyName f2 2023-02-12 23:03:36,279 DEBUG [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f2/testWithMockedMapReduceMultiRegion=b73c6c0b74cbd1b10bb1518dd12c20fb-612bf29bd0fb4e6da4f471b6b892c584 2023-02-12 23:03:36,279 INFO [StoreOpener-b73c6c0b74cbd1b10bb1518dd12c20fb-1] regionserver.HStore(310): Store=b73c6c0b74cbd1b10bb1518dd12c20fb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,279 DEBUG [Listener at localhost/33219] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:36,279 INFO [Listener at localhost/33219] regionserver.HRegion(1071): Opened b73c6c0b74cbd1b10bb1518dd12c20fb; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68926099, jitterRate=0.027078911662101746}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:36,279 DEBUG [Listener at localhost/33219] regionserver.HRegion(964): Region open journal for b73c6c0b74cbd1b10bb1518dd12c20fb: Writing region info on filesystem at 1676243016269Initializing all the Stores at 1676243016269Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016269Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016269Region opened successfully at 1676243016279 (+10 ms) 2023-02-12 23:03:36,287 DEBUG [Listener at localhost/33219] regionserver.HRegion(1603): Closing b73c6c0b74cbd1b10bb1518dd12c20fb, disabling compactions & flushes 2023-02-12 23:03:36,287 INFO [Listener at localhost/33219] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:36,287 DEBUG [Listener at localhost/33219] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:36,288 DEBUG [Listener at localhost/33219] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. after waiting 0 ms 2023-02-12 23:03:36,288 DEBUG [Listener at localhost/33219] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:36,288 INFO [Listener at localhost/33219] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:36,288 DEBUG [Listener at localhost/33219] regionserver.HRegion(1557): Region close journal for b73c6c0b74cbd1b10bb1518dd12c20fb: Waiting for close lock at 1676243016287Disabling compacts and flushes for region at 1676243016287Disabling writes for close at 1676243016288 (+1 ms)Writing region close event to WAL at 1676243016288Closed at 1676243016288 2023-02-12 23:03:36,289 DEBUG [Listener at localhost/33219] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:36,289 INFO [Listener at localhost/33219] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:36,290 DEBUG [Listener at localhost/33219] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:36,292 INFO [StoreOpener-3118215613336d661d6901cc41de476d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3118215613336d661d6901cc41de476d 2023-02-12 23:03:36,292 DEBUG [StoreOpener-3118215613336d661d6901cc41de476d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f1 2023-02-12 23:03:36,293 INFO [StoreOpener-3118215613336d661d6901cc41de476d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3118215613336d661d6901cc41de476d columnFamilyName f1 2023-02-12 23:03:36,297 DEBUG [StoreOpener-3118215613336d661d6901cc41de476d-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f1/testWithMockedMapReduceMultiRegion=3118215613336d661d6901cc41de476d-44a9fe2cae3e427994a05a97004e1931 2023-02-12 23:03:36,297 INFO [StoreOpener-3118215613336d661d6901cc41de476d-1] regionserver.HStore(310): Store=3118215613336d661d6901cc41de476d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,297 INFO [StoreOpener-3118215613336d661d6901cc41de476d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3118215613336d661d6901cc41de476d 2023-02-12 23:03:36,297 DEBUG [StoreOpener-3118215613336d661d6901cc41de476d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f2 2023-02-12 23:03:36,298 INFO [StoreOpener-3118215613336d661d6901cc41de476d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3118215613336d661d6901cc41de476d columnFamilyName f2 2023-02-12 23:03:36,301 DEBUG [StoreOpener-3118215613336d661d6901cc41de476d-1] regionserver.HStore(539): loaded hdfs://localhost:36899/user/jenkins/test-data/7d104003-20b8-0d8b-500f-b1e3f42a16bd/testWithMockedMapReduceMultiRegion/73a56243-1eff-4d3d-8408-8d0cb142672a/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f2/testWithMockedMapReduceMultiRegion=3118215613336d661d6901cc41de476d-7bb1a80d7bd9454aadea2994f51b2ab3 2023-02-12 23:03:36,301 INFO [StoreOpener-3118215613336d661d6901cc41de476d-1] regionserver.HStore(310): Store=3118215613336d661d6901cc41de476d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:36,301 DEBUG [Listener at localhost/33219] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:36,301 INFO [Listener at localhost/33219] regionserver.HRegion(1071): Opened 3118215613336d661d6901cc41de476d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65539465, jitterRate=-0.023385867476463318}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:36,302 DEBUG [Listener at localhost/33219] regionserver.HRegion(964): Region open journal for 3118215613336d661d6901cc41de476d: Writing region info on filesystem at 1676243016290Initializing all the Stores at 1676243016291 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016291Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243016291Region opened successfully at 1676243016301 (+10 ms) 2023-02-12 23:03:36,310 DEBUG [Listener at localhost/33219] regionserver.HRegion(1603): Closing 3118215613336d661d6901cc41de476d, disabling compactions & flushes 2023-02-12 23:03:36,310 INFO [Listener at localhost/33219] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:36,310 DEBUG [Listener at localhost/33219] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:36,310 DEBUG [Listener at localhost/33219] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. after waiting 0 ms 2023-02-12 23:03:36,310 DEBUG [Listener at localhost/33219] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:36,310 INFO [Listener at localhost/33219] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:36,311 DEBUG [Listener at localhost/33219] regionserver.HRegion(1557): Region close journal for 3118215613336d661d6901cc41de476d: Waiting for close lock at 1676243016310Disabling compacts and flushes for region at 1676243016310Disabling writes for close at 1676243016310Writing region close event to WAL at 1676243016310Closed at 1676243016310 2023-02-12 23:03:36,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-12 23:03:36,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-12 23:03:36,318 INFO [Listener at localhost/33219] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-12 23:03:36,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-12 23:03:36,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:36,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 23:03:36,321 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243016321"}]},"ts":"1676243016321"} 2023-02-12 23:03:36,322 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-12 23:03:36,325 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-12 23:03:36,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55fb2b8f1ac8b47848e354e0e6897bb3, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=427c9bd94355639bcfaa338199010ecb, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=255f26913e54145c6d5d7715ff69352f, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b73c6c0b74cbd1b10bb1518dd12c20fb, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3cf12bce3359ee882a269ccd1199fb55, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0d590d5f4bbfca780b0295e86761238, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a67157f758d5013ff72d7e85b49d9033, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3118215613336d661d6901cc41de476d, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e128cbc418893503ff50d6c088a6d006, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=df920b05b5c05a2bf111eb40ef564602, UNASSIGN}] 2023-02-12 23:03:36,327 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0d590d5f4bbfca780b0295e86761238, UNASSIGN 2023-02-12 23:03:36,327 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=427c9bd94355639bcfaa338199010ecb, UNASSIGN 2023-02-12 23:03:36,327 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=255f26913e54145c6d5d7715ff69352f, UNASSIGN 2023-02-12 23:03:36,328 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55fb2b8f1ac8b47848e354e0e6897bb3, UNASSIGN 2023-02-12 23:03:36,328 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=df920b05b5c05a2bf111eb40ef564602, UNASSIGN 2023-02-12 23:03:36,328 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=b0d590d5f4bbfca780b0295e86761238, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:36,328 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=427c9bd94355639bcfaa338199010ecb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:36,328 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=255f26913e54145c6d5d7715ff69352f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:36,328 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016328"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243016328"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243016328"}]},"ts":"1676243016328"} 2023-02-12 23:03:36,328 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676243012625.255f26913e54145c6d5d7715ff69352f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016328"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243016328"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243016328"}]},"ts":"1676243016328"} 2023-02-12 23:03:36,328 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016328"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243016328"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243016328"}]},"ts":"1676243016328"} 2023-02-12 23:03:36,328 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=df920b05b5c05a2bf111eb40ef564602, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:36,328 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=55fb2b8f1ac8b47848e354e0e6897bb3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:36,328 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676243016328"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243016328"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243016328"}]},"ts":"1676243016328"} 2023-02-12 23:03:36,329 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676243016328"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243016328"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243016328"}]},"ts":"1676243016328"} 2023-02-12 23:03:36,330 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=36, state=RUNNABLE; CloseRegionProcedure 255f26913e54145c6d5d7715ff69352f, server=jenkins-hbase4.apache.org,38255,1676243011361}] 2023-02-12 23:03:36,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=39, state=RUNNABLE; CloseRegionProcedure b0d590d5f4bbfca780b0295e86761238, server=jenkins-hbase4.apache.org,38255,1676243011361}] 2023-02-12 23:03:36,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=35, state=RUNNABLE; CloseRegionProcedure 427c9bd94355639bcfaa338199010ecb, server=jenkins-hbase4.apache.org,43427,1676243011390}] 2023-02-12 23:03:36,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure df920b05b5c05a2bf111eb40ef564602, server=jenkins-hbase4.apache.org,38255,1676243011361}] 2023-02-12 23:03:36,332 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=34, state=RUNNABLE; CloseRegionProcedure 55fb2b8f1ac8b47848e354e0e6897bb3, server=jenkins-hbase4.apache.org,38255,1676243011361}] 2023-02-12 23:03:36,333 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e128cbc418893503ff50d6c088a6d006, UNASSIGN 2023-02-12 23:03:36,333 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3118215613336d661d6901cc41de476d, UNASSIGN 2023-02-12 23:03:36,334 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=e128cbc418893503ff50d6c088a6d006, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:36,334 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243016334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243016334"}]},"ts":"1676243016334"} 2023-02-12 23:03:36,334 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3118215613336d661d6901cc41de476d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:36,334 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a67157f758d5013ff72d7e85b49d9033, UNASSIGN 2023-02-12 23:03:36,334 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243016334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243016334"}]},"ts":"1676243016334"} 2023-02-12 23:03:36,334 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3cf12bce3359ee882a269ccd1199fb55, UNASSIGN 2023-02-12 23:03:36,335 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b73c6c0b74cbd1b10bb1518dd12c20fb, UNASSIGN 2023-02-12 23:03:36,335 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=3cf12bce3359ee882a269ccd1199fb55, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:36,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure e128cbc418893503ff50d6c088a6d006, server=jenkins-hbase4.apache.org,43427,1676243011390}] 2023-02-12 23:03:36,335 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a67157f758d5013ff72d7e85b49d9033, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:36,335 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016335"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243016335"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243016335"}]},"ts":"1676243016335"} 2023-02-12 23:03:36,335 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016335"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243016335"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243016335"}]},"ts":"1676243016335"} 2023-02-12 23:03:36,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 3118215613336d661d6901cc41de476d, server=jenkins-hbase4.apache.org,38255,1676243011361}] 2023-02-12 23:03:36,336 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b73c6c0b74cbd1b10bb1518dd12c20fb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:36,336 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243016336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243016336"}]},"ts":"1676243016336"} 2023-02-12 23:03:36,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=38, state=RUNNABLE; CloseRegionProcedure 3cf12bce3359ee882a269ccd1199fb55, server=jenkins-hbase4.apache.org,43427,1676243011390}] 2023-02-12 23:03:36,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=40, state=RUNNABLE; CloseRegionProcedure a67157f758d5013ff72d7e85b49d9033, server=jenkins-hbase4.apache.org,43427,1676243011390}] 2023-02-12 23:03:36,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=37, state=RUNNABLE; CloseRegionProcedure b73c6c0b74cbd1b10bb1518dd12c20fb, server=jenkins-hbase4.apache.org,43427,1676243011390}] 2023-02-12 23:03:36,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 23:03:36,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:36,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b0d590d5f4bbfca780b0295e86761238, disabling compactions & flushes 2023-02-12 23:03:36,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:36,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:36,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. after waiting 0 ms 2023-02-12 23:03:36,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:36,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:36,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3cf12bce3359ee882a269ccd1199fb55, disabling compactions & flushes 2023-02-12 23:03:36,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:36,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:36,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. after waiting 0 ms 2023-02-12 23:03:36,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:36,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:36,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238. 2023-02-12 23:03:36,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b0d590d5f4bbfca780b0295e86761238: Waiting for close lock at 1676243016482Running coprocessor pre-close hooks at 1676243016482Disabling compacts and flushes for region at 1676243016482Disabling writes for close at 1676243016482Writing region close event to WAL at 1676243016483 (+1 ms)Running coprocessor post-close hooks at 1676243016487 (+4 ms)Closed at 1676243016487 2023-02-12 23:03:36,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:36,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55. 2023-02-12 23:03:36,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3cf12bce3359ee882a269ccd1199fb55: Waiting for close lock at 1676243016484Running coprocessor pre-close hooks at 1676243016484Disabling compacts and flushes for region at 1676243016484Disabling writes for close at 1676243016484Writing region close event to WAL at 1676243016485 (+1 ms)Running coprocessor post-close hooks at 1676243016488 (+3 ms)Closed at 1676243016488 2023-02-12 23:03:36,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:36,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:36,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing df920b05b5c05a2bf111eb40ef564602, disabling compactions & flushes 2023-02-12 23:03:36,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:36,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:36,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. after waiting 0 ms 2023-02-12 23:03:36,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:36,488 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=b0d590d5f4bbfca780b0295e86761238, regionState=CLOSED 2023-02-12 23:03:36,488 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016488"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243016488"}]},"ts":"1676243016488"} 2023-02-12 23:03:36,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:36,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:36,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b73c6c0b74cbd1b10bb1518dd12c20fb, disabling compactions & flushes 2023-02-12 23:03:36,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:36,489 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=3cf12bce3359ee882a269ccd1199fb55, regionState=CLOSED 2023-02-12 23:03:36,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:36,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. after waiting 0 ms 2023-02-12 23:03:36,490 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243016489"}]},"ts":"1676243016489"} 2023-02-12 23:03:36,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:36,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=39 2023-02-12 23:03:36,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 23:03:36,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=39, state=SUCCESS; CloseRegionProcedure b0d590d5f4bbfca780b0295e86761238, server=jenkins-hbase4.apache.org,38255,1676243011361 in 160 msec 2023-02-12 23:03:36,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602. 2023-02-12 23:03:36,493 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=38 2023-02-12 23:03:36,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for df920b05b5c05a2bf111eb40ef564602: Waiting for close lock at 1676243016488Running coprocessor pre-close hooks at 1676243016488Disabling compacts and flushes for region at 1676243016488Disabling writes for close at 1676243016488Writing region close event to WAL at 1676243016489 (+1 ms)Running coprocessor post-close hooks at 1676243016493 (+4 ms)Closed at 1676243016493 2023-02-12 23:03:36,493 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=38, state=SUCCESS; CloseRegionProcedure 3cf12bce3359ee882a269ccd1199fb55, server=jenkins-hbase4.apache.org,43427,1676243011390 in 154 msec 2023-02-12 23:03:36,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0d590d5f4bbfca780b0295e86761238, UNASSIGN in 167 msec 2023-02-12 23:03:36,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:36,494 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3cf12bce3359ee882a269ccd1199fb55, UNASSIGN in 168 msec 2023-02-12 23:03:36,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:36,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:36,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 55fb2b8f1ac8b47848e354e0e6897bb3, disabling compactions & flushes 2023-02-12 23:03:36,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:36,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:36,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb. 2023-02-12 23:03:36,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. after waiting 0 ms 2023-02-12 23:03:36,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:36,494 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=df920b05b5c05a2bf111eb40ef564602, regionState=CLOSED 2023-02-12 23:03:36,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b73c6c0b74cbd1b10bb1518dd12c20fb: Waiting for close lock at 1676243016489Running coprocessor pre-close hooks at 1676243016489Disabling compacts and flushes for region at 1676243016489Disabling writes for close at 1676243016490 (+1 ms)Writing region close event to WAL at 1676243016491 (+1 ms)Running coprocessor post-close hooks at 1676243016494 (+3 ms)Closed at 1676243016494 2023-02-12 23:03:36,494 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676243016494"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243016494"}]},"ts":"1676243016494"} 2023-02-12 23:03:36,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:36,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:36,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a67157f758d5013ff72d7e85b49d9033, disabling compactions & flushes 2023-02-12 23:03:36,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:36,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:36,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. after waiting 0 ms 2023-02-12 23:03:36,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:36,496 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b73c6c0b74cbd1b10bb1518dd12c20fb, regionState=CLOSED 2023-02-12 23:03:36,496 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016496"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243016496"}]},"ts":"1676243016496"} 2023-02-12 23:03:36,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 23:03:36,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3. 2023-02-12 23:03:36,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 55fb2b8f1ac8b47848e354e0e6897bb3: Waiting for close lock at 1676243016494Running coprocessor pre-close hooks at 1676243016494Disabling compacts and flushes for region at 1676243016494Disabling writes for close at 1676243016494Writing region close event to WAL at 1676243016495 (+1 ms)Running coprocessor post-close hooks at 1676243016498 (+3 ms)Closed at 1676243016498 2023-02-12 23:03:36,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:36,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033. 2023-02-12 23:03:36,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a67157f758d5013ff72d7e85b49d9033: Waiting for close lock at 1676243016496Running coprocessor pre-close hooks at 1676243016496Disabling compacts and flushes for region at 1676243016496Disabling writes for close at 1676243016496Writing region close event to WAL at 1676243016497 (+1 ms)Running coprocessor post-close hooks at 1676243016500 (+3 ms)Closed at 1676243016500 2023-02-12 23:03:36,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-12 23:03:36,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure df920b05b5c05a2bf111eb40ef564602, server=jenkins-hbase4.apache.org,38255,1676243011361 in 164 msec 2023-02-12 23:03:36,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:36,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3118215613336d661d6901cc41de476d 2023-02-12 23:03:36,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3118215613336d661d6901cc41de476d, disabling compactions & flushes 2023-02-12 23:03:36,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:36,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:36,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. after waiting 0 ms 2023-02-12 23:03:36,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:36,502 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=55fb2b8f1ac8b47848e354e0e6897bb3, regionState=CLOSED 2023-02-12 23:03:36,503 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676243016502"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243016502"}]},"ts":"1676243016502"} 2023-02-12 23:03:36,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:36,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:36,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 427c9bd94355639bcfaa338199010ecb, disabling compactions & flushes 2023-02-12 23:03:36,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:36,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:36,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. after waiting 0 ms 2023-02-12 23:03:36,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:36,503 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=df920b05b5c05a2bf111eb40ef564602, UNASSIGN in 177 msec 2023-02-12 23:03:36,503 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=37 2023-02-12 23:03:36,503 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a67157f758d5013ff72d7e85b49d9033, regionState=CLOSED 2023-02-12 23:03:36,503 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=37, state=SUCCESS; CloseRegionProcedure b73c6c0b74cbd1b10bb1518dd12c20fb, server=jenkins-hbase4.apache.org,43427,1676243011390 in 157 msec 2023-02-12 23:03:36,503 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016503"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243016503"}]},"ts":"1676243016503"} 2023-02-12 23:03:36,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b73c6c0b74cbd1b10bb1518dd12c20fb, UNASSIGN in 178 msec 2023-02-12 23:03:36,506 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=34 2023-02-12 23:03:36,506 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=34, state=SUCCESS; CloseRegionProcedure 55fb2b8f1ac8b47848e354e0e6897bb3, server=jenkins-hbase4.apache.org,38255,1676243011361 in 172 msec 2023-02-12 23:03:36,507 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=40 2023-02-12 23:03:36,507 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=40, state=SUCCESS; CloseRegionProcedure a67157f758d5013ff72d7e85b49d9033, server=jenkins-hbase4.apache.org,43427,1676243011390 in 167 msec 2023-02-12 23:03:36,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55fb2b8f1ac8b47848e354e0e6897bb3, UNASSIGN in 181 msec 2023-02-12 23:03:36,508 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a67157f758d5013ff72d7e85b49d9033, UNASSIGN in 182 msec 2023-02-12 23:03:36,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:36,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:36,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d. 2023-02-12 23:03:36,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3118215613336d661d6901cc41de476d: Waiting for close lock at 1676243016502Running coprocessor pre-close hooks at 1676243016502Disabling compacts and flushes for region at 1676243016502Disabling writes for close at 1676243016502Writing region close event to WAL at 1676243016505 (+3 ms)Running coprocessor post-close hooks at 1676243016509 (+4 ms)Closed at 1676243016509 2023-02-12 23:03:36,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb. 2023-02-12 23:03:36,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 427c9bd94355639bcfaa338199010ecb: Waiting for close lock at 1676243016503Running coprocessor pre-close hooks at 1676243016503Disabling compacts and flushes for region at 1676243016503Disabling writes for close at 1676243016503Writing region close event to WAL at 1676243016506 (+3 ms)Running coprocessor post-close hooks at 1676243016509 (+3 ms)Closed at 1676243016509 2023-02-12 23:03:36,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3118215613336d661d6901cc41de476d 2023-02-12 23:03:36,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:36,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 255f26913e54145c6d5d7715ff69352f, disabling compactions & flushes 2023-02-12 23:03:36,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:36,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:36,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. after waiting 0 ms 2023-02-12 23:03:36,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:36,510 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3118215613336d661d6901cc41de476d, regionState=CLOSED 2023-02-12 23:03:36,511 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016510"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243016510"}]},"ts":"1676243016510"} 2023-02-12 23:03:36,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:36,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:36,511 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=427c9bd94355639bcfaa338199010ecb, regionState=CLOSED 2023-02-12 23:03:36,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e128cbc418893503ff50d6c088a6d006, disabling compactions & flushes 2023-02-12 23:03:36,511 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016511"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243016511"}]},"ts":"1676243016511"} 2023-02-12 23:03:36,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:36,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:36,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. after waiting 0 ms 2023-02-12 23:03:36,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:36,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-12 23:03:36,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 3118215613336d661d6901cc41de476d, server=jenkins-hbase4.apache.org,38255,1676243011361 in 176 msec 2023-02-12 23:03:36,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=35 2023-02-12 23:03:36,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=35, state=SUCCESS; CloseRegionProcedure 427c9bd94355639bcfaa338199010ecb, server=jenkins-hbase4.apache.org,43427,1676243011390 in 182 msec 2023-02-12 23:03:36,516 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3118215613336d661d6901cc41de476d, UNASSIGN in 190 msec 2023-02-12 23:03:36,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=427c9bd94355639bcfaa338199010ecb, UNASSIGN in 190 msec 2023-02-12 23:03:36,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:36,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:36,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f. 2023-02-12 23:03:36,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006. 2023-02-12 23:03:36,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 255f26913e54145c6d5d7715ff69352f: Waiting for close lock at 1676243016510Running coprocessor pre-close hooks at 1676243016510Disabling compacts and flushes for region at 1676243016510Disabling writes for close at 1676243016510Writing region close event to WAL at 1676243016513 (+3 ms)Running coprocessor post-close hooks at 1676243016521 (+8 ms)Closed at 1676243016521 2023-02-12 23:03:36,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e128cbc418893503ff50d6c088a6d006: Waiting for close lock at 1676243016511Running coprocessor pre-close hooks at 1676243016511Disabling compacts and flushes for region at 1676243016511Disabling writes for close at 1676243016511Writing region close event to WAL at 1676243016513 (+2 ms)Running coprocessor post-close hooks at 1676243016521 (+8 ms)Closed at 1676243016521 2023-02-12 23:03:36,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:36,523 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=255f26913e54145c6d5d7715ff69352f, regionState=CLOSED 2023-02-12 23:03:36,523 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676243012625.255f26913e54145c6d5d7715ff69352f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016523"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243016523"}]},"ts":"1676243016523"} 2023-02-12 23:03:36,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:36,524 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=e128cbc418893503ff50d6c088a6d006, regionState=CLOSED 2023-02-12 23:03:36,524 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676243016524"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243016524"}]},"ts":"1676243016524"} 2023-02-12 23:03:36,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=36 2023-02-12 23:03:36,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=36, state=SUCCESS; CloseRegionProcedure 255f26913e54145c6d5d7715ff69352f, server=jenkins-hbase4.apache.org,38255,1676243011361 in 194 msec 2023-02-12 23:03:36,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-12 23:03:36,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure e128cbc418893503ff50d6c088a6d006, server=jenkins-hbase4.apache.org,43427,1676243011390 in 190 msec 2023-02-12 23:03:36,526 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=255f26913e54145c6d5d7715ff69352f, UNASSIGN in 201 msec 2023-02-12 23:03:36,527 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=33 2023-02-12 23:03:36,527 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e128cbc418893503ff50d6c088a6d006, UNASSIGN in 201 msec 2023-02-12 23:03:36,528 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243016528"}]},"ts":"1676243016528"} 2023-02-12 23:03:36,529 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-12 23:03:36,530 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-12 23:03:36,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 213 msec 2023-02-12 23:03:36,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 23:03:36,624 INFO [Listener at localhost/33219] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-12 23:03:36,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-12 23:03:36,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:36,627 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:36,628 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:36,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 23:03:36,638 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:36,638 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:36,638 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:36,638 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:36,638 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d 2023-02-12 23:03:36,638 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:36,638 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:36,638 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:36,641 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f1, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f2, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/recovered.edits] 2023-02-12 23:03:36,642 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f1, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f2, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/recovered.edits] 2023-02-12 23:03:36,642 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f1, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f2, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/recovered.edits] 2023-02-12 23:03:36,642 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3/f1, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3/f2, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3/recovered.edits] 2023-02-12 23:03:36,643 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f1, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f2, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/recovered.edits] 2023-02-12 23:03:36,643 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f1, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f2, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/recovered.edits] 2023-02-12 23:03:36,643 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f1, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f2, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/recovered.edits] 2023-02-12 23:03:36,643 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f1, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f2, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/recovered.edits] 2023-02-12 23:03:36,650 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f1/2ba815c60cc34ffdae5cf1b1be4f448a to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f1/2ba815c60cc34ffdae5cf1b1be4f448a 2023-02-12 23:03:36,651 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f1/0f1ee91f58614274a4e3babe88312edd to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f1/0f1ee91f58614274a4e3babe88312edd 2023-02-12 23:03:36,651 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f1/3c4712e903174c159398923723a246d2 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f1/3c4712e903174c159398923723a246d2 2023-02-12 23:03:36,652 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f1/bf5dc4657b314d7281fddb82128b3e37 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f1/bf5dc4657b314d7281fddb82128b3e37 2023-02-12 23:03:36,652 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f1/7db1c1ae91374979b7614449b0fef0af to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f1/7db1c1ae91374979b7614449b0fef0af 2023-02-12 23:03:36,653 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f1/ab06759e346546cc9f92fe26fd59e359 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f1/ab06759e346546cc9f92fe26fd59e359 2023-02-12 23:03:36,653 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f1/5ab82a03c2be403592ceca25343eaf5e to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f1/5ab82a03c2be403592ceca25343eaf5e 2023-02-12 23:03:36,654 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f1/bf5ebea0407f4942b0aa27ca99f9752d to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f1/bf5ebea0407f4942b0aa27ca99f9752d 2023-02-12 23:03:36,655 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f1/44a9fe2cae3e427994a05a97004e1931 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f1/44a9fe2cae3e427994a05a97004e1931 2023-02-12 23:03:36,655 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f1/de8d76be29d244aca73162f6c2d60563 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f1/de8d76be29d244aca73162f6c2d60563 2023-02-12 23:03:36,655 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f1/e6699d7a7cbb4a4789960fb334fcee3f to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f1/e6699d7a7cbb4a4789960fb334fcee3f 2023-02-12 23:03:36,655 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f1/c1e82f34307143fbb2126a5642a344b8 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f1/c1e82f34307143fbb2126a5642a344b8 2023-02-12 23:03:36,655 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f1/bc9d85117a164a839a502b145a18c1ed to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f1/bc9d85117a164a839a502b145a18c1ed 2023-02-12 23:03:36,656 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3/recovered.edits/6.seqid to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3/recovered.edits/6.seqid 2023-02-12 23:03:36,657 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f1/717dda8f540f427eb03f28501aeb4bca to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f1/717dda8f540f427eb03f28501aeb4bca 2023-02-12 23:03:36,657 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/55fb2b8f1ac8b47848e354e0e6897bb3 2023-02-12 23:03:36,657 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:36,661 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f1, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f2, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/recovered.edits] 2023-02-12 23:03:36,662 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f2/15b4168e68f8467f830cae041cacf6ea to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f2/15b4168e68f8467f830cae041cacf6ea 2023-02-12 23:03:36,662 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f2/2c25515b907a4de9a6b7f039cfcc31a3 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f2/2c25515b907a4de9a6b7f039cfcc31a3 2023-02-12 23:03:36,663 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f2/7cd41cab8665498a92f2a7da1c137efb to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f2/7cd41cab8665498a92f2a7da1c137efb 2023-02-12 23:03:36,663 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f2/7c68b815db0648efa1edf9a8b2644a49 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f2/7c68b815db0648efa1edf9a8b2644a49 2023-02-12 23:03:36,663 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f2/40d24e2c0bcd4f8f92325e98b50034c9 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f2/40d24e2c0bcd4f8f92325e98b50034c9 2023-02-12 23:03:36,663 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f2/20aa6af2a7564e3abf2b3fbcd5b1a3f9 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f2/20aa6af2a7564e3abf2b3fbcd5b1a3f9 2023-02-12 23:03:36,665 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f2/612bf29bd0fb4e6da4f471b6b892c584 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f2/612bf29bd0fb4e6da4f471b6b892c584 2023-02-12 23:03:36,665 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f2/e4f522070e2246888854af39dfd9790b to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/f2/e4f522070e2246888854af39dfd9790b 2023-02-12 23:03:36,666 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f2/7bb1a80d7bd9454aadea2994f51b2ab3 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/f2/7bb1a80d7bd9454aadea2994f51b2ab3 2023-02-12 23:03:36,666 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f2/65591026002c4904b324e2163a4e505a to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/f2/65591026002c4904b324e2163a4e505a 2023-02-12 23:03:36,666 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f2/cb50f806e93440f1971741c0f0585d35 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/f2/cb50f806e93440f1971741c0f0585d35 2023-02-12 23:03:36,666 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f2/d00cd305e50f403bb9e10f9cc52f91f8 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/f2/d00cd305e50f403bb9e10f9cc52f91f8 2023-02-12 23:03:36,666 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f2/de7232fc672b418fad3c27e558b0c4d8 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/f2/de7232fc672b418fad3c27e558b0c4d8 2023-02-12 23:03:36,668 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f2/ed7b34dfcc2542229e98849c8113ca38 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/f2/ed7b34dfcc2542229e98849c8113ca38 2023-02-12 23:03:36,670 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f1/7d11c3d608df4549b72890c0327c9f94 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f1/7d11c3d608df4549b72890c0327c9f94 2023-02-12 23:03:36,672 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/recovered.edits/12.seqid to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb/recovered.edits/12.seqid 2023-02-12 23:03:36,673 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f1/b016fc17aa50474681f71b10b036ddae to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f1/b016fc17aa50474681f71b10b036ddae 2023-02-12 23:03:36,673 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/recovered.edits/12.seqid to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033/recovered.edits/12.seqid 2023-02-12 23:03:36,673 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/recovered.edits/12.seqid to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d/recovered.edits/12.seqid 2023-02-12 23:03:36,673 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/recovered.edits/12.seqid to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f/recovered.edits/12.seqid 2023-02-12 23:03:36,673 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/recovered.edits/12.seqid to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238/recovered.edits/12.seqid 2023-02-12 23:03:36,673 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/427c9bd94355639bcfaa338199010ecb 2023-02-12 23:03:36,673 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:36,674 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/recovered.edits/12.seqid to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55/recovered.edits/12.seqid 2023-02-12 23:03:36,675 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0d590d5f4bbfca780b0295e86761238 2023-02-12 23:03:36,675 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/255f26913e54145c6d5d7715ff69352f 2023-02-12 23:03:36,675 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3118215613336d661d6901cc41de476d 2023-02-12 23:03:36,676 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/a67157f758d5013ff72d7e85b49d9033 2023-02-12 23:03:36,676 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/3cf12bce3359ee882a269ccd1199fb55 2023-02-12 23:03:36,677 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602/f1, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602/f2, FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602/recovered.edits] 2023-02-12 23:03:36,677 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/recovered.edits/12.seqid to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb/recovered.edits/12.seqid 2023-02-12 23:03:36,678 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/b73c6c0b74cbd1b10bb1518dd12c20fb 2023-02-12 23:03:36,679 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f2/0b796354e05147388641b52db655d869 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f2/0b796354e05147388641b52db655d869 2023-02-12 23:03:36,681 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f2/d2cec9141e1344ccae943aefafd150b3 to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/f2/d2cec9141e1344ccae943aefafd150b3 2023-02-12 23:03:36,683 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602/recovered.edits/6.seqid to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602/recovered.edits/6.seqid 2023-02-12 23:03:36,683 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/df920b05b5c05a2bf111eb40ef564602 2023-02-12 23:03:36,684 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/recovered.edits/12.seqid to hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/archive/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006/recovered.edits/12.seqid 2023-02-12 23:03:36,684 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/.tmp/data/default/testWithMockedMapReduceMultiRegion/e128cbc418893503ff50d6c088a6d006 2023-02-12 23:03:36,685 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-12 23:03:36,687 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:36,690 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-12 23:03:36,692 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-12 23:03:36,693 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:36,693 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-12 23:03:36,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676243016693"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:36,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676243016693"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:36,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676243012625.255f26913e54145c6d5d7715ff69352f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676243016693"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:36,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676243016693"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:36,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676243016693"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:36,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676243016693"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:36,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676243016693"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:36,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676243016693"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:36,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676243016693"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:36,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676243016693"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:36,695 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-12 23:03:36,695 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 55fb2b8f1ac8b47848e354e0e6897bb3, NAME => 'testWithMockedMapReduceMultiRegion,,1676243012625.55fb2b8f1ac8b47848e354e0e6897bb3.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 427c9bd94355639bcfaa338199010ecb, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676243012625.427c9bd94355639bcfaa338199010ecb.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 255f26913e54145c6d5d7715ff69352f, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676243012625.255f26913e54145c6d5d7715ff69352f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => b73c6c0b74cbd1b10bb1518dd12c20fb, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676243012625.b73c6c0b74cbd1b10bb1518dd12c20fb.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 3cf12bce3359ee882a269ccd1199fb55, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676243012625.3cf12bce3359ee882a269ccd1199fb55.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => b0d590d5f4bbfca780b0295e86761238, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676243012625.b0d590d5f4bbfca780b0295e86761238.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => a67157f758d5013ff72d7e85b49d9033, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676243012625.a67157f758d5013ff72d7e85b49d9033.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 3118215613336d661d6901cc41de476d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676243012625.3118215613336d661d6901cc41de476d.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => e128cbc418893503ff50d6c088a6d006, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676243012625.e128cbc418893503ff50d6c088a6d006.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => df920b05b5c05a2bf111eb40ef564602, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676243012625.df920b05b5c05a2bf111eb40ef564602.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-12 23:03:36,695 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-12 23:03:36,695 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676243016695"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:36,696 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-12 23:03:36,698 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 23:03:36,699 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 73 msec 2023-02-12 23:03:36,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 23:03:36,730 INFO [Listener at localhost/33219] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-12 23:03:36,730 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 23:03:36,730 INFO [Listener at localhost/33219] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 23:03:36,731 DEBUG [Listener at localhost/33219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26587e08 to 127.0.0.1:57099 2023-02-12 23:03:36,731 DEBUG [Listener at localhost/33219] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:36,731 DEBUG [Listener at localhost/33219] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 23:03:36,731 DEBUG [Listener at localhost/33219] util.JVMClusterUtil(257): Found active master hash=1861130346, stopped=false 2023-02-12 23:03:36,731 INFO [Listener at localhost/33219] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43775,1676243011317 2023-02-12 23:03:36,734 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:36,734 INFO [Listener at localhost/33219] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 23:03:36,734 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:36,734 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:36,734 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:36,737 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:36,737 DEBUG [Listener at localhost/33219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x614a032e to 127.0.0.1:57099 2023-02-12 23:03:36,737 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:36,737 DEBUG [Listener at localhost/33219] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:36,737 INFO [Listener at localhost/33219] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38255,1676243011361' ***** 2023-02-12 23:03:36,737 INFO [Listener at localhost/33219] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 23:03:36,737 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:36,738 INFO [RS:0;jenkins-hbase4:38255] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 23:03:36,738 INFO [RS:0;jenkins-hbase4:38255] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 23:03:36,738 INFO [RS:0;jenkins-hbase4:38255] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 23:03:36,738 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:36,737 INFO [Listener at localhost/33219] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43427,1676243011390' ***** 2023-02-12 23:03:36,738 DEBUG [RS:0;jenkins-hbase4:38255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a0de644 to 127.0.0.1:57099 2023-02-12 23:03:36,738 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 23:03:36,738 DEBUG [RS:0;jenkins-hbase4:38255] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:36,738 INFO [Listener at localhost/33219] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 23:03:36,739 INFO [RS:0;jenkins-hbase4:38255] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 23:03:36,739 INFO [RS:0;jenkins-hbase4:38255] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 23:03:36,739 INFO [RS:0;jenkins-hbase4:38255] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 23:03:36,739 INFO [RS:1;jenkins-hbase4:43427] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 23:03:36,739 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 23:03:36,739 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 23:03:36,739 INFO [RS:1;jenkins-hbase4:43427] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 23:03:36,739 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 23:03:36,740 INFO [RS:1;jenkins-hbase4:43427] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 23:03:36,740 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 23:03:36,740 INFO [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer(3304): Received CLOSE for ca6233a40fca5e27127fec6bcdd7c7b6 2023-02-12 23:03:36,740 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 23:03:36,740 INFO [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:36,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ca6233a40fca5e27127fec6bcdd7c7b6, disabling compactions & flushes 2023-02-12 23:03:36,741 DEBUG [RS:1;jenkins-hbase4:43427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35c61840 to 127.0.0.1:57099 2023-02-12 23:03:36,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6. 2023-02-12 23:03:36,743 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 23:03:36,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6. 2023-02-12 23:03:36,743 DEBUG [RS:1;jenkins-hbase4:43427] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:36,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6. after waiting 0 ms 2023-02-12 23:03:36,743 INFO [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 23:03:36,743 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 23:03:36,743 DEBUG [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer(1479): Online Regions={ca6233a40fca5e27127fec6bcdd7c7b6=hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6.} 2023-02-12 23:03:36,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6. 2023-02-12 23:03:36,743 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 23:03:36,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing ca6233a40fca5e27127fec6bcdd7c7b6 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 23:03:36,744 DEBUG [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer(1505): Waiting on ca6233a40fca5e27127fec6bcdd7c7b6 2023-02-12 23:03:36,744 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 23:03:36,744 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 23:03:36,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-12 23:03:36,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/namespace/ca6233a40fca5e27127fec6bcdd7c7b6/.tmp/info/49c824ebb6cb4d918fb43a118bce0a71 2023-02-12 23:03:36,759 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/.tmp/info/4027f631a5254d359e5c60e0ec9eb289 2023-02-12 23:03:36,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/namespace/ca6233a40fca5e27127fec6bcdd7c7b6/.tmp/info/49c824ebb6cb4d918fb43a118bce0a71 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/namespace/ca6233a40fca5e27127fec6bcdd7c7b6/info/49c824ebb6cb4d918fb43a118bce0a71 2023-02-12 23:03:36,763 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4027f631a5254d359e5c60e0ec9eb289 2023-02-12 23:03:36,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/namespace/ca6233a40fca5e27127fec6bcdd7c7b6/info/49c824ebb6cb4d918fb43a118bce0a71, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 23:03:36,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ca6233a40fca5e27127fec6bcdd7c7b6 in 24ms, sequenceid=6, compaction requested=false 2023-02-12 23:03:36,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/.tmp/rep_barrier/ccdaa82f5d994c118c54fb3562cf7a4b 2023-02-12 23:03:36,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/namespace/ca6233a40fca5e27127fec6bcdd7c7b6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 23:03:36,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6. 2023-02-12 23:03:36,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ca6233a40fca5e27127fec6bcdd7c7b6: Waiting for close lock at 1676243016740Running coprocessor pre-close hooks at 1676243016740Disabling compacts and flushes for region at 1676243016740Disabling writes for close at 1676243016743 (+3 ms)Obtaining lock to block concurrent updates at 1676243016744 (+1 ms)Preparing flush snapshotting stores in ca6233a40fca5e27127fec6bcdd7c7b6 at 1676243016744Finished memstore snapshotting hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676243016744Flushing stores of hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6. at 1676243016744Flushing ca6233a40fca5e27127fec6bcdd7c7b6/info: creating writer at 1676243016744Flushing ca6233a40fca5e27127fec6bcdd7c7b6/info: appending metadata at 1676243016746 (+2 ms)Flushing ca6233a40fca5e27127fec6bcdd7c7b6/info: closing flushed file at 1676243016746Flushing ca6233a40fca5e27127fec6bcdd7c7b6/info: reopening flushed file at 1676243016763 (+17 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ca6233a40fca5e27127fec6bcdd7c7b6 in 24ms, sequenceid=6, compaction requested=false at 1676243016768 (+5 ms)Writing region close event to WAL at 1676243016776 (+8 ms)Running coprocessor post-close hooks at 1676243016779 (+3 ms)Closed at 1676243016780 (+1 ms) 2023-02-12 23:03:36,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676243011976.ca6233a40fca5e27127fec6bcdd7c7b6. 2023-02-12 23:03:36,782 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ccdaa82f5d994c118c54fb3562cf7a4b 2023-02-12 23:03:36,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/.tmp/table/6c074992c01a4ff2b6875f2a2fff7591 2023-02-12 23:03:36,793 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c074992c01a4ff2b6875f2a2fff7591 2023-02-12 23:03:36,793 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/.tmp/info/4027f631a5254d359e5c60e0ec9eb289 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/info/4027f631a5254d359e5c60e0ec9eb289 2023-02-12 23:03:36,797 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4027f631a5254d359e5c60e0ec9eb289 2023-02-12 23:03:36,797 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/info/4027f631a5254d359e5c60e0ec9eb289, entries=30, sequenceid=57, filesize=8.3 K 2023-02-12 23:03:36,797 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/.tmp/rep_barrier/ccdaa82f5d994c118c54fb3562cf7a4b as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/rep_barrier/ccdaa82f5d994c118c54fb3562cf7a4b 2023-02-12 23:03:36,801 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ccdaa82f5d994c118c54fb3562cf7a4b 2023-02-12 23:03:36,801 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/rep_barrier/ccdaa82f5d994c118c54fb3562cf7a4b, entries=10, sequenceid=57, filesize=6.1 K 2023-02-12 23:03:36,801 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/.tmp/table/6c074992c01a4ff2b6875f2a2fff7591 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/table/6c074992c01a4ff2b6875f2a2fff7591 2023-02-12 23:03:36,802 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:36,804 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:36,806 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c074992c01a4ff2b6875f2a2fff7591 2023-02-12 23:03:36,806 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/table/6c074992c01a4ff2b6875f2a2fff7591, entries=13, sequenceid=57, filesize=6.1 K 2023-02-12 23:03:36,807 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 63ms, sequenceid=57, compaction requested=false 2023-02-12 23:03:36,810 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-12 23:03:36,810 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 23:03:36,811 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:36,811 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676243016741Running coprocessor pre-close hooks at 1676243016741Disabling compacts and flushes for region at 1676243016741Disabling writes for close at 1676243016744 (+3 ms)Obtaining lock to block concurrent updates at 1676243016744Preparing flush snapshotting stores in 1588230740 at 1676243016744Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1676243016744Flushing stores of hbase:meta,,1.1588230740 at 1676243016745 (+1 ms)Flushing 1588230740/info: creating writer at 1676243016745Flushing 1588230740/info: appending metadata at 1676243016747 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676243016747Flushing 1588230740/rep_barrier: creating writer at 1676243016763 (+16 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676243016765 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676243016765Flushing 1588230740/table: creating writer at 1676243016783 (+18 ms)Flushing 1588230740/table: appending metadata at 1676243016785 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676243016785Flushing 1588230740/info: reopening flushed file at 1676243016794 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676243016798 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676243016802 (+4 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 63ms, sequenceid=57, compaction requested=false at 1676243016807 (+5 ms)Writing region close event to WAL at 1676243016808 (+1 ms)Running coprocessor post-close hooks at 1676243016810 (+2 ms)Closed at 1676243016811 (+1 ms) 2023-02-12 23:03:36,811 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:36,940 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38255,1676243011361; all regions closed. 2023-02-12 23:03:36,944 INFO [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43427,1676243011390; all regions closed. 2023-02-12 23:03:36,944 DEBUG [RS:0;jenkins-hbase4:38255] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/oldWALs 2023-02-12 23:03:36,944 INFO [RS:0;jenkins-hbase4:38255] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38255%2C1676243011361.meta:.meta(num 1676243011921) 2023-02-12 23:03:36,948 DEBUG [RS:1;jenkins-hbase4:43427] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/oldWALs 2023-02-12 23:03:36,948 INFO [RS:1;jenkins-hbase4:43427] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43427%2C1676243011390:(num 1676243012345) 2023-02-12 23:03:36,948 DEBUG [RS:1;jenkins-hbase4:43427] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:36,948 INFO [RS:1;jenkins-hbase4:43427] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:36,949 INFO [RS:1;jenkins-hbase4:43427] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 23:03:36,949 INFO [RS:1;jenkins-hbase4:43427] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 23:03:36,949 INFO [RS:1;jenkins-hbase4:43427] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 23:03:36,949 INFO [RS:1;jenkins-hbase4:43427] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 23:03:36,949 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:36,950 INFO [RS:1;jenkins-hbase4:43427] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43427 2023-02-12 23:03:36,950 DEBUG [RS:0;jenkins-hbase4:38255] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/oldWALs 2023-02-12 23:03:36,950 INFO [RS:0;jenkins-hbase4:38255] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38255%2C1676243011361:(num 1676243012705) 2023-02-12 23:03:36,950 DEBUG [RS:0;jenkins-hbase4:38255] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:36,951 INFO [RS:0;jenkins-hbase4:38255] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:36,951 INFO [RS:0;jenkins-hbase4:38255] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 23:03:36,951 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:36,994 INFO [RS:0;jenkins-hbase4:38255] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38255 2023-02-12 23:03:36,997 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:36,997 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43427,1676243011390 2023-02-12 23:03:36,997 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:36,997 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:36,997 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:36,997 ERROR [Listener at localhost/33219-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2433bccd rejected from java.util.concurrent.ThreadPoolExecutor@200c2c93[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:36,997 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:36,997 ERROR [Listener at localhost/33219-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d4d3eeb rejected from java.util.concurrent.ThreadPoolExecutor@200c2c93[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:36,997 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38255,1676243011361 2023-02-12 23:03:36,997 ERROR [Listener at localhost/33219-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c606315 rejected from java.util.concurrent.ThreadPoolExecutor@585fec41[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:36,998 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38255,1676243011361] 2023-02-12 23:03:36,998 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38255,1676243011361; numProcessing=1 2023-02-12 23:03:37,000 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38255,1676243011361 already deleted, retry=false 2023-02-12 23:03:37,000 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38255,1676243011361 expired; onlineServers=1 2023-02-12 23:03:37,000 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43427,1676243011390] 2023-02-12 23:03:37,000 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43427,1676243011390; numProcessing=2 2023-02-12 23:03:37,001 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43427,1676243011390 already deleted, retry=false 2023-02-12 23:03:37,001 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43427,1676243011390 expired; onlineServers=0 2023-02-12 23:03:37,001 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43775,1676243011317' ***** 2023-02-12 23:03:37,001 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 23:03:37,002 DEBUG [M:0;jenkins-hbase4:43775] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ad1016f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:37,002 INFO [M:0;jenkins-hbase4:43775] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43775,1676243011317 2023-02-12 23:03:37,002 INFO [M:0;jenkins-hbase4:43775] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43775,1676243011317; all regions closed. 2023-02-12 23:03:37,002 DEBUG [M:0;jenkins-hbase4:43775] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:37,002 DEBUG [M:0;jenkins-hbase4:43775] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 23:03:37,002 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 23:03:37,002 DEBUG [M:0;jenkins-hbase4:43775] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 23:03:37,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676243011568] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676243011568,5,FailOnTimeoutGroup] 2023-02-12 23:03:37,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676243011568] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676243011568,5,FailOnTimeoutGroup] 2023-02-12 23:03:37,002 INFO [M:0;jenkins-hbase4:43775] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 23:03:37,004 INFO [M:0;jenkins-hbase4:43775] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 23:03:37,004 INFO [M:0;jenkins-hbase4:43775] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 23:03:37,004 DEBUG [M:0;jenkins-hbase4:43775] master.HMaster(1502): Stopping service threads 2023-02-12 23:03:37,004 INFO [M:0;jenkins-hbase4:43775] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 23:03:37,004 ERROR [M:0;jenkins-hbase4:43775] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 23:03:37,005 INFO [M:0;jenkins-hbase4:43775] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 23:03:37,005 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 23:03:37,005 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:37,005 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:37,005 DEBUG [M:0;jenkins-hbase4:43775] zookeeper.ZKUtil(398): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 23:03:37,005 WARN [M:0;jenkins-hbase4:43775] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 23:03:37,005 INFO [M:0;jenkins-hbase4:43775] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 23:03:37,005 INFO [M:0;jenkins-hbase4:43775] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 23:03:37,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:37,006 DEBUG [M:0;jenkins-hbase4:43775] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 23:03:37,006 INFO [M:0;jenkins-hbase4:43775] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:37,006 DEBUG [M:0;jenkins-hbase4:43775] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:37,006 DEBUG [M:0;jenkins-hbase4:43775] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 23:03:37,006 DEBUG [M:0;jenkins-hbase4:43775] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:37,006 INFO [M:0;jenkins-hbase4:43775] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.13 KB heapSize=200.04 KB 2023-02-12 23:03:37,014 INFO [M:0;jenkins-hbase4:43775] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.13 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/12b4efd92c8b4fac8193d3b5a412d545 2023-02-12 23:03:37,018 DEBUG [M:0;jenkins-hbase4:43775] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/12b4efd92c8b4fac8193d3b5a412d545 as hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/12b4efd92c8b4fac8193d3b5a412d545 2023-02-12 23:03:37,021 INFO [M:0;jenkins-hbase4:43775] regionserver.HStore(1080): Added hdfs://localhost:36899/user/jenkins/test-data/303570bc-56f8-bd71-516f-be162094dc91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/12b4efd92c8b4fac8193d3b5a412d545, entries=53, sequenceid=357, filesize=10.7 K 2023-02-12 23:03:37,022 INFO [M:0;jenkins-hbase4:43775] regionserver.HRegion(2947): Finished flush of dataSize ~167.13 KB/171142, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false 2023-02-12 23:03:37,023 INFO [M:0;jenkins-hbase4:43775] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:37,023 DEBUG [M:0;jenkins-hbase4:43775] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676243017006Disabling compacts and flushes for region at 1676243017006Disabling writes for close at 1676243017006Obtaining lock to block concurrent updates at 1676243017006Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676243017006Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171142, getHeapSize=204824, getOffHeapSize=0, getCellsCount=442 at 1676243017006Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676243017007 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676243017007Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676243017009 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676243017009Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676243017019 (+10 ms)Finished flush of dataSize ~167.13 KB/171142, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false at 1676243017022 (+3 ms)Writing region close event to WAL at 1676243017023 (+1 ms)Closed at 1676243017023 2023-02-12 23:03:37,025 INFO [M:0;jenkins-hbase4:43775] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 23:03:37,025 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:37,026 INFO [M:0;jenkins-hbase4:43775] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43775 2023-02-12 23:03:37,028 DEBUG [M:0;jenkins-hbase4:43775] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43775,1676243011317 already deleted, retry=false 2023-02-12 23:03:37,236 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:37,236 INFO [M:0;jenkins-hbase4:43775] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43775,1676243011317; zookeeper connection closed. 2023-02-12 23:03:37,236 ERROR [Listener at localhost/33219-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4722d20b rejected from java.util.concurrent.ThreadPoolExecutor@431d5e37[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:37,237 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1004ac670a60000, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:37,237 ERROR [Listener at localhost/33219-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@66b09ab9 rejected from java.util.concurrent.ThreadPoolExecutor@431d5e37[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:37,336 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:37,336 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38255,1676243011361; zookeeper connection closed. 2023-02-12 23:03:37,336 ERROR [Listener at localhost/33219-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@732dfbbb rejected from java.util.concurrent.ThreadPoolExecutor@585fec41[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:37,337 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x1004ac670a60001, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:37,337 ERROR [Listener at localhost/33219-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@b909a24 rejected from java.util.concurrent.ThreadPoolExecutor@585fec41[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:37,337 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@74b0129d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@74b0129d 2023-02-12 23:03:37,437 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:37,437 INFO [RS:1;jenkins-hbase4:43427] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43427,1676243011390; zookeeper connection closed. 2023-02-12 23:03:37,437 ERROR [Listener at localhost/33219-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1508e4e8 rejected from java.util.concurrent.ThreadPoolExecutor@200c2c93[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:37,437 DEBUG [Listener at localhost/33219-EventThread] zookeeper.ZKWatcher(600): regionserver:43427-0x1004ac670a60002, quorum=127.0.0.1:57099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:37,437 ERROR [Listener at localhost/33219-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@19f9590 rejected from java.util.concurrent.ThreadPoolExecutor@200c2c93[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:37,437 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@72a4638d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@72a4638d 2023-02-12 23:03:37,438 INFO [Listener at localhost/33219] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 23:03:37,438 WARN [Listener at localhost/33219] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 23:03:37,441 INFO [Listener at localhost/33219] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:37,549 WARN [BP-1167918324-172.31.14.131-1676243010742 heartbeating to localhost/127.0.0.1:36899] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 23:03:37,552 WARN [BP-1167918324-172.31.14.131-1676243010742 heartbeating to localhost/127.0.0.1:36899] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1167918324-172.31.14.131-1676243010742 (Datanode Uuid 98fdaec2-8d38-44a4-8bdb-d257f7786b6e) service to localhost/127.0.0.1:36899 2023-02-12 23:03:37,552 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/cluster_b3c77a6c-332c-f8c9-38b3-7970cc896390/dfs/data/data3/current/BP-1167918324-172.31.14.131-1676243010742] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:37,553 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/cluster_b3c77a6c-332c-f8c9-38b3-7970cc896390/dfs/data/data4/current/BP-1167918324-172.31.14.131-1676243010742] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:37,554 WARN [Listener at localhost/33219] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 23:03:37,557 INFO [Listener at localhost/33219] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:37,660 WARN [BP-1167918324-172.31.14.131-1676243010742 heartbeating to localhost/127.0.0.1:36899] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 23:03:37,660 WARN [BP-1167918324-172.31.14.131-1676243010742 heartbeating to localhost/127.0.0.1:36899] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1167918324-172.31.14.131-1676243010742 (Datanode Uuid f1ae33bc-a1cf-426c-9e32-6afe31acc638) service to localhost/127.0.0.1:36899 2023-02-12 23:03:37,661 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/cluster_b3c77a6c-332c-f8c9-38b3-7970cc896390/dfs/data/data1/current/BP-1167918324-172.31.14.131-1676243010742] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:37,661 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/cluster_b3c77a6c-332c-f8c9-38b3-7970cc896390/dfs/data/data2/current/BP-1167918324-172.31.14.131-1676243010742] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:37,670 INFO [Listener at localhost/33219] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:37,789 INFO [Listener at localhost/33219] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 23:03:37,824 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 23:03:37,839 INFO [Listener at localhost/33219] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=229 (was 179) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:36899 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/33219.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/33219 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33219.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:36899 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33219.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: (jenkins-hbase4.apache.org,43775,1676243011317)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33219.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33219.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:36899 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/33219.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:36899 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/33219.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33219.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:36899 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33219.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36899 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33219.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:36899 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=640 (was 564) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=224 (was 200) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3962 (was 4012) 2023-02-12 23:03:37,849 INFO [Listener at localhost/33219] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=229, OpenFileDescriptor=640, MaxFileDescriptor=60000, SystemLoadAverage=224, ProcessCount=166, AvailableMemoryMB=3961 2023-02-12 23:03:37,859 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/hadoop.log.dir so I do NOT create it in target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e 2023-02-12 23:03:37,859 WARN [Listener at localhost/33219] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 23:03:37,859 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/hadoop.tmp.dir so I do NOT create it in target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e 2023-02-12 23:03:37,859 WARN [Listener at localhost/33219] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f1c5725-f80e-dbc6-30ca-3f5e0bfd9fdf/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 23:03:37,859 DEBUG [Listener at localhost/33219] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e 2023-02-12 23:03:37,859 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 23:03:37,859 INFO [Listener at localhost/33219] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/cluster_ad28aed6-1a59-c8c3-bfd6-8335d537d772, deleteOnExit=true 2023-02-12 23:03:37,859 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 23:03:37,859 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/test.cache.data in system properties and HBase conf 2023-02-12 23:03:37,859 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 23:03:37,860 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/hadoop.log.dir in system properties and HBase conf 2023-02-12 23:03:37,860 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 23:03:37,860 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 23:03:37,860 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 23:03:37,860 DEBUG [Listener at localhost/33219] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 23:03:37,860 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 23:03:37,860 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 23:03:37,860 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 23:03:37,860 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 23:03:37,861 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 23:03:37,861 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 23:03:37,861 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 23:03:37,861 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 23:03:37,861 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 23:03:37,861 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/nfs.dump.dir in system properties and HBase conf 2023-02-12 23:03:37,861 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/java.io.tmpdir in system properties and HBase conf 2023-02-12 23:03:37,861 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 23:03:37,861 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 23:03:37,861 INFO [Listener at localhost/33219] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 23:03:37,865 WARN [Listener at localhost/33219] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 23:03:37,865 WARN [Listener at localhost/33219] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 23:03:37,870 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 23:03:37,932 WARN [Listener at localhost/33219] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:37,935 INFO [Listener at localhost/33219] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:37,939 INFO [Listener at localhost/33219] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/java.io.tmpdir/Jetty_localhost_34871_hdfs____.jcl079/webapp 2023-02-12 23:03:38,031 INFO [Listener at localhost/33219] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34871 2023-02-12 23:03:38,036 WARN [Listener at localhost/33219] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 23:03:38,036 WARN [Listener at localhost/33219] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 23:03:38,077 WARN [Listener at localhost/46471] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:38,095 WARN [Listener at localhost/46471] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 23:03:38,097 WARN [Listener at localhost/46471] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:38,098 INFO [Listener at localhost/46471] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:38,104 INFO [Listener at localhost/46471] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/java.io.tmpdir/Jetty_localhost_39789_datanode____.l9k6h3/webapp 2023-02-12 23:03:38,200 INFO [Listener at localhost/46471] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39789 2023-02-12 23:03:38,207 WARN [Listener at localhost/41665] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:38,223 WARN [Listener at localhost/41665] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 23:03:38,225 WARN [Listener at localhost/41665] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:38,226 INFO [Listener at localhost/41665] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:38,229 INFO [Listener at localhost/41665] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/java.io.tmpdir/Jetty_localhost_40321_datanode____.4o3alf/webapp 2023-02-12 23:03:38,308 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7b9507e3725685da: Processing first storage report for DS-34b7a82c-9793-4894-acce-722e3be9cd63 from datanode 8c2bc7f2-a137-47d4-98b0-e3d1a9b9889c 2023-02-12 23:03:38,308 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7b9507e3725685da: from storage DS-34b7a82c-9793-4894-acce-722e3be9cd63 node DatanodeRegistration(127.0.0.1:36241, datanodeUuid=8c2bc7f2-a137-47d4-98b0-e3d1a9b9889c, infoPort=34167, infoSecurePort=0, ipcPort=41665, storageInfo=lv=-57;cid=testClusterID;nsid=1146506843;c=1676243017867), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:38,308 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7b9507e3725685da: Processing first storage report for DS-59f77371-229c-41fe-a29b-8be9db44244f from datanode 8c2bc7f2-a137-47d4-98b0-e3d1a9b9889c 2023-02-12 23:03:38,308 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7b9507e3725685da: from storage DS-59f77371-229c-41fe-a29b-8be9db44244f node DatanodeRegistration(127.0.0.1:36241, datanodeUuid=8c2bc7f2-a137-47d4-98b0-e3d1a9b9889c, infoPort=34167, infoSecurePort=0, ipcPort=41665, storageInfo=lv=-57;cid=testClusterID;nsid=1146506843;c=1676243017867), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:38,339 INFO [Listener at localhost/41665] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40321 2023-02-12 23:03:38,349 WARN [Listener at localhost/44537] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:38,457 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x98fa3310a174c8fe: Processing first storage report for DS-0b2c0a43-d6db-4f0f-a3c5-ebead09c0b56 from datanode 7fa91944-bf93-4200-8d69-ad493b0bbb61 2023-02-12 23:03:38,457 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x98fa3310a174c8fe: from storage DS-0b2c0a43-d6db-4f0f-a3c5-ebead09c0b56 node DatanodeRegistration(127.0.0.1:37769, datanodeUuid=7fa91944-bf93-4200-8d69-ad493b0bbb61, infoPort=33645, infoSecurePort=0, ipcPort=44537, storageInfo=lv=-57;cid=testClusterID;nsid=1146506843;c=1676243017867), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:38,457 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x98fa3310a174c8fe: Processing first storage report for DS-d003d725-b6a4-4b2f-965b-5e04eddff425 from datanode 7fa91944-bf93-4200-8d69-ad493b0bbb61 2023-02-12 23:03:38,457 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x98fa3310a174c8fe: from storage DS-d003d725-b6a4-4b2f-965b-5e04eddff425 node DatanodeRegistration(127.0.0.1:37769, datanodeUuid=7fa91944-bf93-4200-8d69-ad493b0bbb61, infoPort=33645, infoSecurePort=0, ipcPort=44537, storageInfo=lv=-57;cid=testClusterID;nsid=1146506843;c=1676243017867), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:38,557 DEBUG [Listener at localhost/44537] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e 2023-02-12 23:03:38,559 INFO [Listener at localhost/44537] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/cluster_ad28aed6-1a59-c8c3-bfd6-8335d537d772/zookeeper_0, clientPort=58963, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/cluster_ad28aed6-1a59-c8c3-bfd6-8335d537d772/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/cluster_ad28aed6-1a59-c8c3-bfd6-8335d537d772/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 23:03:38,560 INFO [Listener at localhost/44537] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58963 2023-02-12 23:03:38,560 INFO [Listener at localhost/44537] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:38,561 INFO [Listener at localhost/44537] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:38,578 INFO [Listener at localhost/44537] util.FSUtils(479): Created version file at hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740 with version=8 2023-02-12 23:03:38,579 INFO [Listener at localhost/44537] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:38,579 INFO [Listener at localhost/44537] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:38,580 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46471/user/jenkins/test-data/ebf54ebe-c0ad-987a-c4d7-947cb9ae411a/hbase-staging 2023-02-12 23:03:38,582 INFO [Listener at localhost/44537] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:38,582 INFO [Listener at localhost/44537] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:38,582 INFO [Listener at localhost/44537] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:38,582 INFO [Listener at localhost/44537] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:38,582 INFO [Listener at localhost/44537] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:38,582 INFO [Listener at localhost/44537] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:38,583 INFO [Listener at localhost/44537] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:38,583 INFO [Listener at localhost/44537] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34483 2023-02-12 23:03:38,583 INFO [Listener at localhost/44537] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:38,584 INFO [Listener at localhost/44537] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:38,585 INFO [Listener at localhost/44537] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34483 connecting to ZooKeeper ensemble=127.0.0.1:58963 2023-02-12 23:03:38,596 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:344830x0, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:38,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:34483-0x1004ac68d040000 connected 2023-02-12 23:03:38,617 DEBUG [Listener at localhost/44537] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:38,617 DEBUG [Listener at localhost/44537] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:38,617 DEBUG [Listener at localhost/44537] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:38,620 DEBUG [Listener at localhost/44537] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34483 2023-02-12 23:03:38,624 DEBUG [Listener at localhost/44537] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34483 2023-02-12 23:03:38,624 DEBUG [Listener at localhost/44537] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34483 2023-02-12 23:03:38,624 DEBUG [Listener at localhost/44537] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34483 2023-02-12 23:03:38,624 DEBUG [Listener at localhost/44537] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34483 2023-02-12 23:03:38,624 INFO [Listener at localhost/44537] master.HMaster(439): hbase.rootdir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740, hbase.cluster.distributed=false 2023-02-12 23:03:38,639 INFO [Listener at localhost/44537] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:38,640 INFO [Listener at localhost/44537] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:38,640 INFO [Listener at localhost/44537] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:38,640 INFO [Listener at localhost/44537] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:38,640 INFO [Listener at localhost/44537] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:38,640 INFO [Listener at localhost/44537] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:38,640 INFO [Listener at localhost/44537] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:38,658 INFO [Listener at localhost/44537] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46233 2023-02-12 23:03:38,659 INFO [Listener at localhost/44537] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 23:03:38,662 DEBUG [Listener at localhost/44537] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:38,663 INFO [Listener at localhost/44537] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:38,664 INFO [Listener at localhost/44537] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:38,665 INFO [Listener at localhost/44537] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46233 connecting to ZooKeeper ensemble=127.0.0.1:58963 2023-02-12 23:03:38,671 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:462330x0, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:38,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46233-0x1004ac68d040001 connected 2023-02-12 23:03:38,673 DEBUG [Listener at localhost/44537] zookeeper.ZKUtil(164): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:38,673 DEBUG [Listener at localhost/44537] zookeeper.ZKUtil(164): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:38,674 DEBUG [Listener at localhost/44537] zookeeper.ZKUtil(164): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:38,675 DEBUG [Listener at localhost/44537] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46233 2023-02-12 23:03:38,676 DEBUG [Listener at localhost/44537] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46233 2023-02-12 23:03:38,676 DEBUG [Listener at localhost/44537] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46233 2023-02-12 23:03:38,678 DEBUG [Listener at localhost/44537] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46233 2023-02-12 23:03:38,678 DEBUG [Listener at localhost/44537] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46233 2023-02-12 23:03:38,691 INFO [Listener at localhost/44537] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:38,692 INFO [Listener at localhost/44537] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:38,692 INFO [Listener at localhost/44537] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:38,692 INFO [Listener at localhost/44537] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:38,692 INFO [Listener at localhost/44537] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:38,692 INFO [Listener at localhost/44537] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:38,692 INFO [Listener at localhost/44537] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:38,693 INFO [Listener at localhost/44537] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34931 2023-02-12 23:03:38,693 INFO [Listener at localhost/44537] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 23:03:38,694 DEBUG [Listener at localhost/44537] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:38,694 INFO [Listener at localhost/44537] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:38,695 INFO [Listener at localhost/44537] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:38,696 INFO [Listener at localhost/44537] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34931 connecting to ZooKeeper ensemble=127.0.0.1:58963 2023-02-12 23:03:38,700 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:349310x0, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:38,701 DEBUG [Listener at localhost/44537] zookeeper.ZKUtil(164): regionserver:349310x0, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:38,701 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34931-0x1004ac68d040002 connected 2023-02-12 23:03:38,702 DEBUG [Listener at localhost/44537] zookeeper.ZKUtil(164): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:38,702 DEBUG [Listener at localhost/44537] zookeeper.ZKUtil(164): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:38,704 DEBUG [Listener at localhost/44537] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34931 2023-02-12 23:03:38,708 DEBUG [Listener at localhost/44537] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34931 2023-02-12 23:03:38,708 DEBUG [Listener at localhost/44537] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34931 2023-02-12 23:03:38,708 DEBUG [Listener at localhost/44537] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34931 2023-02-12 23:03:38,709 DEBUG [Listener at localhost/44537] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34931 2023-02-12 23:03:38,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34483,1676243018582 2023-02-12 23:03:38,711 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 23:03:38,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34483,1676243018582 2023-02-12 23:03:38,712 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:38,712 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:38,712 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:38,713 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:38,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 23:03:38,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34483,1676243018582 from backup master directory 2023-02-12 23:03:38,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 23:03:38,718 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34483,1676243018582 2023-02-12 23:03:38,718 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 23:03:38,718 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:38,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,34483,1676243018582 2023-02-12 23:03:38,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/hbase.id with ID: 23ddb5cc-0684-40cf-937e-8aa3bca29445 2023-02-12 23:03:38,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:38,753 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:38,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2cb8aaba to 127.0.0.1:58963 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:38,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55fbacf1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:38,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:38,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 23:03:38,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:38,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/MasterData/data/master/store-tmp 2023-02-12 23:03:38,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:38,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 23:03:38,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:38,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:38,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 23:03:38,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:38,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:38,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676243018778Disabling compacts and flushes for region at 1676243018778Disabling writes for close at 1676243018778Writing region close event to WAL at 1676243018778Closed at 1676243018778 2023-02-12 23:03:38,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/MasterData/WALs/jenkins-hbase4.apache.org,34483,1676243018582 2023-02-12 23:03:38,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34483%2C1676243018582, suffix=, logDir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/MasterData/WALs/jenkins-hbase4.apache.org,34483,1676243018582, archiveDir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/MasterData/oldWALs, maxLogs=10 2023-02-12 23:03:38,793 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37769,DS-0b2c0a43-d6db-4f0f-a3c5-ebead09c0b56,DISK] 2023-02-12 23:03:38,793 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36241,DS-34b7a82c-9793-4894-acce-722e3be9cd63,DISK] 2023-02-12 23:03:38,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/MasterData/WALs/jenkins-hbase4.apache.org,34483,1676243018582/jenkins-hbase4.apache.org%2C34483%2C1676243018582.1676243018781 2023-02-12 23:03:38,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37769,DS-0b2c0a43-d6db-4f0f-a3c5-ebead09c0b56,DISK], DatanodeInfoWithStorage[127.0.0.1:36241,DS-34b7a82c-9793-4894-acce-722e3be9cd63,DISK]] 2023-02-12 23:03:38,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:38,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:38,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:38,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:38,800 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:38,801 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 23:03:38,801 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 23:03:38,802 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:38,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:38,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:38,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:38,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:38,808 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63398139, jitterRate=-0.055294111371040344}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 23:03:38,809 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676243018796Initializing all the Stores at 1676243018797 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243018797Cleaning up temporary data from old regions at 1676243018803 (+6 ms)Cleaning up detritus from prior splits at 1676243018803Region opened successfully at 1676243018809 (+6 ms) 2023-02-12 23:03:38,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 23:03:38,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 23:03:38,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 23:03:38,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 23:03:38,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 23:03:38,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 23:03:38,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 23:03:38,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 23:03:38,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 23:03:38,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 23:03:38,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 23:03:38,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 23:03:38,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 23:03:38,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 23:03:38,824 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:38,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 23:03:38,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 23:03:38,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 23:03:38,826 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:38,826 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:38,826 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:38,827 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:38,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,34483,1676243018582, sessionid=0x1004ac68d040000, setting cluster-up flag (Was=false) 2023-02-12 23:03:38,835 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:38,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 23:03:38,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34483,1676243018582 2023-02-12 23:03:38,842 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:38,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 23:03:38,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34483,1676243018582 2023-02-12 23:03:38,847 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.hbase-snapshot/.tmp 2023-02-12 23:03:38,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:38,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:38,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:38,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:38,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:38,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 23:03:38,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:38,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676243048853 2023-02-12 23:03:38,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 23:03:38,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 23:03:38,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 23:03:38,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 23:03:38,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 23:03:38,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 23:03:38,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,854 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:38,854 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 23:03:38,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 23:03:38,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 23:03:38,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 23:03:38,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 23:03:38,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 23:03:38,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676243018855,5,FailOnTimeoutGroup] 2023-02-12 23:03:38,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676243018855,5,FailOnTimeoutGroup] 2023-02-12 23:03:38,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 23:03:38,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,855 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:38,865 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:38,865 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:38,865 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740 2023-02-12 23:03:38,872 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:38,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 23:03:38,877 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/info 2023-02-12 23:03:38,877 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 23:03:38,877 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:38,878 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 23:03:38,878 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:38,879 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 23:03:38,879 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:38,879 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 23:03:38,880 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/table 2023-02-12 23:03:38,880 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 23:03:38,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:38,881 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740 2023-02-12 23:03:38,881 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740 2023-02-12 23:03:38,882 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 23:03:38,883 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 23:03:38,884 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:38,884 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59958491, jitterRate=-0.10654886066913605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 23:03:38,885 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676243018872Initializing all the Stores at 1676243018872Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243018872Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243018876 (+4 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243018876Cleaning up temporary data from old regions at 1676243018882 (+6 ms)Cleaning up detritus from prior splits at 1676243018882Region opened successfully at 1676243018885 (+3 ms) 2023-02-12 23:03:38,885 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 23:03:38,885 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 23:03:38,885 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 23:03:38,885 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 23:03:38,885 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 23:03:38,885 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:38,885 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676243018885Disabling compacts and flushes for region at 1676243018885Disabling writes for close at 1676243018885Writing region close event to WAL at 1676243018885Closed at 1676243018885 2023-02-12 23:03:38,886 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:38,886 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 23:03:38,886 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 23:03:38,887 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 23:03:38,889 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 23:03:38,910 INFO [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer(952): ClusterId : 23ddb5cc-0684-40cf-937e-8aa3bca29445 2023-02-12 23:03:38,910 INFO [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer(952): ClusterId : 23ddb5cc-0684-40cf-937e-8aa3bca29445 2023-02-12 23:03:38,910 DEBUG [RS:1;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 23:03:38,911 DEBUG [RS:0;jenkins-hbase4:46233] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 23:03:38,912 DEBUG [RS:0;jenkins-hbase4:46233] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 23:03:38,912 DEBUG [RS:0;jenkins-hbase4:46233] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 23:03:38,912 DEBUG [RS:1;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 23:03:38,912 DEBUG [RS:1;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 23:03:38,916 DEBUG [RS:0;jenkins-hbase4:46233] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 23:03:38,917 DEBUG [RS:0;jenkins-hbase4:46233] zookeeper.ReadOnlyZKClient(139): Connect 0x4626a7be to 127.0.0.1:58963 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:38,917 DEBUG [RS:1;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 23:03:38,918 DEBUG [RS:1;jenkins-hbase4:34931] zookeeper.ReadOnlyZKClient(139): Connect 0x17c269f3 to 127.0.0.1:58963 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:38,925 DEBUG [RS:0;jenkins-hbase4:46233] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48e1510a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:38,925 DEBUG [RS:1;jenkins-hbase4:34931] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1905957b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:38,925 DEBUG [RS:0;jenkins-hbase4:46233] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cdeccce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:38,925 DEBUG [RS:1;jenkins-hbase4:34931] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d3a0283, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:38,933 DEBUG [RS:0;jenkins-hbase4:46233] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46233 2023-02-12 23:03:38,933 DEBUG [RS:1;jenkins-hbase4:34931] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34931 2023-02-12 23:03:38,933 INFO [RS:0;jenkins-hbase4:46233] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 23:03:38,933 INFO [RS:0;jenkins-hbase4:46233] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 23:03:38,933 INFO [RS:1;jenkins-hbase4:34931] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 23:03:38,933 INFO [RS:1;jenkins-hbase4:34931] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 23:03:38,933 DEBUG [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 23:03:38,933 DEBUG [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 23:03:38,934 INFO [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34483,1676243018582 with isa=jenkins-hbase4.apache.org/172.31.14.131:34931, startcode=1676243018691 2023-02-12 23:03:38,934 INFO [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34483,1676243018582 with isa=jenkins-hbase4.apache.org/172.31.14.131:46233, startcode=1676243018639 2023-02-12 23:03:38,934 DEBUG [RS:1;jenkins-hbase4:34931] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 23:03:38,934 DEBUG [RS:0;jenkins-hbase4:46233] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 23:03:38,936 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59861, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 23:03:38,936 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39579, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 23:03:38,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34483] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:38,937 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:38,938 DEBUG [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740 2023-02-12 23:03:38,938 DEBUG [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740 2023-02-12 23:03:38,938 DEBUG [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46471 2023-02-12 23:03:38,938 DEBUG [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 23:03:38,938 DEBUG [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46471 2023-02-12 23:03:38,938 DEBUG [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 23:03:38,939 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:38,948 DEBUG [RS:0;jenkins-hbase4:46233] zookeeper.ZKUtil(162): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:38,948 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34931,1676243018691] 2023-02-12 23:03:38,948 WARN [RS:0;jenkins-hbase4:46233] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:38,948 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46233,1676243018639] 2023-02-12 23:03:38,948 INFO [RS:0;jenkins-hbase4:46233] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:38,948 DEBUG [RS:1;jenkins-hbase4:34931] zookeeper.ZKUtil(162): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:38,948 DEBUG [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/WALs/jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:38,948 WARN [RS:1;jenkins-hbase4:34931] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:38,948 INFO [RS:1;jenkins-hbase4:34931] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:38,948 DEBUG [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/WALs/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:38,954 DEBUG [RS:1;jenkins-hbase4:34931] zookeeper.ZKUtil(162): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:38,954 DEBUG [RS:0;jenkins-hbase4:46233] zookeeper.ZKUtil(162): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:38,954 DEBUG [RS:1;jenkins-hbase4:34931] zookeeper.ZKUtil(162): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:38,954 DEBUG [RS:0;jenkins-hbase4:46233] zookeeper.ZKUtil(162): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:38,955 DEBUG [RS:1;jenkins-hbase4:34931] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 23:03:38,955 DEBUG [RS:0;jenkins-hbase4:46233] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 23:03:38,955 INFO [RS:1;jenkins-hbase4:34931] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 23:03:38,955 INFO [RS:0;jenkins-hbase4:46233] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 23:03:38,956 INFO [RS:1;jenkins-hbase4:34931] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 23:03:38,957 INFO [RS:1;jenkins-hbase4:34931] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 23:03:38,957 INFO [RS:0;jenkins-hbase4:46233] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 23:03:38,957 INFO [RS:1;jenkins-hbase4:34931] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,957 INFO [RS:0;jenkins-hbase4:46233] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 23:03:38,957 INFO [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 23:03:38,957 INFO [RS:0;jenkins-hbase4:46233] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,958 INFO [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 23:03:38,959 INFO [RS:1;jenkins-hbase4:34931] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,959 DEBUG [RS:1;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,959 INFO [RS:0;jenkins-hbase4:46233] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,959 DEBUG [RS:1;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,960 DEBUG [RS:0;jenkins-hbase4:46233] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,960 DEBUG [RS:1;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,960 DEBUG [RS:0;jenkins-hbase4:46233] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,960 DEBUG [RS:1;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,960 DEBUG [RS:0;jenkins-hbase4:46233] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,960 DEBUG [RS:1;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,960 DEBUG [RS:0;jenkins-hbase4:46233] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,960 DEBUG [RS:1;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:38,960 DEBUG [RS:0;jenkins-hbase4:46233] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,960 DEBUG [RS:1;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,960 DEBUG [RS:0;jenkins-hbase4:46233] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:38,961 DEBUG [RS:1;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,961 DEBUG [RS:0;jenkins-hbase4:46233] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,961 DEBUG [RS:1;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,961 DEBUG [RS:0;jenkins-hbase4:46233] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,961 DEBUG [RS:1;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,961 DEBUG [RS:0;jenkins-hbase4:46233] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,961 DEBUG [RS:0;jenkins-hbase4:46233] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:38,964 INFO [RS:0;jenkins-hbase4:46233] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,964 INFO [RS:0;jenkins-hbase4:46233] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,964 INFO [RS:1;jenkins-hbase4:34931] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,964 INFO [RS:0;jenkins-hbase4:46233] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,964 INFO [RS:1;jenkins-hbase4:34931] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,965 INFO [RS:1;jenkins-hbase4:34931] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,975 INFO [RS:0;jenkins-hbase4:46233] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 23:03:38,975 INFO [RS:0;jenkins-hbase4:46233] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46233,1676243018639-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,980 INFO [RS:1;jenkins-hbase4:34931] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 23:03:38,980 INFO [RS:1;jenkins-hbase4:34931] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34931,1676243018691-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:38,986 INFO [RS:0;jenkins-hbase4:46233] regionserver.Replication(203): jenkins-hbase4.apache.org,46233,1676243018639 started 2023-02-12 23:03:38,986 INFO [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46233,1676243018639, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46233, sessionid=0x1004ac68d040001 2023-02-12 23:03:38,986 DEBUG [RS:0;jenkins-hbase4:46233] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 23:03:38,986 DEBUG [RS:0;jenkins-hbase4:46233] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:38,986 DEBUG [RS:0;jenkins-hbase4:46233] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46233,1676243018639' 2023-02-12 23:03:38,986 DEBUG [RS:0;jenkins-hbase4:46233] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:38,986 DEBUG [RS:0;jenkins-hbase4:46233] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:38,986 DEBUG [RS:0;jenkins-hbase4:46233] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 23:03:38,987 DEBUG [RS:0;jenkins-hbase4:46233] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 23:03:38,987 DEBUG [RS:0;jenkins-hbase4:46233] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:38,987 DEBUG [RS:0;jenkins-hbase4:46233] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46233,1676243018639' 2023-02-12 23:03:38,987 DEBUG [RS:0;jenkins-hbase4:46233] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:38,987 DEBUG [RS:0;jenkins-hbase4:46233] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:38,987 DEBUG [RS:0;jenkins-hbase4:46233] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 23:03:38,987 INFO [RS:0;jenkins-hbase4:46233] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 23:03:38,987 INFO [RS:0;jenkins-hbase4:46233] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 23:03:38,996 INFO [RS:1;jenkins-hbase4:34931] regionserver.Replication(203): jenkins-hbase4.apache.org,34931,1676243018691 started 2023-02-12 23:03:38,996 INFO [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34931,1676243018691, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34931, sessionid=0x1004ac68d040002 2023-02-12 23:03:38,996 DEBUG [RS:1;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 23:03:38,996 DEBUG [RS:1;jenkins-hbase4:34931] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:38,996 DEBUG [RS:1;jenkins-hbase4:34931] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34931,1676243018691' 2023-02-12 23:03:38,996 DEBUG [RS:1;jenkins-hbase4:34931] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:38,996 DEBUG [RS:1;jenkins-hbase4:34931] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:38,997 DEBUG [RS:1;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 23:03:38,997 DEBUG [RS:1;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 23:03:38,997 DEBUG [RS:1;jenkins-hbase4:34931] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:38,997 DEBUG [RS:1;jenkins-hbase4:34931] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34931,1676243018691' 2023-02-12 23:03:38,997 DEBUG [RS:1;jenkins-hbase4:34931] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:38,997 DEBUG [RS:1;jenkins-hbase4:34931] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:38,997 DEBUG [RS:1;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 23:03:38,997 INFO [RS:1;jenkins-hbase4:34931] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 23:03:38,997 INFO [RS:1;jenkins-hbase4:34931] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 23:03:39,039 DEBUG [jenkins-hbase4:34483] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 23:03:39,039 DEBUG [jenkins-hbase4:34483] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:39,040 DEBUG [jenkins-hbase4:34483] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:39,040 DEBUG [jenkins-hbase4:34483] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:39,040 DEBUG [jenkins-hbase4:34483] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:39,040 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34931,1676243018691, state=OPENING 2023-02-12 23:03:39,042 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 23:03:39,043 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:39,043 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 23:03:39,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34931,1676243018691}] 2023-02-12 23:03:39,199 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:39,199 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 23:03:39,201 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35916, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 23:03:39,204 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 23:03:39,204 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:39,205 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34931%2C1676243018691.meta, suffix=.meta, logDir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/WALs/jenkins-hbase4.apache.org,34931,1676243018691, archiveDir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/oldWALs, maxLogs=32 2023-02-12 23:03:39,218 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36241,DS-34b7a82c-9793-4894-acce-722e3be9cd63,DISK] 2023-02-12 23:03:39,218 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37769,DS-0b2c0a43-d6db-4f0f-a3c5-ebead09c0b56,DISK] 2023-02-12 23:03:39,220 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/WALs/jenkins-hbase4.apache.org,34931,1676243018691/jenkins-hbase4.apache.org%2C34931%2C1676243018691.meta.1676243019206.meta 2023-02-12 23:03:39,220 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37769,DS-0b2c0a43-d6db-4f0f-a3c5-ebead09c0b56,DISK], DatanodeInfoWithStorage[127.0.0.1:36241,DS-34b7a82c-9793-4894-acce-722e3be9cd63,DISK]] 2023-02-12 23:03:39,220 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:39,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 23:03:39,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 23:03:39,221 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 23:03:39,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 23:03:39,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:39,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 23:03:39,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 23:03:39,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 23:03:39,223 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/info 2023-02-12 23:03:39,223 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/info 2023-02-12 23:03:39,223 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 23:03:39,224 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:39,224 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 23:03:39,224 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:39,224 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:39,225 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 23:03:39,225 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:39,225 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 23:03:39,226 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/table 2023-02-12 23:03:39,226 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/table 2023-02-12 23:03:39,226 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 23:03:39,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:39,227 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740 2023-02-12 23:03:39,227 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740 2023-02-12 23:03:39,229 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 23:03:39,230 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 23:03:39,230 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67603328, jitterRate=0.0073680877685546875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 23:03:39,230 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676243019221Writing region info on filesystem at 1676243019221Initializing all the Stores at 1676243019222 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243019222Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243019222Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243019222Cleaning up temporary data from old regions at 1676243019228 (+6 ms)Cleaning up detritus from prior splits at 1676243019228Running coprocessor post-open hooks at 1676243019230 (+2 ms)Region opened successfully at 1676243019230 2023-02-12 23:03:39,231 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676243019199 2023-02-12 23:03:39,234 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 23:03:39,235 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 23:03:39,235 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34931,1676243018691, state=OPEN 2023-02-12 23:03:39,236 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 23:03:39,236 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 23:03:39,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 23:03:39,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34931,1676243018691 in 193 msec 2023-02-12 23:03:39,238 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 23:03:39,238 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 351 msec 2023-02-12 23:03:39,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 392 msec 2023-02-12 23:03:39,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676243018711, completionTime=-1 2023-02-12 23:03:39,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 23:03:39,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 23:03:39,242 DEBUG [hconnection-0x7c8e729c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:39,243 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35918, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:39,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 23:03:39,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676243079245 2023-02-12 23:03:39,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676243139245 2023-02-12 23:03:39,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-12 23:03:39,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34483,1676243018582-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:39,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34483,1676243018582-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:39,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34483,1676243018582-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:39,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34483, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:39,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:39,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 23:03:39,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:39,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 23:03:39,253 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 23:03:39,254 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 23:03:39,254 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 23:03:39,256 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/hbase/namespace/1d4e3323886b588be7c14179934902d1 2023-02-12 23:03:39,256 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/hbase/namespace/1d4e3323886b588be7c14179934902d1 empty. 2023-02-12 23:03:39,256 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/hbase/namespace/1d4e3323886b588be7c14179934902d1 2023-02-12 23:03:39,256 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 23:03:39,265 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:39,266 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1d4e3323886b588be7c14179934902d1, NAME => 'hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp 2023-02-12 23:03:39,272 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:39,272 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 1d4e3323886b588be7c14179934902d1, disabling compactions & flushes 2023-02-12 23:03:39,272 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1. 2023-02-12 23:03:39,272 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1. 2023-02-12 23:03:39,272 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1. after waiting 0 ms 2023-02-12 23:03:39,272 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1. 2023-02-12 23:03:39,272 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1. 2023-02-12 23:03:39,272 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 1d4e3323886b588be7c14179934902d1: Waiting for close lock at 1676243019272Disabling compacts and flushes for region at 1676243019272Disabling writes for close at 1676243019272Writing region close event to WAL at 1676243019272Closed at 1676243019272 2023-02-12 23:03:39,274 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 23:03:39,275 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676243019274"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243019274"}]},"ts":"1676243019274"} 2023-02-12 23:03:39,278 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 23:03:39,278 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 23:03:39,278 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243019278"}]},"ts":"1676243019278"} 2023-02-12 23:03:39,279 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 23:03:39,282 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:39,283 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:39,283 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:39,283 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:39,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1d4e3323886b588be7c14179934902d1, ASSIGN}] 2023-02-12 23:03:39,286 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1d4e3323886b588be7c14179934902d1, ASSIGN 2023-02-12 23:03:39,286 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1d4e3323886b588be7c14179934902d1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46233,1676243018639; forceNewPlan=false, retain=false 2023-02-12 23:03:39,436 INFO [jenkins-hbase4:34483] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 23:03:39,437 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1d4e3323886b588be7c14179934902d1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:39,437 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676243019437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243019437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243019437"}]},"ts":"1676243019437"} 2023-02-12 23:03:39,438 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1d4e3323886b588be7c14179934902d1, server=jenkins-hbase4.apache.org,46233,1676243018639}] 2023-02-12 23:03:39,591 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:39,591 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 23:03:39,593 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35968, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 23:03:39,596 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1. 2023-02-12 23:03:39,597 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46233%2C1676243018639, suffix=, logDir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/WALs/jenkins-hbase4.apache.org,46233,1676243018639, archiveDir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/oldWALs, maxLogs=32 2023-02-12 23:03:39,610 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36241,DS-34b7a82c-9793-4894-acce-722e3be9cd63,DISK] 2023-02-12 23:03:39,610 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37769,DS-0b2c0a43-d6db-4f0f-a3c5-ebead09c0b56,DISK] 2023-02-12 23:03:39,614 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/WALs/jenkins-hbase4.apache.org,46233,1676243018639/jenkins-hbase4.apache.org%2C46233%2C1676243018639.1676243019597 2023-02-12 23:03:39,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36241,DS-34b7a82c-9793-4894-acce-722e3be9cd63,DISK], DatanodeInfoWithStorage[127.0.0.1:37769,DS-0b2c0a43-d6db-4f0f-a3c5-ebead09c0b56,DISK]] 2023-02-12 23:03:39,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1d4e3323886b588be7c14179934902d1, NAME => 'hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:39,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1d4e3323886b588be7c14179934902d1 2023-02-12 23:03:39,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:39,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1d4e3323886b588be7c14179934902d1 2023-02-12 23:03:39,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1d4e3323886b588be7c14179934902d1 2023-02-12 23:03:39,616 INFO [StoreOpener-1d4e3323886b588be7c14179934902d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1d4e3323886b588be7c14179934902d1 2023-02-12 23:03:39,617 DEBUG [StoreOpener-1d4e3323886b588be7c14179934902d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/namespace/1d4e3323886b588be7c14179934902d1/info 2023-02-12 23:03:39,617 DEBUG [StoreOpener-1d4e3323886b588be7c14179934902d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/namespace/1d4e3323886b588be7c14179934902d1/info 2023-02-12 23:03:39,618 INFO [StoreOpener-1d4e3323886b588be7c14179934902d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d4e3323886b588be7c14179934902d1 columnFamilyName info 2023-02-12 23:03:39,618 INFO [StoreOpener-1d4e3323886b588be7c14179934902d1-1] regionserver.HStore(310): Store=1d4e3323886b588be7c14179934902d1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:39,619 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/namespace/1d4e3323886b588be7c14179934902d1 2023-02-12 23:03:39,619 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/namespace/1d4e3323886b588be7c14179934902d1 2023-02-12 23:03:39,621 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1d4e3323886b588be7c14179934902d1 2023-02-12 23:03:39,623 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/namespace/1d4e3323886b588be7c14179934902d1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:39,623 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1d4e3323886b588be7c14179934902d1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70311378, jitterRate=0.04772117733955383}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 23:03:39,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1d4e3323886b588be7c14179934902d1: Running coprocessor pre-open hook at 1676243019615Writing region info on filesystem at 1676243019615Initializing all the Stores at 1676243019616 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243019616Cleaning up temporary data from old regions at 1676243019620 (+4 ms)Cleaning up detritus from prior splits at 1676243019620Running coprocessor post-open hooks at 1676243019624 (+4 ms)Region opened successfully at 1676243019624 2023-02-12 23:03:39,624 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1., pid=6, masterSystemTime=1676243019591 2023-02-12 23:03:39,627 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1. 2023-02-12 23:03:39,628 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1. 2023-02-12 23:03:39,628 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1d4e3323886b588be7c14179934902d1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:39,629 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676243019628"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243019628"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243019628"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243019628"}]},"ts":"1676243019628"} 2023-02-12 23:03:39,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 23:03:39,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1d4e3323886b588be7c14179934902d1, server=jenkins-hbase4.apache.org,46233,1676243018639 in 192 msec 2023-02-12 23:03:39,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 23:03:39,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1d4e3323886b588be7c14179934902d1, ASSIGN in 348 msec 2023-02-12 23:03:39,633 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 23:03:39,633 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243019633"}]},"ts":"1676243019633"} 2023-02-12 23:03:39,635 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 23:03:39,638 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 23:03:39,639 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 386 msec 2023-02-12 23:03:39,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 23:03:39,654 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:39,654 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:39,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:39,658 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35974, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:39,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 23:03:39,667 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:39,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-12 23:03:39,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 23:03:39,682 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:39,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-02-12 23:03:39,695 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 23:03:39,697 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 23:03:39,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.979sec 2023-02-12 23:03:39,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 23:03:39,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 23:03:39,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 23:03:39,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34483,1676243018582-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 23:03:39,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34483,1676243018582-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 23:03:39,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 23:03:39,711 DEBUG [Listener at localhost/44537] zookeeper.ReadOnlyZKClient(139): Connect 0x3562ab1f to 127.0.0.1:58963 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:39,717 DEBUG [Listener at localhost/44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33d9fd67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:39,719 DEBUG [hconnection-0x5b91cf3b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:39,721 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35922, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:39,722 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34483,1676243018582 2023-02-12 23:03:39,723 DEBUG [Listener at localhost/44537] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 23:03:39,724 DEBUG [Listener at localhost/44537] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 23:03:39,728 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37492, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 23:03:39,728 INFO [Listener at localhost/44537] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-12 23:03:39,729 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-12 23:03:39,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 23:03:39,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:37492 deadline: 1676243079729, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-12 23:03:39,729 INFO [Listener at localhost/44537] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-12 23:03:39,732 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:39,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 23:03:39,734 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 23:03:39,734 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-12 23:03:39,734 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 23:03:39,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:39,736 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:39,736 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538 empty. 2023-02-12 23:03:39,737 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:39,737 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-12 23:03:39,744 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:39,745 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 14d42cc94b3177ea83b3cce3565d8538, NAME => 'testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp 2023-02-12 23:03:39,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:39,755 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 14d42cc94b3177ea83b3cce3565d8538, disabling compactions & flushes 2023-02-12 23:03:39,755 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:39,755 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:39,755 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. after waiting 0 ms 2023-02-12 23:03:39,755 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:39,755 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:39,755 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 14d42cc94b3177ea83b3cce3565d8538: Waiting for close lock at 1676243019755Disabling compacts and flushes for region at 1676243019755Disabling writes for close at 1676243019755Writing region close event to WAL at 1676243019755Closed at 1676243019755 2023-02-12 23:03:39,756 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 23:03:39,757 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676243019757"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243019757"}]},"ts":"1676243019757"} 2023-02-12 23:03:39,758 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 23:03:39,759 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 23:03:39,759 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243019759"}]},"ts":"1676243019759"} 2023-02-12 23:03:39,760 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-12 23:03:39,764 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:39,765 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:39,765 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:39,765 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:39,765 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=14d42cc94b3177ea83b3cce3565d8538, ASSIGN}] 2023-02-12 23:03:39,767 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=14d42cc94b3177ea83b3cce3565d8538, ASSIGN 2023-02-12 23:03:39,767 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=14d42cc94b3177ea83b3cce3565d8538, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34931,1676243018691; forceNewPlan=false, retain=false 2023-02-12 23:03:39,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:39,918 INFO [jenkins-hbase4:34483] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 23:03:39,918 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=14d42cc94b3177ea83b3cce3565d8538, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:39,918 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676243019918"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243019918"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243019918"}]},"ts":"1676243019918"} 2023-02-12 23:03:39,920 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 14d42cc94b3177ea83b3cce3565d8538, server=jenkins-hbase4.apache.org,34931,1676243018691}] 2023-02-12 23:03:39,999 INFO [RS:1;jenkins-hbase4:34931] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34931%2C1676243018691, suffix=, logDir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/WALs/jenkins-hbase4.apache.org,34931,1676243018691, archiveDir=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/oldWALs, maxLogs=32 2023-02-12 23:03:40,011 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36241,DS-34b7a82c-9793-4894-acce-722e3be9cd63,DISK] 2023-02-12 23:03:40,011 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37769,DS-0b2c0a43-d6db-4f0f-a3c5-ebead09c0b56,DISK] 2023-02-12 23:03:40,013 INFO [RS:1;jenkins-hbase4:34931] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/WALs/jenkins-hbase4.apache.org,34931,1676243018691/jenkins-hbase4.apache.org%2C34931%2C1676243018691.1676243019999 2023-02-12 23:03:40,013 DEBUG [RS:1;jenkins-hbase4:34931] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36241,DS-34b7a82c-9793-4894-acce-722e3be9cd63,DISK], DatanodeInfoWithStorage[127.0.0.1:37769,DS-0b2c0a43-d6db-4f0f-a3c5-ebead09c0b56,DISK]] 2023-02-12 23:03:40,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:40,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:40,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 14d42cc94b3177ea83b3cce3565d8538, NAME => 'testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:40,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:40,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:40,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:40,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:40,075 INFO [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:40,076 DEBUG [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f1 2023-02-12 23:03:40,076 DEBUG [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f1 2023-02-12 23:03:40,077 INFO [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14d42cc94b3177ea83b3cce3565d8538 columnFamilyName f1 2023-02-12 23:03:40,077 INFO [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] regionserver.HStore(310): Store=14d42cc94b3177ea83b3cce3565d8538/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:40,077 INFO [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:40,078 DEBUG [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f2 2023-02-12 23:03:40,078 DEBUG [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f2 2023-02-12 23:03:40,078 INFO [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14d42cc94b3177ea83b3cce3565d8538 columnFamilyName f2 2023-02-12 23:03:40,079 INFO [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] regionserver.HStore(310): Store=14d42cc94b3177ea83b3cce3565d8538/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:40,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:40,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:40,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:40,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:40,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:40,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 14d42cc94b3177ea83b3cce3565d8538; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74525266, jitterRate=0.11051300168037415}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:40,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 14d42cc94b3177ea83b3cce3565d8538: Running coprocessor pre-open hook at 1676243020074Writing region info on filesystem at 1676243020074Initializing all the Stores at 1676243020075 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243020075Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243020075Cleaning up temporary data from old regions at 1676243020080 (+5 ms)Cleaning up detritus from prior splits at 1676243020080Running coprocessor post-open hooks at 1676243020083 (+3 ms)Region opened successfully at 1676243020083 2023-02-12 23:03:40,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538., pid=12, masterSystemTime=1676243020071 2023-02-12 23:03:40,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:40,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:40,085 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=14d42cc94b3177ea83b3cce3565d8538, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,086 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676243020085"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243020085"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243020085"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243020085"}]},"ts":"1676243020085"} 2023-02-12 23:03:40,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 23:03:40,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 14d42cc94b3177ea83b3cce3565d8538, server=jenkins-hbase4.apache.org,34931,1676243018691 in 167 msec 2023-02-12 23:03:40,089 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 23:03:40,089 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=14d42cc94b3177ea83b3cce3565d8538, ASSIGN in 323 msec 2023-02-12 23:03:40,090 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 23:03:40,090 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243020090"}]},"ts":"1676243020090"} 2023-02-12 23:03:40,091 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-12 23:03:40,093 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 23:03:40,094 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 361 msec 2023-02-12 23:03:40,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:40,339 INFO [Listener at localhost/44537] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-12 23:03:40,339 DEBUG [Listener at localhost/44537] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-12 23:03:40,339 INFO [Listener at localhost/44537] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 23:03:40,341 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-12 23:03:40,341 INFO [Listener at localhost/44537] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 23:03:40,341 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-12 23:03:40,341 INFO [Listener at localhost/44537] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 23:03:40,378 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34931] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:40,460 INFO [Listener at localhost/44537] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 23:03:40,460 INFO [Listener at localhost/44537] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 23:03:40,461 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-12 23:03:40,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676243020461 (current time:1676243020461). 2023-02-12 23:03:40,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 23:03:40,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] zookeeper.ReadOnlyZKClient(139): Connect 0x6210269b to 127.0.0.1:58963 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:40,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@282c6bc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:40,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:40,466 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35926, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:40,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6210269b to 127.0.0.1:58963 2023-02-12 23:03:40,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:40,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 23:03:40,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-12 23:03:40,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-12 23:03:40,471 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-12 23:03:40,471 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676243620471 2023-02-12 23:03:40,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-12 23:03:40,471 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,472 DEBUG [Listener at localhost/44537] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 23:03:40,473 DEBUG [Listener at localhost/44537] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 23:03:40,473 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-12 23:03:40,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-12 23:03:40,474 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-12 23:03:40,475 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-12 23:03:40,475 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676243620475 2023-02-12 23:03:40,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,488 INFO [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-12 23:03:40,488 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:40,489 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-12 23:03:40,489 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-12 23:03:40,489 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,489 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,491 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:40,491 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:40,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:40,491 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:40,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:40,492 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,492 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 23:03:40,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-12 23:03:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-12 23:03:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,493 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-12 23:03:40,493 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-12 23:03:40,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,493 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-12 23:03:40,493 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:40,494 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 23:03:40,494 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-12 23:03:40,494 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:40,494 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 23:03:40,494 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34931,1676243018691' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 23:03:40,495 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 23:03:40,495 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 23:03:40,495 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46233,1676243018639' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 23:03:40,496 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,496 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:40,496 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,497 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,497 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:40,497 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,497 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:40,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34931,1676243018691' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-12 23:03:40,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@292d964e[Count = 0] remaining members to acquire global barrier 2023-02-12 23:03:40,498 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-12 23:03:40,498 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,499 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,499 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,499 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 23:03:40,499 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 23:03:40,500 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 23:03:40,500 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,500 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 23:03:40,500 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46233,1676243018639' in zk 2023-02-12 23:03:40,500 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 23:03:40,500 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 23:03:40,500 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:40,500 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. started... 2023-02-12 23:03:40,500 INFO [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 14d42cc94b3177ea83b3cce3565d8538 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 23:03:40,501 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 23:03:40,501 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:40,501 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 23:03:40,513 INFO [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/.tmp/f1/241404b5fe8a4e5a8bd64973ba36702d 2023-02-12 23:03:40,528 INFO [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/.tmp/f2/685f594c7a034419b62c7d84d358c8c5 2023-02-12 23:03:40,533 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/.tmp/f1/241404b5fe8a4e5a8bd64973ba36702d as hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f1/241404b5fe8a4e5a8bd64973ba36702d 2023-02-12 23:03:40,537 INFO [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f1/241404b5fe8a4e5a8bd64973ba36702d, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 23:03:40,538 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/.tmp/f2/685f594c7a034419b62c7d84d358c8c5 as hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f2/685f594c7a034419b62c7d84d358c8c5 2023-02-12 23:03:40,542 INFO [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f2/685f594c7a034419b62c7d84d358c8c5, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 23:03:40,543 INFO [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 14d42cc94b3177ea83b3cce3565d8538 in 43ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:40,543 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-12 23:03:40,544 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 14d42cc94b3177ea83b3cce3565d8538: 2023-02-12 23:03:40,544 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,544 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:40,544 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f1/241404b5fe8a4e5a8bd64973ba36702d] hfiles 2023-02-12 23:03:40,544 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f1/241404b5fe8a4e5a8bd64973ba36702d for snapshot=testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,544 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f2/685f594c7a034419b62c7d84d358c8c5] hfiles 2023-02-12 23:03:40,544 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f2/685f594c7a034419b62c7d84d358c8c5 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,555 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. completed. 2023-02-12 23:03:40,556 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:40,556 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 23:03:40,556 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 23:03:40,556 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,556 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 23:03:40,556 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34931,1676243018691' in zk 2023-02-12 23:03:40,559 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,559 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 23:03:40,559 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:40,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,559 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 23:03:40,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:40,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:40,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:40,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:40,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,34931,1676243018691': 2023-02-12 23:03:40,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34931,1676243018691' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-12 23:03:40,562 INFO [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-12 23:03:40,562 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 23:03:40,562 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 23:03:40,562 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,562 INFO [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 23:03:40,563 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,563 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,563 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:40,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:40,564 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,564 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,565 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,566 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,566 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:40,566 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:40,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:40,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,571 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,571 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:40,571 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:40,571 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:40,571 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:40,571 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:40,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:40,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:40,571 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:40,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:40,571 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:40,571 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,571 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,571 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:40,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:40,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,571 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,572 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,572 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,572 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:40,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:40,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion because node does not exist (not an error) 2023-02-12 23:03:40,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,573 DEBUG [Listener at localhost/44537] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:40,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-12 23:03:40,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 23:03:40,575 DEBUG [Listener at localhost/44537] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 23:03:40,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-12 23:03:40,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,600 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676243020471Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676243020571 (+100 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676243020572 (+1 ms)Writing data manifest for testWithMockedMapReduceSingleRegion at 1676243020574 (+2 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676243020580 (+6 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676243020599 (+19 ms) 2023-02-12 23:03:40,602 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-12 23:03:40,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 130 msec 2023-02-12 23:03:40,719 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 23:03:40,719 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-12 23:03:40,775 DEBUG [Listener at localhost/44537] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:40,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-12 23:03:40,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 23:03:40,777 INFO [Listener at localhost/44537] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 23:03:40,780 INFO [Listener at localhost/44537] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 23:03:40,785 INFO [Listener at localhost/44537] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 23:03:40,812 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34931] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:40,894 INFO [Listener at localhost/44537] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 23:03:40,899 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 23:03:40,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,901 INFO [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-12 23:03:40,901 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:40,902 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-12 23:03:40,902 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-12 23:03:40,902 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,902 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,905 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:40,905 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:40,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:40,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:40,905 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:40,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:40,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,905 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,906 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 23:03:40,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 23:03:40,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,906 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 23:03:40,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,906 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,907 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,907 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-12 23:03:40,907 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:40,907 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-12 23:03:40,907 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 23:03:40,908 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 23:03:40,908 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46233,1676243018639' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 23:03:40,908 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:40,908 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 23:03:40,909 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 23:03:40,909 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 23:03:40,909 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:40,909 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. started... 2023-02-12 23:03:40,909 INFO [rs(jenkins-hbase4.apache.org,34931,1676243018691)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 14d42cc94b3177ea83b3cce3565d8538 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 23:03:40,909 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,910 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,910 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:40,924 INFO [rs(jenkins-hbase4.apache.org,34931,1676243018691)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/.tmp/f1/0c64303b969744b5b3b2572ef0951a95 2023-02-12 23:03:40,941 INFO [rs(jenkins-hbase4.apache.org,34931,1676243018691)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/.tmp/f2/e8daa31eb37346118987b9b9972b6233 2023-02-12 23:03:40,945 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/.tmp/f1/0c64303b969744b5b3b2572ef0951a95 as hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f1/0c64303b969744b5b3b2572ef0951a95 2023-02-12 23:03:40,949 INFO [rs(jenkins-hbase4.apache.org,34931,1676243018691)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f1/0c64303b969744b5b3b2572ef0951a95, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 23:03:40,949 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/.tmp/f2/e8daa31eb37346118987b9b9972b6233 as hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f2/e8daa31eb37346118987b9b9972b6233 2023-02-12 23:03:40,953 INFO [rs(jenkins-hbase4.apache.org,34931,1676243018691)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f2/e8daa31eb37346118987b9b9972b6233, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 23:03:40,954 INFO [rs(jenkins-hbase4.apache.org,34931,1676243018691)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 14d42cc94b3177ea83b3cce3565d8538 in 45ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:40,955 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 14d42cc94b3177ea83b3cce3565d8538: 2023-02-12 23:03:40,955 DEBUG [rs(jenkins-hbase4.apache.org,34931,1676243018691)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:40,955 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 23:03:40,955 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 23:03:40,955 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,955 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 23:03:40,955 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34931,1676243018691' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 23:03:40,957 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,957 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:40,957 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,957 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:40,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34931,1676243018691' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-12 23:03:40,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d1217b3[Count = 0] remaining members to acquire global barrier 2023-02-12 23:03:40,959 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-12 23:03:40,959 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,960 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,960 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,960 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 23:03:40,960 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,960 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 23:03:40,960 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 23:03:40,960 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 23:03:40,960 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 23:03:40,960 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34931,1676243018691' in zk 2023-02-12 23:03:40,960 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46233,1676243018639' in zk 2023-02-12 23:03:40,962 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 23:03:40,962 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:40,963 DEBUG [member: 'jenkins-hbase4.apache.org,46233,1676243018639' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 23:03:40,963 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,963 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 23:03:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:40,963 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:40,963 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1676243018691' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 23:03:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,34931,1676243018691': 2023-02-12 23:03:40,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34931,1676243018691' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-12 23:03:40,966 INFO [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-12 23:03:40,966 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 23:03:40,966 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 23:03:40,966 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,966 INFO [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 23:03:40,967 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,967 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,967 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:40,967 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,967 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:40,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:40,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,968 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:40,968 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,970 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:40,970 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,972 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,972 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:40,972 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:40,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:40,972 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:40,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:40,972 DEBUG [(jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:40,972 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:40,972 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,972 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-12 23:03:40,972 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 23:03:40,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:40,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:40,972 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,973 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,973 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:40,973 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,973 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:40,973 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,973 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:40,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:40,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:40,973 DEBUG [Listener at localhost/44537] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-12 23:03:40,973 DEBUG [Listener at localhost/44537] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 23:03:40,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:40,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:41,073 DEBUG [Listener at localhost/44537] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 23:03:41,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 23:03:41,078 INFO [Listener at localhost/44537] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676243020461 type: FLUSH version: 2 ttl: 0 2023-02-12 23:03:41,079 DEBUG [Listener at localhost/44537] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46471/user/jenkins/test-data/ebf54ebe-c0ad-987a-c4d7-947cb9ae411a/testWithMockedMapReduceSingleRegion/182f3d99-baa2-4239-99a0-0c3997a14117/data/default/testWithMockedMapReduceSingleRegion 2023-02-12 23:03:41,079 INFO [Listener at localhost/44537] snapshot.RestoreSnapshotHelper(239): region to add: 14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:41,079 INFO [Listener at localhost/44537] snapshot.RestoreSnapshotHelper(585): clone region=14d42cc94b3177ea83b3cce3565d8538 as 14d42cc94b3177ea83b3cce3565d8538 in snapshot testWithMockedMapReduceSingleRegion 2023-02-12 23:03:41,080 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 14d42cc94b3177ea83b3cce3565d8538, NAME => 'testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46471/user/jenkins/test-data/ebf54ebe-c0ad-987a-c4d7-947cb9ae411a/testWithMockedMapReduceSingleRegion/182f3d99-baa2-4239-99a0-0c3997a14117 2023-02-12 23:03:41,085 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:41,086 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 241404b5fe8a4e5a8bd64973ba36702d from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-12 23:03:41,087 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 685f594c7a034419b62c7d84d358c8c5 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-12 23:03:41,089 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 14d42cc94b3177ea83b3cce3565d8538, disabling compactions & flushes 2023-02-12 23:03:41,089 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:41,089 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:41,089 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. after waiting 0 ms 2023-02-12 23:03:41,089 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:41,089 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:41,089 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 14d42cc94b3177ea83b3cce3565d8538: Waiting for close lock at 1676243021089Disabling compacts and flushes for region at 1676243021089Disabling writes for close at 1676243021089Writing region close event to WAL at 1676243021089Closed at 1676243021089 2023-02-12 23:03:41,089 INFO [Listener at localhost/44537] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676243020461 type: FLUSH version: 2 ttl: 0 2023-02-12 23:03:41,090 DEBUG [Listener at localhost/44537] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46471/user/jenkins/test-data/ebf54ebe-c0ad-987a-c4d7-947cb9ae411a/testWithMockedMapReduceSingleRegion/182f3d99-baa2-4239-99a0-0c3997a14117 2023-02-12 23:03:41,090 DEBUG [Listener at localhost/44537] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46471/user/jenkins/test-data/ebf54ebe-c0ad-987a-c4d7-947cb9ae411a/testWithMockedMapReduceSingleRegion/182f3d99-baa2-4239-99a0-0c3997a14117 2023-02-12 23:03:41,090 DEBUG [Listener at localhost/44537] util.CommonFSUtils(699): |-data/ 2023-02-12 23:03:41,090 DEBUG [Listener at localhost/44537] util.CommonFSUtils(699): |----default/ 2023-02-12 23:03:41,091 DEBUG [Listener at localhost/44537] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-12 23:03:41,091 DEBUG [Listener at localhost/44537] util.CommonFSUtils(699): |----------14d42cc94b3177ea83b3cce3565d8538/ 2023-02-12 23:03:41,091 DEBUG [Listener at localhost/44537] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:41,091 DEBUG [Listener at localhost/44537] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:41,092 DEBUG [Listener at localhost/44537] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=14d42cc94b3177ea83b3cce3565d8538-241404b5fe8a4e5a8bd64973ba36702d 2023-02-12 23:03:41,092 DEBUG [Listener at localhost/44537] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:41,092 DEBUG [Listener at localhost/44537] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=14d42cc94b3177ea83b3cce3565d8538-685f594c7a034419b62c7d84d358c8c5 2023-02-12 23:03:41,095 INFO [Listener at localhost/44537] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 23:03:41,098 DEBUG [Listener at localhost/44537] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:41,098 INFO [Listener at localhost/44537] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:41,098 DEBUG [Listener at localhost/44537] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:41,100 INFO [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:41,101 DEBUG [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/ebf54ebe-c0ad-987a-c4d7-947cb9ae411a/testWithMockedMapReduceSingleRegion/182f3d99-baa2-4239-99a0-0c3997a14117/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f1 2023-02-12 23:03:41,101 INFO [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14d42cc94b3177ea83b3cce3565d8538 columnFamilyName f1 2023-02-12 23:03:41,105 DEBUG [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] regionserver.HStore(539): loaded hdfs://localhost:46471/user/jenkins/test-data/ebf54ebe-c0ad-987a-c4d7-947cb9ae411a/testWithMockedMapReduceSingleRegion/182f3d99-baa2-4239-99a0-0c3997a14117/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f1/testWithMockedMapReduceSingleRegion=14d42cc94b3177ea83b3cce3565d8538-241404b5fe8a4e5a8bd64973ba36702d 2023-02-12 23:03:41,105 INFO [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] regionserver.HStore(310): Store=14d42cc94b3177ea83b3cce3565d8538/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:41,105 INFO [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:41,106 DEBUG [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46471/user/jenkins/test-data/ebf54ebe-c0ad-987a-c4d7-947cb9ae411a/testWithMockedMapReduceSingleRegion/182f3d99-baa2-4239-99a0-0c3997a14117/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f2 2023-02-12 23:03:41,106 INFO [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14d42cc94b3177ea83b3cce3565d8538 columnFamilyName f2 2023-02-12 23:03:41,110 DEBUG [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] regionserver.HStore(539): loaded hdfs://localhost:46471/user/jenkins/test-data/ebf54ebe-c0ad-987a-c4d7-947cb9ae411a/testWithMockedMapReduceSingleRegion/182f3d99-baa2-4239-99a0-0c3997a14117/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f2/testWithMockedMapReduceSingleRegion=14d42cc94b3177ea83b3cce3565d8538-685f594c7a034419b62c7d84d358c8c5 2023-02-12 23:03:41,110 INFO [StoreOpener-14d42cc94b3177ea83b3cce3565d8538-1] regionserver.HStore(310): Store=14d42cc94b3177ea83b3cce3565d8538/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:41,110 DEBUG [Listener at localhost/44537] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:41,110 INFO [Listener at localhost/44537] regionserver.HRegion(1071): Opened 14d42cc94b3177ea83b3cce3565d8538; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60021247, jitterRate=-0.10561372339725494}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:41,110 DEBUG [Listener at localhost/44537] regionserver.HRegion(964): Region open journal for 14d42cc94b3177ea83b3cce3565d8538: Writing region info on filesystem at 1676243021098Initializing all the Stores at 1676243021099 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243021099Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243021099Region opened successfully at 1676243021110 (+11 ms) 2023-02-12 23:03:41,157 DEBUG [Listener at localhost/44537] regionserver.HRegion(1603): Closing 14d42cc94b3177ea83b3cce3565d8538, disabling compactions & flushes 2023-02-12 23:03:41,157 INFO [Listener at localhost/44537] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:41,157 DEBUG [Listener at localhost/44537] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:41,158 DEBUG [Listener at localhost/44537] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. after waiting 0 ms 2023-02-12 23:03:41,158 DEBUG [Listener at localhost/44537] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:41,158 INFO [Listener at localhost/44537] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:41,158 DEBUG [Listener at localhost/44537] regionserver.HRegion(1557): Region close journal for 14d42cc94b3177ea83b3cce3565d8538: Waiting for close lock at 1676243021157Disabling compacts and flushes for region at 1676243021157Disabling writes for close at 1676243021158 (+1 ms)Writing region close event to WAL at 1676243021158Closed at 1676243021158 2023-02-12 23:03:41,162 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-12 23:03:41,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-12 23:03:41,165 INFO [Listener at localhost/44537] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-12 23:03:41,166 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-12 23:03:41,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 23:03:41,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 23:03:41,169 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243021169"}]},"ts":"1676243021169"} 2023-02-12 23:03:41,170 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-12 23:03:41,172 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-12 23:03:41,173 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=14d42cc94b3177ea83b3cce3565d8538, UNASSIGN}] 2023-02-12 23:03:41,174 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=14d42cc94b3177ea83b3cce3565d8538, UNASSIGN 2023-02-12 23:03:41,175 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=14d42cc94b3177ea83b3cce3565d8538, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:41,175 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676243021175"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243021175"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243021175"}]},"ts":"1676243021175"} 2023-02-12 23:03:41,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 14d42cc94b3177ea83b3cce3565d8538, server=jenkins-hbase4.apache.org,34931,1676243018691}] 2023-02-12 23:03:41,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 23:03:41,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:41,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 14d42cc94b3177ea83b3cce3565d8538, disabling compactions & flushes 2023-02-12 23:03:41,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:41,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:41,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. after waiting 0 ms 2023-02-12 23:03:41,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:41,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:41,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538. 2023-02-12 23:03:41,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 14d42cc94b3177ea83b3cce3565d8538: Waiting for close lock at 1676243021328Running coprocessor pre-close hooks at 1676243021328Disabling compacts and flushes for region at 1676243021328Disabling writes for close at 1676243021328Writing region close event to WAL at 1676243021329 (+1 ms)Running coprocessor post-close hooks at 1676243021332 (+3 ms)Closed at 1676243021332 2023-02-12 23:03:41,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:41,333 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=14d42cc94b3177ea83b3cce3565d8538, regionState=CLOSED 2023-02-12 23:03:41,334 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676243021333"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243021333"}]},"ts":"1676243021333"} 2023-02-12 23:03:41,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 23:03:41,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 14d42cc94b3177ea83b3cce3565d8538, server=jenkins-hbase4.apache.org,34931,1676243018691 in 159 msec 2023-02-12 23:03:41,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 23:03:41,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=14d42cc94b3177ea83b3cce3565d8538, UNASSIGN in 163 msec 2023-02-12 23:03:41,338 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243021338"}]},"ts":"1676243021338"} 2023-02-12 23:03:41,339 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-12 23:03:41,340 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-12 23:03:41,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 175 msec 2023-02-12 23:03:41,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 23:03:41,472 INFO [Listener at localhost/44537] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-12 23:03:41,472 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-12 23:03:41,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 23:03:41,474 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 23:03:41,475 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 23:03:41,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 23:03:41,478 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:41,479 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f1, FileablePath, hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f2, FileablePath, hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/recovered.edits] 2023-02-12 23:03:41,482 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f1/0c64303b969744b5b3b2572ef0951a95 to hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/archive/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f1/0c64303b969744b5b3b2572ef0951a95 2023-02-12 23:03:41,483 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f1/241404b5fe8a4e5a8bd64973ba36702d to hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/archive/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f1/241404b5fe8a4e5a8bd64973ba36702d 2023-02-12 23:03:41,484 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f2/685f594c7a034419b62c7d84d358c8c5 to hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/archive/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f2/685f594c7a034419b62c7d84d358c8c5 2023-02-12 23:03:41,485 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f2/e8daa31eb37346118987b9b9972b6233 to hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/archive/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/f2/e8daa31eb37346118987b9b9972b6233 2023-02-12 23:03:41,488 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/recovered.edits/12.seqid to hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/archive/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538/recovered.edits/12.seqid 2023-02-12 23:03:41,488 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/.tmp/data/default/testWithMockedMapReduceSingleRegion/14d42cc94b3177ea83b3cce3565d8538 2023-02-12 23:03:41,488 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-12 23:03:41,490 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 23:03:41,491 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-12 23:03:41,493 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-12 23:03:41,493 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 23:03:41,493 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-12 23:03:41,494 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676243021493"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:41,495 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 23:03:41,495 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 14d42cc94b3177ea83b3cce3565d8538, NAME => 'testWithMockedMapReduceSingleRegion,,1676243019732.14d42cc94b3177ea83b3cce3565d8538.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 23:03:41,495 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-12 23:03:41,495 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676243021495"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:41,496 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-12 23:03:41,498 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 23:03:41,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 25 msec 2023-02-12 23:03:41,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34483] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 23:03:41,577 INFO [Listener at localhost/44537] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-12 23:03:41,577 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 23:03:41,577 INFO [Listener at localhost/44537] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 23:03:41,577 DEBUG [Listener at localhost/44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3562ab1f to 127.0.0.1:58963 2023-02-12 23:03:41,577 DEBUG [Listener at localhost/44537] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:41,578 DEBUG [Listener at localhost/44537] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 23:03:41,578 DEBUG [Listener at localhost/44537] util.JVMClusterUtil(257): Found active master hash=1385226254, stopped=false 2023-02-12 23:03:41,578 INFO [Listener at localhost/44537] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34483,1676243018582 2023-02-12 23:03:41,581 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:41,581 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:41,581 INFO [Listener at localhost/44537] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 23:03:41,581 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:41,581 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:41,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:41,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:41,583 DEBUG [Listener at localhost/44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cb8aaba to 127.0.0.1:58963 2023-02-12 23:03:41,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:41,583 DEBUG [Listener at localhost/44537] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:41,583 INFO [Listener at localhost/44537] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46233,1676243018639' ***** 2023-02-12 23:03:41,583 INFO [Listener at localhost/44537] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 23:03:41,583 INFO [Listener at localhost/44537] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34931,1676243018691' ***** 2023-02-12 23:03:41,583 INFO [RS:0;jenkins-hbase4:46233] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 23:03:41,584 INFO [Listener at localhost/44537] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 23:03:41,584 INFO [RS:0;jenkins-hbase4:46233] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 23:03:41,584 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 23:03:41,584 INFO [RS:0;jenkins-hbase4:46233] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 23:03:41,584 INFO [RS:1;jenkins-hbase4:34931] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 23:03:41,585 INFO [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer(3304): Received CLOSE for 1d4e3323886b588be7c14179934902d1 2023-02-12 23:03:41,585 INFO [RS:1;jenkins-hbase4:34931] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 23:03:41,585 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 23:03:41,585 INFO [RS:1;jenkins-hbase4:34931] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 23:03:41,585 INFO [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:41,585 INFO [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:41,585 DEBUG [RS:1;jenkins-hbase4:34931] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17c269f3 to 127.0.0.1:58963 2023-02-12 23:03:41,585 DEBUG [RS:0;jenkins-hbase4:46233] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4626a7be to 127.0.0.1:58963 2023-02-12 23:03:41,586 DEBUG [RS:0;jenkins-hbase4:46233] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:41,586 INFO [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 23:03:41,586 DEBUG [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer(1479): Online Regions={1d4e3323886b588be7c14179934902d1=hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1.} 2023-02-12 23:03:41,586 DEBUG [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer(1505): Waiting on 1d4e3323886b588be7c14179934902d1 2023-02-12 23:03:41,586 DEBUG [RS:1;jenkins-hbase4:34931] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:41,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1d4e3323886b588be7c14179934902d1, disabling compactions & flushes 2023-02-12 23:03:41,586 INFO [RS:1;jenkins-hbase4:34931] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 23:03:41,586 INFO [RS:1;jenkins-hbase4:34931] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 23:03:41,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1. 2023-02-12 23:03:41,586 INFO [RS:1;jenkins-hbase4:34931] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 23:03:41,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1. 2023-02-12 23:03:41,586 INFO [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 23:03:41,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1. after waiting 0 ms 2023-02-12 23:03:41,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1. 2023-02-12 23:03:41,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1d4e3323886b588be7c14179934902d1 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 23:03:41,586 INFO [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 23:03:41,587 DEBUG [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 23:03:41,587 DEBUG [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 23:03:41,587 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 23:03:41,587 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 23:03:41,587 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 23:03:41,587 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 23:03:41,587 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 23:03:41,587 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-12 23:03:41,595 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/.tmp/info/d814a9f216e2489689a7cfb1e25d4e17 2023-02-12 23:03:41,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/namespace/1d4e3323886b588be7c14179934902d1/.tmp/info/56a9f089bc6243db95d52fe18cc3bddf 2023-02-12 23:03:41,599 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d814a9f216e2489689a7cfb1e25d4e17 2023-02-12 23:03:41,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/namespace/1d4e3323886b588be7c14179934902d1/.tmp/info/56a9f089bc6243db95d52fe18cc3bddf as hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/namespace/1d4e3323886b588be7c14179934902d1/info/56a9f089bc6243db95d52fe18cc3bddf 2023-02-12 23:03:41,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/namespace/1d4e3323886b588be7c14179934902d1/info/56a9f089bc6243db95d52fe18cc3bddf, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 23:03:41,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1d4e3323886b588be7c14179934902d1 in 18ms, sequenceid=6, compaction requested=false 2023-02-12 23:03:41,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/namespace/1d4e3323886b588be7c14179934902d1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 23:03:41,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1. 2023-02-12 23:03:41,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1d4e3323886b588be7c14179934902d1: Waiting for close lock at 1676243021586Running coprocessor pre-close hooks at 1676243021586Disabling compacts and flushes for region at 1676243021586Disabling writes for close at 1676243021586Obtaining lock to block concurrent updates at 1676243021586Preparing flush snapshotting stores in 1d4e3323886b588be7c14179934902d1 at 1676243021586Finished memstore snapshotting hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676243021587 (+1 ms)Flushing stores of hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1. at 1676243021587Flushing 1d4e3323886b588be7c14179934902d1/info: creating writer at 1676243021587Flushing 1d4e3323886b588be7c14179934902d1/info: appending metadata at 1676243021589 (+2 ms)Flushing 1d4e3323886b588be7c14179934902d1/info: closing flushed file at 1676243021589Flushing 1d4e3323886b588be7c14179934902d1/info: reopening flushed file at 1676243021600 (+11 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1d4e3323886b588be7c14179934902d1 in 18ms, sequenceid=6, compaction requested=false at 1676243021604 (+4 ms)Writing region close event to WAL at 1676243021606 (+2 ms)Running coprocessor post-close hooks at 1676243021609 (+3 ms)Closed at 1676243021609 2023-02-12 23:03:41,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676243019252.1d4e3323886b588be7c14179934902d1. 2023-02-12 23:03:41,612 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/.tmp/rep_barrier/2ced2fe406f9417d9b1919b21e6f7255 2023-02-12 23:03:41,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ced2fe406f9417d9b1919b21e6f7255 2023-02-12 23:03:41,622 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/.tmp/table/828cc5bafb504002954aca1ba64b1157 2023-02-12 23:03:41,625 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 828cc5bafb504002954aca1ba64b1157 2023-02-12 23:03:41,626 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/.tmp/info/d814a9f216e2489689a7cfb1e25d4e17 as hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/info/d814a9f216e2489689a7cfb1e25d4e17 2023-02-12 23:03:41,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d814a9f216e2489689a7cfb1e25d4e17 2023-02-12 23:03:41,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/info/d814a9f216e2489689a7cfb1e25d4e17, entries=12, sequenceid=21, filesize=6.3 K 2023-02-12 23:03:41,630 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/.tmp/rep_barrier/2ced2fe406f9417d9b1919b21e6f7255 as hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/rep_barrier/2ced2fe406f9417d9b1919b21e6f7255 2023-02-12 23:03:41,633 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ced2fe406f9417d9b1919b21e6f7255 2023-02-12 23:03:41,633 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/rep_barrier/2ced2fe406f9417d9b1919b21e6f7255, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 23:03:41,634 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/.tmp/table/828cc5bafb504002954aca1ba64b1157 as hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/table/828cc5bafb504002954aca1ba64b1157 2023-02-12 23:03:41,637 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 828cc5bafb504002954aca1ba64b1157 2023-02-12 23:03:41,637 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/table/828cc5bafb504002954aca1ba64b1157, entries=4, sequenceid=21, filesize=5.1 K 2023-02-12 23:03:41,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 53ms, sequenceid=21, compaction requested=false 2023-02-12 23:03:41,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 23:03:41,644 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 23:03:41,644 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:41,644 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676243021587Running coprocessor pre-close hooks at 1676243021587Disabling compacts and flushes for region at 1676243021587Disabling writes for close at 1676243021587Obtaining lock to block concurrent updates at 1676243021587Preparing flush snapshotting stores in 1588230740 at 1676243021587Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1676243021587Flushing stores of hbase:meta,,1.1588230740 at 1676243021588 (+1 ms)Flushing 1588230740/info: creating writer at 1676243021588Flushing 1588230740/info: appending metadata at 1676243021589 (+1 ms)Flushing 1588230740/info: closing flushed file at 1676243021589Flushing 1588230740/rep_barrier: creating writer at 1676243021599 (+10 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676243021606 (+7 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676243021606Flushing 1588230740/table: creating writer at 1676243021615 (+9 ms)Flushing 1588230740/table: appending metadata at 1676243021617 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676243021617Flushing 1588230740/info: reopening flushed file at 1676243021626 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676243021630 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676243021635 (+5 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 53ms, sequenceid=21, compaction requested=false at 1676243021641 (+6 ms)Writing region close event to WAL at 1676243021641Running coprocessor post-close hooks at 1676243021644 (+3 ms)Closed at 1676243021644 2023-02-12 23:03:41,644 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:41,668 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:41,669 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:41,786 INFO [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46233,1676243018639; all regions closed. 2023-02-12 23:03:41,787 INFO [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34931,1676243018691; all regions closed. 2023-02-12 23:03:41,791 DEBUG [RS:0;jenkins-hbase4:46233] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/oldWALs 2023-02-12 23:03:41,791 DEBUG [RS:1;jenkins-hbase4:34931] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/oldWALs 2023-02-12 23:03:41,791 INFO [RS:0;jenkins-hbase4:46233] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46233%2C1676243018639:(num 1676243019597) 2023-02-12 23:03:41,791 INFO [RS:1;jenkins-hbase4:34931] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34931%2C1676243018691.meta:.meta(num 1676243019206) 2023-02-12 23:03:41,791 DEBUG [RS:0;jenkins-hbase4:46233] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:41,791 INFO [RS:0;jenkins-hbase4:46233] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:41,791 INFO [RS:0;jenkins-hbase4:46233] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 23:03:41,791 INFO [RS:0;jenkins-hbase4:46233] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 23:03:41,791 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:41,791 INFO [RS:0;jenkins-hbase4:46233] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 23:03:41,791 INFO [RS:0;jenkins-hbase4:46233] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 23:03:41,792 INFO [RS:0;jenkins-hbase4:46233] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46233 2023-02-12 23:03:41,794 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/WALs/jenkins-hbase4.apache.org,34931,1676243018691/jenkins-hbase4.apache.org%2C34931%2C1676243018691.1676243019999 not finished, retry = 0 2023-02-12 23:03:41,794 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:41,794 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46233,1676243018639 2023-02-12 23:03:41,795 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:41,795 ERROR [Listener at localhost/44537-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2771a438 rejected from java.util.concurrent.ThreadPoolExecutor@234e340e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:41,795 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:41,795 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:41,795 ERROR [Listener at localhost/44537-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7d9a501b rejected from java.util.concurrent.ThreadPoolExecutor@234e340e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:41,797 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46233,1676243018639] 2023-02-12 23:03:41,797 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46233,1676243018639; numProcessing=1 2023-02-12 23:03:41,798 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46233,1676243018639 already deleted, retry=false 2023-02-12 23:03:41,798 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46233,1676243018639 expired; onlineServers=1 2023-02-12 23:03:41,896 DEBUG [RS:1;jenkins-hbase4:34931] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/oldWALs 2023-02-12 23:03:41,896 INFO [RS:1;jenkins-hbase4:34931] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34931%2C1676243018691:(num 1676243019999) 2023-02-12 23:03:41,896 DEBUG [RS:1;jenkins-hbase4:34931] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:41,896 INFO [RS:1;jenkins-hbase4:34931] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:41,897 INFO [RS:1;jenkins-hbase4:34931] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 23:03:41,897 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:41,898 INFO [RS:1;jenkins-hbase4:34931] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34931 2023-02-12 23:03:41,899 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34931,1676243018691 2023-02-12 23:03:41,899 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:41,899 ERROR [Listener at localhost/44537-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3535771e rejected from java.util.concurrent.ThreadPoolExecutor@310ae560[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:41,900 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34931,1676243018691] 2023-02-12 23:03:41,900 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34931,1676243018691; numProcessing=2 2023-02-12 23:03:41,903 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34931,1676243018691 already deleted, retry=false 2023-02-12 23:03:41,903 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34931,1676243018691 expired; onlineServers=0 2023-02-12 23:03:41,903 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34483,1676243018582' ***** 2023-02-12 23:03:41,903 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 23:03:41,904 DEBUG [M:0;jenkins-hbase4:34483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56af7e84, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:41,904 INFO [M:0;jenkins-hbase4:34483] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34483,1676243018582 2023-02-12 23:03:41,904 INFO [M:0;jenkins-hbase4:34483] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34483,1676243018582; all regions closed. 2023-02-12 23:03:41,904 DEBUG [M:0;jenkins-hbase4:34483] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:41,904 DEBUG [M:0;jenkins-hbase4:34483] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 23:03:41,904 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 23:03:41,904 DEBUG [M:0;jenkins-hbase4:34483] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 23:03:41,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676243018855] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676243018855,5,FailOnTimeoutGroup] 2023-02-12 23:03:41,904 INFO [M:0;jenkins-hbase4:34483] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 23:03:41,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676243018855] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676243018855,5,FailOnTimeoutGroup] 2023-02-12 23:03:41,905 INFO [M:0;jenkins-hbase4:34483] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 23:03:41,905 INFO [M:0;jenkins-hbase4:34483] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 23:03:41,905 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:41,905 DEBUG [M:0;jenkins-hbase4:34483] master.HMaster(1502): Stopping service threads 2023-02-12 23:03:41,906 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:41,906 INFO [M:0;jenkins-hbase4:34483] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 23:03:41,906 ERROR [M:0;jenkins-hbase4:34483] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 23:03:41,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:41,906 INFO [M:0;jenkins-hbase4:34483] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 23:03:41,906 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 23:03:41,907 DEBUG [M:0;jenkins-hbase4:34483] zookeeper.ZKUtil(398): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 23:03:41,907 WARN [M:0;jenkins-hbase4:34483] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 23:03:41,907 INFO [M:0;jenkins-hbase4:34483] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 23:03:41,907 INFO [M:0;jenkins-hbase4:34483] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 23:03:41,907 DEBUG [M:0;jenkins-hbase4:34483] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 23:03:41,907 INFO [M:0;jenkins-hbase4:34483] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:41,908 DEBUG [M:0;jenkins-hbase4:34483] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:41,908 DEBUG [M:0;jenkins-hbase4:34483] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 23:03:41,908 DEBUG [M:0;jenkins-hbase4:34483] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:41,908 INFO [M:0;jenkins-hbase4:34483] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.09 KB heapSize=67.06 KB 2023-02-12 23:03:41,920 INFO [M:0;jenkins-hbase4:34483] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.09 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2fb647319cfe4764ac6b7a5a5f02ef8a 2023-02-12 23:03:41,924 DEBUG [M:0;jenkins-hbase4:34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2fb647319cfe4764ac6b7a5a5f02ef8a as hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2fb647319cfe4764ac6b7a5a5f02ef8a 2023-02-12 23:03:41,927 INFO [M:0;jenkins-hbase4:34483] regionserver.HStore(1080): Added hdfs://localhost:46471/user/jenkins/test-data/98e8225f-6802-10b7-4d02-3f263284f740/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2fb647319cfe4764ac6b7a5a5f02ef8a, entries=17, sequenceid=132, filesize=8.7 K 2023-02-12 23:03:41,928 INFO [M:0;jenkins-hbase4:34483] regionserver.HRegion(2947): Finished flush of dataSize ~56.09 KB/57440, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=132, compaction requested=false 2023-02-12 23:03:41,928 INFO [M:0;jenkins-hbase4:34483] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:41,928 DEBUG [M:0;jenkins-hbase4:34483] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676243021907Disabling compacts and flushes for region at 1676243021907Disabling writes for close at 1676243021908 (+1 ms)Obtaining lock to block concurrent updates at 1676243021908Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676243021908Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57440, getHeapSize=68656, getOffHeapSize=0, getCellsCount=145 at 1676243021908Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676243021909 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676243021909Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676243021911 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676243021911Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676243021924 (+13 ms)Finished flush of dataSize ~56.09 KB/57440, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=132, compaction requested=false at 1676243021928 (+4 ms)Writing region close event to WAL at 1676243021928Closed at 1676243021928 2023-02-12 23:03:41,930 INFO [M:0;jenkins-hbase4:34483] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 23:03:41,930 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:41,931 INFO [M:0;jenkins-hbase4:34483] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34483 2023-02-12 23:03:41,933 DEBUG [M:0;jenkins-hbase4:34483] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34483,1676243018582 already deleted, retry=false 2023-02-12 23:03:42,081 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:42,081 INFO [M:0;jenkins-hbase4:34483] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34483,1676243018582; zookeeper connection closed. 2023-02-12 23:03:42,081 ERROR [Listener at localhost/44537-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6fdaf80e rejected from java.util.concurrent.ThreadPoolExecutor@6be5712d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:42,083 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): master:34483-0x1004ac68d040000, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:42,083 ERROR [Listener at localhost/44537-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2721ca46 rejected from java.util.concurrent.ThreadPoolExecutor@6be5712d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:42,181 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:42,181 INFO [RS:1;jenkins-hbase4:34931] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34931,1676243018691; zookeeper connection closed. 2023-02-12 23:03:42,181 ERROR [Listener at localhost/44537-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b25efba rejected from java.util.concurrent.ThreadPoolExecutor@310ae560[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:42,181 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1004ac68d040002, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:42,181 ERROR [Listener at localhost/44537-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@23712274 rejected from java.util.concurrent.ThreadPoolExecutor@310ae560[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:42,181 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1b2e70c6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1b2e70c6 2023-02-12 23:03:42,281 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:42,281 INFO [RS:0;jenkins-hbase4:46233] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46233,1676243018639; zookeeper connection closed. 2023-02-12 23:03:42,281 ERROR [Listener at localhost/44537-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5dccb42 rejected from java.util.concurrent.ThreadPoolExecutor@234e340e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:42,281 DEBUG [Listener at localhost/44537-EventThread] zookeeper.ZKWatcher(600): regionserver:46233-0x1004ac68d040001, quorum=127.0.0.1:58963, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:42,282 ERROR [Listener at localhost/44537-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@29d6c313 rejected from java.util.concurrent.ThreadPoolExecutor@234e340e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:42,282 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@bf50362] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@bf50362 2023-02-12 23:03:42,282 INFO [Listener at localhost/44537] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 23:03:42,283 WARN [Listener at localhost/44537] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 23:03:42,287 INFO [Listener at localhost/44537] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:42,391 WARN [BP-811713247-172.31.14.131-1676243017867 heartbeating to localhost/127.0.0.1:46471] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 23:03:42,391 WARN [BP-811713247-172.31.14.131-1676243017867 heartbeating to localhost/127.0.0.1:46471] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-811713247-172.31.14.131-1676243017867 (Datanode Uuid 7fa91944-bf93-4200-8d69-ad493b0bbb61) service to localhost/127.0.0.1:46471 2023-02-12 23:03:42,391 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/cluster_ad28aed6-1a59-c8c3-bfd6-8335d537d772/dfs/data/data3/current/BP-811713247-172.31.14.131-1676243017867] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:42,391 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/cluster_ad28aed6-1a59-c8c3-bfd6-8335d537d772/dfs/data/data4/current/BP-811713247-172.31.14.131-1676243017867] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:42,394 WARN [Listener at localhost/44537] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 23:03:42,397 INFO [Listener at localhost/44537] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:42,501 WARN [BP-811713247-172.31.14.131-1676243017867 heartbeating to localhost/127.0.0.1:46471] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 23:03:42,501 WARN [BP-811713247-172.31.14.131-1676243017867 heartbeating to localhost/127.0.0.1:46471] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-811713247-172.31.14.131-1676243017867 (Datanode Uuid 8c2bc7f2-a137-47d4-98b0-e3d1a9b9889c) service to localhost/127.0.0.1:46471 2023-02-12 23:03:42,502 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/cluster_ad28aed6-1a59-c8c3-bfd6-8335d537d772/dfs/data/data1/current/BP-811713247-172.31.14.131-1676243017867] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:42,503 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/cluster_ad28aed6-1a59-c8c3-bfd6-8335d537d772/dfs/data/data2/current/BP-811713247-172.31.14.131-1676243017867] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:42,515 INFO [Listener at localhost/44537] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:42,632 INFO [Listener at localhost/44537] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 23:03:42,654 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 23:03:42,667 INFO [Listener at localhost/44537] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=253 (was 229) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44537 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:46471 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:46471 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:46471 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46471 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44537.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,34483,1676243018582)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:46471 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:46471 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:46471 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=658 (was 640) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=238 (was 224) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3930 (was 3961) 2023-02-12 23:03:42,678 INFO [Listener at localhost/44537] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=253, OpenFileDescriptor=658, MaxFileDescriptor=60000, SystemLoadAverage=238, ProcessCount=166, AvailableMemoryMB=3930 2023-02-12 23:03:42,688 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/hadoop.log.dir so I do NOT create it in target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1 2023-02-12 23:03:42,688 WARN [Listener at localhost/44537] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 23:03:42,688 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/hadoop.tmp.dir so I do NOT create it in target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1 2023-02-12 23:03:42,688 WARN [Listener at localhost/44537] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c3d9bd4-2282-314c-e9f0-a499f36ad18e/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 23:03:42,688 DEBUG [Listener at localhost/44537] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1 2023-02-12 23:03:42,688 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 23:03:42,688 INFO [Listener at localhost/44537] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/cluster_4d6dd8fe-b2d8-ef3b-76ee-5bcdabfb1b8e, deleteOnExit=true 2023-02-12 23:03:42,688 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 23:03:42,688 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/test.cache.data in system properties and HBase conf 2023-02-12 23:03:42,688 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 23:03:42,689 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/hadoop.log.dir in system properties and HBase conf 2023-02-12 23:03:42,689 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 23:03:42,689 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 23:03:42,689 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 23:03:42,689 DEBUG [Listener at localhost/44537] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 23:03:42,689 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 23:03:42,689 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 23:03:42,689 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 23:03:42,689 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 23:03:42,689 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 23:03:42,690 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 23:03:42,690 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 23:03:42,690 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 23:03:42,690 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 23:03:42,690 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/nfs.dump.dir in system properties and HBase conf 2023-02-12 23:03:42,690 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/java.io.tmpdir in system properties and HBase conf 2023-02-12 23:03:42,690 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 23:03:42,690 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 23:03:42,690 INFO [Listener at localhost/44537] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 23:03:42,695 WARN [Listener at localhost/44537] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 23:03:42,695 WARN [Listener at localhost/44537] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 23:03:42,766 WARN [Listener at localhost/44537] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:42,768 INFO [Listener at localhost/44537] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:42,773 INFO [Listener at localhost/44537] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/java.io.tmpdir/Jetty_localhost_40063_hdfs____6eqmqj/webapp 2023-02-12 23:03:42,865 INFO [Listener at localhost/44537] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40063 2023-02-12 23:03:42,869 WARN [Listener at localhost/44537] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 23:03:42,870 WARN [Listener at localhost/44537] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 23:03:42,911 WARN [Listener at localhost/45279] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:42,926 WARN [Listener at localhost/45279] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 23:03:42,932 WARN [Listener at localhost/45279] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:42,933 INFO [Listener at localhost/45279] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:42,937 INFO [Listener at localhost/45279] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/java.io.tmpdir/Jetty_localhost_40903_datanode____9vngmf/webapp 2023-02-12 23:03:43,029 INFO [Listener at localhost/45279] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40903 2023-02-12 23:03:43,039 WARN [Listener at localhost/40121] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:43,055 WARN [Listener at localhost/40121] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 23:03:43,057 WARN [Listener at localhost/40121] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:43,058 INFO [Listener at localhost/40121] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:43,061 INFO [Listener at localhost/40121] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/java.io.tmpdir/Jetty_localhost_34051_datanode____.in37pq/webapp 2023-02-12 23:03:43,150 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2eab78135ad8100e: Processing first storage report for DS-a3bd7c52-c545-4fae-b825-d5d16058a3aa from datanode b66110aa-0b42-42c4-b351-25e7a87abf1b 2023-02-12 23:03:43,150 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2eab78135ad8100e: from storage DS-a3bd7c52-c545-4fae-b825-d5d16058a3aa node DatanodeRegistration(127.0.0.1:41593, datanodeUuid=b66110aa-0b42-42c4-b351-25e7a87abf1b, infoPort=37065, infoSecurePort=0, ipcPort=40121, storageInfo=lv=-57;cid=testClusterID;nsid=720817887;c=1676243022697), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:43,150 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2eab78135ad8100e: Processing first storage report for DS-0df4928a-c343-4579-8f29-d338289d64f6 from datanode b66110aa-0b42-42c4-b351-25e7a87abf1b 2023-02-12 23:03:43,150 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2eab78135ad8100e: from storage DS-0df4928a-c343-4579-8f29-d338289d64f6 node DatanodeRegistration(127.0.0.1:41593, datanodeUuid=b66110aa-0b42-42c4-b351-25e7a87abf1b, infoPort=37065, infoSecurePort=0, ipcPort=40121, storageInfo=lv=-57;cid=testClusterID;nsid=720817887;c=1676243022697), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:43,170 INFO [Listener at localhost/40121] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34051 2023-02-12 23:03:43,178 WARN [Listener at localhost/36827] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:43,263 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x81892f9aa057247d: Processing first storage report for DS-9528e155-07fd-457e-9b53-95856fc48e61 from datanode 9c3676bb-7205-4fd9-881c-f1db28b14068 2023-02-12 23:03:43,264 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x81892f9aa057247d: from storage DS-9528e155-07fd-457e-9b53-95856fc48e61 node DatanodeRegistration(127.0.0.1:35697, datanodeUuid=9c3676bb-7205-4fd9-881c-f1db28b14068, infoPort=33085, infoSecurePort=0, ipcPort=36827, storageInfo=lv=-57;cid=testClusterID;nsid=720817887;c=1676243022697), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-12 23:03:43,264 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x81892f9aa057247d: Processing first storage report for DS-0f4902e8-53ac-46cc-8591-c3b1a9cb92d5 from datanode 9c3676bb-7205-4fd9-881c-f1db28b14068 2023-02-12 23:03:43,264 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x81892f9aa057247d: from storage DS-0f4902e8-53ac-46cc-8591-c3b1a9cb92d5 node DatanodeRegistration(127.0.0.1:35697, datanodeUuid=9c3676bb-7205-4fd9-881c-f1db28b14068, infoPort=33085, infoSecurePort=0, ipcPort=36827, storageInfo=lv=-57;cid=testClusterID;nsid=720817887;c=1676243022697), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:43,286 DEBUG [Listener at localhost/36827] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1 2023-02-12 23:03:43,288 INFO [Listener at localhost/36827] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/cluster_4d6dd8fe-b2d8-ef3b-76ee-5bcdabfb1b8e/zookeeper_0, clientPort=59902, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/cluster_4d6dd8fe-b2d8-ef3b-76ee-5bcdabfb1b8e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/cluster_4d6dd8fe-b2d8-ef3b-76ee-5bcdabfb1b8e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 23:03:43,289 INFO [Listener at localhost/36827] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59902 2023-02-12 23:03:43,289 INFO [Listener at localhost/36827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:43,290 INFO [Listener at localhost/36827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:43,304 INFO [Listener at localhost/36827] util.FSUtils(479): Created version file at hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75 with version=8 2023-02-12 23:03:43,304 INFO [Listener at localhost/36827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:43,305 INFO [Listener at localhost/36827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:43,306 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45279/user/jenkins/test-data/546b1613-ddee-cd34-dae2-83a8057af100/hbase-staging 2023-02-12 23:03:43,308 INFO [Listener at localhost/36827] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:43,308 INFO [Listener at localhost/36827] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:43,308 INFO [Listener at localhost/36827] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:43,308 INFO [Listener at localhost/36827] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:43,308 INFO [Listener at localhost/36827] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:43,308 INFO [Listener at localhost/36827] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:43,308 INFO [Listener at localhost/36827] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:43,310 INFO [Listener at localhost/36827] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44559 2023-02-12 23:03:43,310 INFO [Listener at localhost/36827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:43,311 INFO [Listener at localhost/36827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:43,311 INFO [Listener at localhost/36827] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44559 connecting to ZooKeeper ensemble=127.0.0.1:59902 2023-02-12 23:03:43,319 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:445590x0, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:43,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44559-0x1004ac69f7d0000 connected 2023-02-12 23:03:43,340 DEBUG [Listener at localhost/36827] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:43,340 DEBUG [Listener at localhost/36827] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:43,340 DEBUG [Listener at localhost/36827] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:43,344 DEBUG [Listener at localhost/36827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44559 2023-02-12 23:03:43,344 DEBUG [Listener at localhost/36827] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44559 2023-02-12 23:03:43,344 DEBUG [Listener at localhost/36827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44559 2023-02-12 23:03:43,345 DEBUG [Listener at localhost/36827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44559 2023-02-12 23:03:43,346 DEBUG [Listener at localhost/36827] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44559 2023-02-12 23:03:43,346 INFO [Listener at localhost/36827] master.HMaster(439): hbase.rootdir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75, hbase.cluster.distributed=false 2023-02-12 23:03:43,359 INFO [Listener at localhost/36827] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:43,359 INFO [Listener at localhost/36827] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:43,359 INFO [Listener at localhost/36827] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:43,359 INFO [Listener at localhost/36827] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:43,359 INFO [Listener at localhost/36827] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:43,359 INFO [Listener at localhost/36827] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:43,360 INFO [Listener at localhost/36827] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:43,360 INFO [Listener at localhost/36827] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43147 2023-02-12 23:03:43,361 INFO [Listener at localhost/36827] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 23:03:43,361 DEBUG [Listener at localhost/36827] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:43,361 INFO [Listener at localhost/36827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:43,362 INFO [Listener at localhost/36827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:43,363 INFO [Listener at localhost/36827] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43147 connecting to ZooKeeper ensemble=127.0.0.1:59902 2023-02-12 23:03:43,365 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:431470x0, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:43,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43147-0x1004ac69f7d0001 connected 2023-02-12 23:03:43,366 DEBUG [Listener at localhost/36827] zookeeper.ZKUtil(164): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:43,367 DEBUG [Listener at localhost/36827] zookeeper.ZKUtil(164): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:43,367 DEBUG [Listener at localhost/36827] zookeeper.ZKUtil(164): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:43,368 DEBUG [Listener at localhost/36827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43147 2023-02-12 23:03:43,368 DEBUG [Listener at localhost/36827] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43147 2023-02-12 23:03:43,370 DEBUG [Listener at localhost/36827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43147 2023-02-12 23:03:43,370 DEBUG [Listener at localhost/36827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43147 2023-02-12 23:03:43,371 DEBUG [Listener at localhost/36827] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43147 2023-02-12 23:03:43,381 INFO [Listener at localhost/36827] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:43,381 INFO [Listener at localhost/36827] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:43,381 INFO [Listener at localhost/36827] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:43,381 INFO [Listener at localhost/36827] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:43,381 INFO [Listener at localhost/36827] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:43,381 INFO [Listener at localhost/36827] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:43,381 INFO [Listener at localhost/36827] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:43,382 INFO [Listener at localhost/36827] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34761 2023-02-12 23:03:43,382 INFO [Listener at localhost/36827] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 23:03:43,384 DEBUG [Listener at localhost/36827] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:43,384 INFO [Listener at localhost/36827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:43,385 INFO [Listener at localhost/36827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:43,386 INFO [Listener at localhost/36827] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34761 connecting to ZooKeeper ensemble=127.0.0.1:59902 2023-02-12 23:03:43,388 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:347610x0, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:43,388 DEBUG [Listener at localhost/36827] zookeeper.ZKUtil(164): regionserver:347610x0, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:43,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34761-0x1004ac69f7d0002 connected 2023-02-12 23:03:43,390 DEBUG [Listener at localhost/36827] zookeeper.ZKUtil(164): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:43,390 DEBUG [Listener at localhost/36827] zookeeper.ZKUtil(164): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:43,390 DEBUG [Listener at localhost/36827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34761 2023-02-12 23:03:43,392 DEBUG [Listener at localhost/36827] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34761 2023-02-12 23:03:43,394 DEBUG [Listener at localhost/36827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34761 2023-02-12 23:03:43,396 DEBUG [Listener at localhost/36827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34761 2023-02-12 23:03:43,396 DEBUG [Listener at localhost/36827] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34761 2023-02-12 23:03:43,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44559,1676243023307 2023-02-12 23:03:43,400 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 23:03:43,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44559,1676243023307 2023-02-12 23:03:43,401 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:43,401 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:43,401 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:43,402 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:43,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 23:03:43,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44559,1676243023307 from backup master directory 2023-02-12 23:03:43,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 23:03:43,406 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44559,1676243023307 2023-02-12 23:03:43,406 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 23:03:43,406 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:43,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,44559,1676243023307 2023-02-12 23:03:43,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/hbase.id with ID: c970a154-e2a8-484f-a7c2-623c7d761eb2 2023-02-12 23:03:43,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:43,436 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:43,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x126927f5 to 127.0.0.1:59902 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:43,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ef9a305, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:43,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:43,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 23:03:43,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:43,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/MasterData/data/master/store-tmp 2023-02-12 23:03:43,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:43,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 23:03:43,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:43,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:43,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 23:03:43,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:43,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:43,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676243023459Disabling compacts and flushes for region at 1676243023459Disabling writes for close at 1676243023459Writing region close event to WAL at 1676243023459Closed at 1676243023459 2023-02-12 23:03:43,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/MasterData/WALs/jenkins-hbase4.apache.org,44559,1676243023307 2023-02-12 23:03:43,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44559%2C1676243023307, suffix=, logDir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/MasterData/WALs/jenkins-hbase4.apache.org,44559,1676243023307, archiveDir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/MasterData/oldWALs, maxLogs=10 2023-02-12 23:03:43,473 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41593,DS-a3bd7c52-c545-4fae-b825-d5d16058a3aa,DISK] 2023-02-12 23:03:43,473 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35697,DS-9528e155-07fd-457e-9b53-95856fc48e61,DISK] 2023-02-12 23:03:43,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/MasterData/WALs/jenkins-hbase4.apache.org,44559,1676243023307/jenkins-hbase4.apache.org%2C44559%2C1676243023307.1676243023461 2023-02-12 23:03:43,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41593,DS-a3bd7c52-c545-4fae-b825-d5d16058a3aa,DISK], DatanodeInfoWithStorage[127.0.0.1:35697,DS-9528e155-07fd-457e-9b53-95856fc48e61,DISK]] 2023-02-12 23:03:43,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:43,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:43,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:43,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:43,476 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:43,477 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 23:03:43,477 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 23:03:43,478 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:43,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:43,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:43,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:43,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:43,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69804610, jitterRate=0.040169745683670044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 23:03:43,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676243023475Initializing all the Stores at 1676243023476 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243023476Cleaning up temporary data from old regions at 1676243023479 (+3 ms)Cleaning up detritus from prior splits at 1676243023479Region opened successfully at 1676243023485 (+6 ms) 2023-02-12 23:03:43,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 23:03:43,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 23:03:43,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 23:03:43,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 23:03:43,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 23:03:43,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 23:03:43,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 23:03:43,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 23:03:43,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 23:03:43,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 23:03:43,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 23:03:43,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 23:03:43,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 23:03:43,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 23:03:43,500 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:43,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 23:03:43,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 23:03:43,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 23:03:43,503 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:43,503 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:43,503 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:43,503 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:43,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,44559,1676243023307, sessionid=0x1004ac69f7d0000, setting cluster-up flag (Was=false) 2023-02-12 23:03:43,510 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:43,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 23:03:43,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44559,1676243023307 2023-02-12 23:03:43,517 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:43,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 23:03:43,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44559,1676243023307 2023-02-12 23:03:43,523 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.hbase-snapshot/.tmp 2023-02-12 23:03:43,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:43,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:43,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:43,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:43,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:43,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 23:03:43,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:43,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676243053529 2023-02-12 23:03:43,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 23:03:43,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 23:03:43,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 23:03:43,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 23:03:43,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 23:03:43,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 23:03:43,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,530 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:43,530 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 23:03:43,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 23:03:43,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 23:03:43,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 23:03:43,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 23:03:43,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 23:03:43,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676243023531,5,FailOnTimeoutGroup] 2023-02-12 23:03:43,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676243023531,5,FailOnTimeoutGroup] 2023-02-12 23:03:43,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 23:03:43,531 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:43,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,542 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:43,543 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:43,543 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75 2023-02-12 23:03:43,549 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:43,552 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 23:03:43,553 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/info 2023-02-12 23:03:43,553 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 23:03:43,553 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:43,554 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 23:03:43,554 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:43,555 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 23:03:43,555 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:43,555 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 23:03:43,556 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/table 2023-02-12 23:03:43,556 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 23:03:43,556 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:43,557 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740 2023-02-12 23:03:43,557 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740 2023-02-12 23:03:43,559 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 23:03:43,560 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 23:03:43,562 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:43,563 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64059993, jitterRate=-0.0454317182302475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 23:03:43,563 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676243023549Initializing all the Stores at 1676243023550 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243023550Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243023552 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243023552Cleaning up temporary data from old regions at 1676243023558 (+6 ms)Cleaning up detritus from prior splits at 1676243023558Region opened successfully at 1676243023563 (+5 ms) 2023-02-12 23:03:43,563 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 23:03:43,563 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 23:03:43,563 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 23:03:43,563 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 23:03:43,563 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 23:03:43,563 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:43,563 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676243023563Disabling compacts and flushes for region at 1676243023563Disabling writes for close at 1676243023563Writing region close event to WAL at 1676243023563Closed at 1676243023563 2023-02-12 23:03:43,564 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:43,564 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 23:03:43,564 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 23:03:43,565 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 23:03:43,567 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 23:03:43,598 INFO [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer(952): ClusterId : c970a154-e2a8-484f-a7c2-623c7d761eb2 2023-02-12 23:03:43,598 INFO [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(952): ClusterId : c970a154-e2a8-484f-a7c2-623c7d761eb2 2023-02-12 23:03:43,598 DEBUG [RS:0;jenkins-hbase4:43147] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 23:03:43,598 DEBUG [RS:1;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 23:03:43,600 DEBUG [RS:0;jenkins-hbase4:43147] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 23:03:43,600 DEBUG [RS:0;jenkins-hbase4:43147] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 23:03:43,600 DEBUG [RS:1;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 23:03:43,600 DEBUG [RS:1;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 23:03:43,602 DEBUG [RS:0;jenkins-hbase4:43147] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 23:03:43,603 DEBUG [RS:0;jenkins-hbase4:43147] zookeeper.ReadOnlyZKClient(139): Connect 0x1b9bf488 to 127.0.0.1:59902 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:43,603 DEBUG [RS:1;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 23:03:43,603 DEBUG [RS:1;jenkins-hbase4:34761] zookeeper.ReadOnlyZKClient(139): Connect 0x5ac929e7 to 127.0.0.1:59902 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:43,608 DEBUG [RS:0;jenkins-hbase4:43147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@155c198b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:43,608 DEBUG [RS:1;jenkins-hbase4:34761] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@540eccce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:43,608 DEBUG [RS:0;jenkins-hbase4:43147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11639ff8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:43,608 DEBUG [RS:1;jenkins-hbase4:34761] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50314297, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:43,618 DEBUG [RS:1;jenkins-hbase4:34761] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34761 2023-02-12 23:03:43,618 INFO [RS:1;jenkins-hbase4:34761] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 23:03:43,618 INFO [RS:1;jenkins-hbase4:34761] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 23:03:43,618 DEBUG [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 23:03:43,618 INFO [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44559,1676243023307 with isa=jenkins-hbase4.apache.org/172.31.14.131:34761, startcode=1676243023381 2023-02-12 23:03:43,618 DEBUG [RS:1;jenkins-hbase4:34761] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 23:03:43,620 DEBUG [RS:0;jenkins-hbase4:43147] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43147 2023-02-12 23:03:43,620 INFO [RS:0;jenkins-hbase4:43147] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 23:03:43,620 INFO [RS:0;jenkins-hbase4:43147] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 23:03:43,620 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44953, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 23:03:43,620 DEBUG [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 23:03:43,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:43,622 INFO [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44559,1676243023307 with isa=jenkins-hbase4.apache.org/172.31.14.131:43147, startcode=1676243023359 2023-02-12 23:03:43,622 DEBUG [RS:0;jenkins-hbase4:43147] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 23:03:43,622 DEBUG [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75 2023-02-12 23:03:43,622 DEBUG [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45279 2023-02-12 23:03:43,622 DEBUG [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 23:03:43,623 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:43,624 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55455, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 23:03:43,624 DEBUG [RS:1;jenkins-hbase4:34761] zookeeper.ZKUtil(162): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:43,624 WARN [RS:1;jenkins-hbase4:34761] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:43,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:43,624 INFO [RS:1;jenkins-hbase4:34761] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:43,625 DEBUG [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/WALs/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:43,625 DEBUG [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75 2023-02-12 23:03:43,625 DEBUG [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45279 2023-02-12 23:03:43,625 DEBUG [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 23:03:43,626 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34761,1676243023381] 2023-02-12 23:03:43,633 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:43,633 DEBUG [RS:0;jenkins-hbase4:43147] zookeeper.ZKUtil(162): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:43,633 WARN [RS:0;jenkins-hbase4:43147] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:43,633 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43147,1676243023359] 2023-02-12 23:03:43,633 INFO [RS:0;jenkins-hbase4:43147] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:43,633 DEBUG [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/WALs/jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:43,633 DEBUG [RS:1;jenkins-hbase4:34761] zookeeper.ZKUtil(162): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:43,634 DEBUG [RS:1;jenkins-hbase4:34761] zookeeper.ZKUtil(162): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:43,635 DEBUG [RS:1;jenkins-hbase4:34761] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 23:03:43,636 INFO [RS:1;jenkins-hbase4:34761] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 23:03:43,636 DEBUG [RS:0;jenkins-hbase4:43147] zookeeper.ZKUtil(162): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:43,636 DEBUG [RS:0;jenkins-hbase4:43147] zookeeper.ZKUtil(162): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:43,637 INFO [RS:1;jenkins-hbase4:34761] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 23:03:43,637 DEBUG [RS:0;jenkins-hbase4:43147] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 23:03:43,637 INFO [RS:0;jenkins-hbase4:43147] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 23:03:43,640 INFO [RS:1;jenkins-hbase4:34761] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 23:03:43,640 INFO [RS:1;jenkins-hbase4:34761] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,644 INFO [RS:0;jenkins-hbase4:43147] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 23:03:43,644 INFO [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 23:03:43,645 INFO [RS:0;jenkins-hbase4:43147] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 23:03:43,645 INFO [RS:0;jenkins-hbase4:43147] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,645 INFO [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 23:03:43,646 INFO [RS:1;jenkins-hbase4:34761] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,646 DEBUG [RS:1;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,646 DEBUG [RS:1;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,646 INFO [RS:0;jenkins-hbase4:43147] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,646 DEBUG [RS:1;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,646 DEBUG [RS:0;jenkins-hbase4:43147] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,646 DEBUG [RS:1;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,646 DEBUG [RS:0;jenkins-hbase4:43147] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,646 DEBUG [RS:1;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,646 DEBUG [RS:0;jenkins-hbase4:43147] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,646 DEBUG [RS:1;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:43,646 DEBUG [RS:0;jenkins-hbase4:43147] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,646 DEBUG [RS:1;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,646 DEBUG [RS:0;jenkins-hbase4:43147] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,646 DEBUG [RS:1;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,647 DEBUG [RS:0;jenkins-hbase4:43147] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:43,647 DEBUG [RS:1;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,647 DEBUG [RS:0;jenkins-hbase4:43147] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,647 DEBUG [RS:1;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,647 DEBUG [RS:0;jenkins-hbase4:43147] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,647 DEBUG [RS:0;jenkins-hbase4:43147] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,647 DEBUG [RS:0;jenkins-hbase4:43147] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:43,648 INFO [RS:1;jenkins-hbase4:34761] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,648 INFO [RS:1;jenkins-hbase4:34761] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,648 INFO [RS:1;jenkins-hbase4:34761] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,652 INFO [RS:0;jenkins-hbase4:43147] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,652 INFO [RS:0;jenkins-hbase4:43147] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,652 INFO [RS:0;jenkins-hbase4:43147] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,662 INFO [RS:1;jenkins-hbase4:34761] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 23:03:43,662 INFO [RS:1;jenkins-hbase4:34761] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34761,1676243023381-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,667 INFO [RS:0;jenkins-hbase4:43147] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 23:03:43,667 INFO [RS:0;jenkins-hbase4:43147] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43147,1676243023359-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,673 INFO [RS:1;jenkins-hbase4:34761] regionserver.Replication(203): jenkins-hbase4.apache.org,34761,1676243023381 started 2023-02-12 23:03:43,674 INFO [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34761,1676243023381, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34761, sessionid=0x1004ac69f7d0002 2023-02-12 23:03:43,674 DEBUG [RS:1;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 23:03:43,674 DEBUG [RS:1;jenkins-hbase4:34761] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:43,674 DEBUG [RS:1;jenkins-hbase4:34761] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34761,1676243023381' 2023-02-12 23:03:43,674 DEBUG [RS:1;jenkins-hbase4:34761] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:43,674 DEBUG [RS:1;jenkins-hbase4:34761] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:43,675 DEBUG [RS:1;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 23:03:43,675 DEBUG [RS:1;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 23:03:43,675 DEBUG [RS:1;jenkins-hbase4:34761] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:43,675 DEBUG [RS:1;jenkins-hbase4:34761] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34761,1676243023381' 2023-02-12 23:03:43,675 DEBUG [RS:1;jenkins-hbase4:34761] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:43,675 DEBUG [RS:1;jenkins-hbase4:34761] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:43,675 DEBUG [RS:1;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 23:03:43,675 INFO [RS:1;jenkins-hbase4:34761] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 23:03:43,675 INFO [RS:1;jenkins-hbase4:34761] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 23:03:43,678 INFO [RS:0;jenkins-hbase4:43147] regionserver.Replication(203): jenkins-hbase4.apache.org,43147,1676243023359 started 2023-02-12 23:03:43,678 INFO [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43147,1676243023359, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43147, sessionid=0x1004ac69f7d0001 2023-02-12 23:03:43,678 DEBUG [RS:0;jenkins-hbase4:43147] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 23:03:43,678 DEBUG [RS:0;jenkins-hbase4:43147] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:43,678 DEBUG [RS:0;jenkins-hbase4:43147] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43147,1676243023359' 2023-02-12 23:03:43,678 DEBUG [RS:0;jenkins-hbase4:43147] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:43,679 DEBUG [RS:0;jenkins-hbase4:43147] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:43,679 DEBUG [RS:0;jenkins-hbase4:43147] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 23:03:43,679 DEBUG [RS:0;jenkins-hbase4:43147] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 23:03:43,679 DEBUG [RS:0;jenkins-hbase4:43147] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:43,679 DEBUG [RS:0;jenkins-hbase4:43147] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43147,1676243023359' 2023-02-12 23:03:43,679 DEBUG [RS:0;jenkins-hbase4:43147] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:43,679 DEBUG [RS:0;jenkins-hbase4:43147] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:43,679 DEBUG [RS:0;jenkins-hbase4:43147] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 23:03:43,680 INFO [RS:0;jenkins-hbase4:43147] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 23:03:43,680 INFO [RS:0;jenkins-hbase4:43147] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 23:03:43,717 DEBUG [jenkins-hbase4:44559] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 23:03:43,717 DEBUG [jenkins-hbase4:44559] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:43,718 DEBUG [jenkins-hbase4:44559] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:43,718 DEBUG [jenkins-hbase4:44559] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:43,718 DEBUG [jenkins-hbase4:44559] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:43,719 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34761,1676243023381, state=OPENING 2023-02-12 23:03:43,720 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 23:03:43,721 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:43,721 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 23:03:43,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34761,1676243023381}] 2023-02-12 23:03:43,887 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:43,887 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 23:03:43,888 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32816, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 23:03:43,892 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 23:03:43,892 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:43,893 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34761%2C1676243023381.meta, suffix=.meta, logDir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/WALs/jenkins-hbase4.apache.org,34761,1676243023381, archiveDir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/oldWALs, maxLogs=32 2023-02-12 23:03:43,907 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35697,DS-9528e155-07fd-457e-9b53-95856fc48e61,DISK] 2023-02-12 23:03:43,907 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41593,DS-a3bd7c52-c545-4fae-b825-d5d16058a3aa,DISK] 2023-02-12 23:03:43,908 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/WALs/jenkins-hbase4.apache.org,34761,1676243023381/jenkins-hbase4.apache.org%2C34761%2C1676243023381.meta.1676243023894.meta 2023-02-12 23:03:43,908 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41593,DS-a3bd7c52-c545-4fae-b825-d5d16058a3aa,DISK], DatanodeInfoWithStorage[127.0.0.1:35697,DS-9528e155-07fd-457e-9b53-95856fc48e61,DISK]] 2023-02-12 23:03:43,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:43,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 23:03:43,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 23:03:43,909 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 23:03:43,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 23:03:43,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:43,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 23:03:43,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 23:03:43,910 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 23:03:43,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/info 2023-02-12 23:03:43,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/info 2023-02-12 23:03:43,911 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 23:03:43,912 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:43,912 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 23:03:43,913 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:43,913 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:43,913 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 23:03:43,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:43,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 23:03:43,914 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/table 2023-02-12 23:03:43,914 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/table 2023-02-12 23:03:43,914 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 23:03:43,915 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:43,915 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740 2023-02-12 23:03:43,916 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740 2023-02-12 23:03:43,917 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 23:03:43,918 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 23:03:43,919 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73059193, jitterRate=0.08866681158542633}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 23:03:43,919 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676243023909Writing region info on filesystem at 1676243023909Initializing all the Stores at 1676243023910 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243023910Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243023910Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243023910Cleaning up temporary data from old regions at 1676243023916 (+6 ms)Cleaning up detritus from prior splits at 1676243023917 (+1 ms)Running coprocessor post-open hooks at 1676243023919 (+2 ms)Region opened successfully at 1676243023919 2023-02-12 23:03:43,920 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676243023887 2023-02-12 23:03:43,926 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 23:03:43,926 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 23:03:43,926 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34761,1676243023381, state=OPEN 2023-02-12 23:03:43,928 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 23:03:43,928 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 23:03:43,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 23:03:43,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34761,1676243023381 in 207 msec 2023-02-12 23:03:43,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 23:03:43,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 365 msec 2023-02-12 23:03:43,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 408 msec 2023-02-12 23:03:43,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676243023400, completionTime=-1 2023-02-12 23:03:43,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 23:03:43,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 23:03:43,933 DEBUG [hconnection-0x3a23218d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:43,934 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32828, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:43,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 23:03:43,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676243083936 2023-02-12 23:03:43,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676243143936 2023-02-12 23:03:43,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-12 23:03:43,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44559,1676243023307-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44559,1676243023307-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44559,1676243023307-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44559, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:43,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 23:03:43,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:43,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 23:03:43,948 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 23:03:43,949 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 23:03:43,949 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 23:03:43,950 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/hbase/namespace/9c54aa70cc7be9a373403be60dbd52f8 2023-02-12 23:03:43,951 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/hbase/namespace/9c54aa70cc7be9a373403be60dbd52f8 empty. 2023-02-12 23:03:43,951 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/hbase/namespace/9c54aa70cc7be9a373403be60dbd52f8 2023-02-12 23:03:43,951 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 23:03:43,962 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:43,963 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9c54aa70cc7be9a373403be60dbd52f8, NAME => 'hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp 2023-02-12 23:03:43,969 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:43,970 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 9c54aa70cc7be9a373403be60dbd52f8, disabling compactions & flushes 2023-02-12 23:03:43,970 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8. 2023-02-12 23:03:43,970 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8. 2023-02-12 23:03:43,970 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8. after waiting 0 ms 2023-02-12 23:03:43,970 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8. 2023-02-12 23:03:43,970 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8. 2023-02-12 23:03:43,970 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 9c54aa70cc7be9a373403be60dbd52f8: Waiting for close lock at 1676243023969Disabling compacts and flushes for region at 1676243023969Disabling writes for close at 1676243023970 (+1 ms)Writing region close event to WAL at 1676243023970Closed at 1676243023970 2023-02-12 23:03:43,972 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 23:03:43,972 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676243023972"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243023972"}]},"ts":"1676243023972"} 2023-02-12 23:03:43,974 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 23:03:43,974 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 23:03:43,975 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243023974"}]},"ts":"1676243023974"} 2023-02-12 23:03:43,976 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 23:03:43,978 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:43,979 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:43,979 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:43,979 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:43,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9c54aa70cc7be9a373403be60dbd52f8, ASSIGN}] 2023-02-12 23:03:43,982 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9c54aa70cc7be9a373403be60dbd52f8, ASSIGN 2023-02-12 23:03:43,982 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=9c54aa70cc7be9a373403be60dbd52f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43147,1676243023359; forceNewPlan=false, retain=false 2023-02-12 23:03:44,132 INFO [jenkins-hbase4:44559] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 23:03:44,133 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9c54aa70cc7be9a373403be60dbd52f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:44,133 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676243024133"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243024133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243024133"}]},"ts":"1676243024133"} 2023-02-12 23:03:44,135 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 9c54aa70cc7be9a373403be60dbd52f8, server=jenkins-hbase4.apache.org,43147,1676243023359}] 2023-02-12 23:03:44,287 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:44,288 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 23:03:44,290 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60750, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 23:03:44,294 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8. 2023-02-12 23:03:44,295 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43147%2C1676243023359, suffix=, logDir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/WALs/jenkins-hbase4.apache.org,43147,1676243023359, archiveDir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/oldWALs, maxLogs=32 2023-02-12 23:03:44,308 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35697,DS-9528e155-07fd-457e-9b53-95856fc48e61,DISK] 2023-02-12 23:03:44,308 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41593,DS-a3bd7c52-c545-4fae-b825-d5d16058a3aa,DISK] 2023-02-12 23:03:44,313 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/WALs/jenkins-hbase4.apache.org,43147,1676243023359/jenkins-hbase4.apache.org%2C43147%2C1676243023359.1676243024295 2023-02-12 23:03:44,313 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35697,DS-9528e155-07fd-457e-9b53-95856fc48e61,DISK], DatanodeInfoWithStorage[127.0.0.1:41593,DS-a3bd7c52-c545-4fae-b825-d5d16058a3aa,DISK]] 2023-02-12 23:03:44,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9c54aa70cc7be9a373403be60dbd52f8, NAME => 'hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:44,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 9c54aa70cc7be9a373403be60dbd52f8 2023-02-12 23:03:44,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:44,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9c54aa70cc7be9a373403be60dbd52f8 2023-02-12 23:03:44,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9c54aa70cc7be9a373403be60dbd52f8 2023-02-12 23:03:44,316 INFO [StoreOpener-9c54aa70cc7be9a373403be60dbd52f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 9c54aa70cc7be9a373403be60dbd52f8 2023-02-12 23:03:44,317 DEBUG [StoreOpener-9c54aa70cc7be9a373403be60dbd52f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/namespace/9c54aa70cc7be9a373403be60dbd52f8/info 2023-02-12 23:03:44,317 DEBUG [StoreOpener-9c54aa70cc7be9a373403be60dbd52f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/namespace/9c54aa70cc7be9a373403be60dbd52f8/info 2023-02-12 23:03:44,317 INFO [StoreOpener-9c54aa70cc7be9a373403be60dbd52f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c54aa70cc7be9a373403be60dbd52f8 columnFamilyName info 2023-02-12 23:03:44,318 INFO [StoreOpener-9c54aa70cc7be9a373403be60dbd52f8-1] regionserver.HStore(310): Store=9c54aa70cc7be9a373403be60dbd52f8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:44,318 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/namespace/9c54aa70cc7be9a373403be60dbd52f8 2023-02-12 23:03:44,319 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/namespace/9c54aa70cc7be9a373403be60dbd52f8 2023-02-12 23:03:44,320 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9c54aa70cc7be9a373403be60dbd52f8 2023-02-12 23:03:44,322 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/namespace/9c54aa70cc7be9a373403be60dbd52f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:44,322 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9c54aa70cc7be9a373403be60dbd52f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64855912, jitterRate=-0.033571600914001465}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 23:03:44,322 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9c54aa70cc7be9a373403be60dbd52f8: Running coprocessor pre-open hook at 1676243024314Writing region info on filesystem at 1676243024314Initializing all the Stores at 1676243024315 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243024315Cleaning up temporary data from old regions at 1676243024319 (+4 ms)Cleaning up detritus from prior splits at 1676243024319Running coprocessor post-open hooks at 1676243024322 (+3 ms)Region opened successfully at 1676243024322 2023-02-12 23:03:44,323 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8., pid=6, masterSystemTime=1676243024287 2023-02-12 23:03:44,325 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8. 2023-02-12 23:03:44,326 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8. 2023-02-12 23:03:44,326 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9c54aa70cc7be9a373403be60dbd52f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:44,326 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676243024326"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243024326"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243024326"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243024326"}]},"ts":"1676243024326"} 2023-02-12 23:03:44,329 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 23:03:44,329 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 9c54aa70cc7be9a373403be60dbd52f8, server=jenkins-hbase4.apache.org,43147,1676243023359 in 192 msec 2023-02-12 23:03:44,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 23:03:44,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=9c54aa70cc7be9a373403be60dbd52f8, ASSIGN in 350 msec 2023-02-12 23:03:44,331 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 23:03:44,331 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243024331"}]},"ts":"1676243024331"} 2023-02-12 23:03:44,332 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 23:03:44,335 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 23:03:44,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 388 msec 2023-02-12 23:03:44,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 23:03:44,349 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:44,349 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:44,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:44,353 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60754, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:44,354 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 23:03:44,360 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:44,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-12 23:03:44,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 23:03:44,372 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:44,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-12 23:03:44,379 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 23:03:44,382 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 23:03:44,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.976sec 2023-02-12 23:03:44,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 23:03:44,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 23:03:44,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 23:03:44,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44559,1676243023307-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 23:03:44,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44559,1676243023307-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 23:03:44,384 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 23:03:44,398 DEBUG [Listener at localhost/36827] zookeeper.ReadOnlyZKClient(139): Connect 0x3e4647f1 to 127.0.0.1:59902 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:44,401 DEBUG [Listener at localhost/36827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79298a5a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:44,404 DEBUG [hconnection-0x258b105b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:44,406 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32838, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:44,407 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44559,1676243023307 2023-02-12 23:03:44,407 DEBUG [Listener at localhost/36827] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 23:03:44,409 DEBUG [Listener at localhost/36827] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 23:03:44,411 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50282, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 23:03:44,411 INFO [Listener at localhost/36827] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:44,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:44,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 23:03:44,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:50282 deadline: 1676243084412, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:44,412 INFO [Listener at localhost/36827] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 23:03:44,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:44,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:44,417 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 23:03:44,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-12 23:03:44,417 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 23:03:44,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:44,419 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de 2023-02-12 23:03:44,419 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de empty. 2023-02-12 23:03:44,420 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de 2023-02-12 23:03:44,420 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-12 23:03:44,431 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:44,432 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1aeee6597470d734a6f59558c60e76de, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp 2023-02-12 23:03:44,442 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:44,442 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 1aeee6597470d734a6f59558c60e76de, disabling compactions & flushes 2023-02-12 23:03:44,442 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:44,442 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:44,442 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. after waiting 0 ms 2023-02-12 23:03:44,442 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:44,442 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:44,442 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 1aeee6597470d734a6f59558c60e76de: Waiting for close lock at 1676243024442Disabling compacts and flushes for region at 1676243024442Disabling writes for close at 1676243024442Writing region close event to WAL at 1676243024442Closed at 1676243024442 2023-02-12 23:03:44,444 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 23:03:44,444 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676243024444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243024444"}]},"ts":"1676243024444"} 2023-02-12 23:03:44,446 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 23:03:44,446 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 23:03:44,446 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243024446"}]},"ts":"1676243024446"} 2023-02-12 23:03:44,447 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-12 23:03:44,451 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:44,451 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:44,452 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:44,452 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:44,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=1aeee6597470d734a6f59558c60e76de, ASSIGN}] 2023-02-12 23:03:44,454 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=1aeee6597470d734a6f59558c60e76de, ASSIGN 2023-02-12 23:03:44,454 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=1aeee6597470d734a6f59558c60e76de, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34761,1676243023381; forceNewPlan=false, retain=false 2023-02-12 23:03:44,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:44,604 INFO [jenkins-hbase4:44559] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 23:03:44,605 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1aeee6597470d734a6f59558c60e76de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:44,605 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676243024605"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243024605"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243024605"}]},"ts":"1676243024605"} 2023-02-12 23:03:44,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 1aeee6597470d734a6f59558c60e76de, server=jenkins-hbase4.apache.org,34761,1676243023381}] 2023-02-12 23:03:44,677 INFO [RS:1;jenkins-hbase4:34761] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34761%2C1676243023381, suffix=, logDir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/WALs/jenkins-hbase4.apache.org,34761,1676243023381, archiveDir=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/oldWALs, maxLogs=32 2023-02-12 23:03:44,691 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41593,DS-a3bd7c52-c545-4fae-b825-d5d16058a3aa,DISK] 2023-02-12 23:03:44,691 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35697,DS-9528e155-07fd-457e-9b53-95856fc48e61,DISK] 2023-02-12 23:03:44,692 INFO [RS:1;jenkins-hbase4:34761] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/WALs/jenkins-hbase4.apache.org,34761,1676243023381/jenkins-hbase4.apache.org%2C34761%2C1676243023381.1676243024677 2023-02-12 23:03:44,693 DEBUG [RS:1;jenkins-hbase4:34761] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41593,DS-a3bd7c52-c545-4fae-b825-d5d16058a3aa,DISK], DatanodeInfoWithStorage[127.0.0.1:35697,DS-9528e155-07fd-457e-9b53-95856fc48e61,DISK]] 2023-02-12 23:03:44,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:44,723 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 23:03:44,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:44,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1aeee6597470d734a6f59558c60e76de, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:44,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 1aeee6597470d734a6f59558c60e76de 2023-02-12 23:03:44,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:44,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1aeee6597470d734a6f59558c60e76de 2023-02-12 23:03:44,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1aeee6597470d734a6f59558c60e76de 2023-02-12 23:03:44,768 INFO [StoreOpener-1aeee6597470d734a6f59558c60e76de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1aeee6597470d734a6f59558c60e76de 2023-02-12 23:03:44,770 DEBUG [StoreOpener-1aeee6597470d734a6f59558c60e76de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f1 2023-02-12 23:03:44,770 DEBUG [StoreOpener-1aeee6597470d734a6f59558c60e76de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f1 2023-02-12 23:03:44,770 INFO [StoreOpener-1aeee6597470d734a6f59558c60e76de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1aeee6597470d734a6f59558c60e76de columnFamilyName f1 2023-02-12 23:03:44,771 INFO [StoreOpener-1aeee6597470d734a6f59558c60e76de-1] regionserver.HStore(310): Store=1aeee6597470d734a6f59558c60e76de/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:44,771 INFO [StoreOpener-1aeee6597470d734a6f59558c60e76de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1aeee6597470d734a6f59558c60e76de 2023-02-12 23:03:44,772 DEBUG [StoreOpener-1aeee6597470d734a6f59558c60e76de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f2 2023-02-12 23:03:44,772 DEBUG [StoreOpener-1aeee6597470d734a6f59558c60e76de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f2 2023-02-12 23:03:44,772 INFO [StoreOpener-1aeee6597470d734a6f59558c60e76de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1aeee6597470d734a6f59558c60e76de columnFamilyName f2 2023-02-12 23:03:44,773 INFO [StoreOpener-1aeee6597470d734a6f59558c60e76de-1] regionserver.HStore(310): Store=1aeee6597470d734a6f59558c60e76de/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:44,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de 2023-02-12 23:03:44,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de 2023-02-12 23:03:44,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:44,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1aeee6597470d734a6f59558c60e76de 2023-02-12 23:03:44,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:44,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1aeee6597470d734a6f59558c60e76de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60873885, jitterRate=-0.09290842711925507}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:44,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1aeee6597470d734a6f59558c60e76de: Running coprocessor pre-open hook at 1676243024763Writing region info on filesystem at 1676243024763Initializing all the Stores at 1676243024764 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243024764Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243024768 (+4 ms)Cleaning up temporary data from old regions at 1676243024775 (+7 ms)Cleaning up detritus from prior splits at 1676243024775Running coprocessor post-open hooks at 1676243024779 (+4 ms)Region opened successfully at 1676243024779 2023-02-12 23:03:44,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de., pid=12, masterSystemTime=1676243024758 2023-02-12 23:03:44,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:44,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:44,782 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1aeee6597470d734a6f59558c60e76de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:44,782 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676243024782"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243024782"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243024782"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243024782"}]},"ts":"1676243024782"} 2023-02-12 23:03:44,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 23:03:44,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 1aeee6597470d734a6f59558c60e76de, server=jenkins-hbase4.apache.org,34761,1676243023381 in 178 msec 2023-02-12 23:03:44,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 23:03:44,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=1aeee6597470d734a6f59558c60e76de, ASSIGN in 334 msec 2023-02-12 23:03:44,787 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 23:03:44,788 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243024788"}]},"ts":"1676243024788"} 2023-02-12 23:03:44,789 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-12 23:03:44,791 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 23:03:44,792 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 376 msec 2023-02-12 23:03:45,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:45,022 INFO [Listener at localhost/36827] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-12 23:03:45,022 DEBUG [Listener at localhost/36827] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-12 23:03:45,022 INFO [Listener at localhost/36827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 23:03:45,024 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-12 23:03:45,024 INFO [Listener at localhost/36827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 23:03:45,024 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-12 23:03:45,024 INFO [Listener at localhost/36827] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 23:03:45,053 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34761] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:45,137 INFO [Listener at localhost/36827] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 23:03:45,137 INFO [Listener at localhost/36827] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 23:03:45,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-12 23:03:45,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676243025138 (current time:1676243025138). 2023-02-12 23:03:45,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 23:03:45,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] zookeeper.ReadOnlyZKClient(139): Connect 0x2e56749d to 127.0.0.1:59902 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:45,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@785407d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:45,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:45,143 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32848, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:45,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e56749d to 127.0.0.1:59902 2023-02-12 23:03:45,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:45,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 23:03:45,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-12 23:03:45,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-12 23:03:45,147 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-12 23:03:45,148 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676243625148 2023-02-12 23:03:45,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-12 23:03:45,148 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,149 DEBUG [Listener at localhost/36827] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 23:03:45,149 DEBUG [Listener at localhost/36827] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 23:03:45,150 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-12 23:03:45,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-12 23:03:45,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 4 msec 2023-02-12 23:03:45,152 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-12 23:03:45,152 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676243625152 2023-02-12 23:03:45,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-12 23:03:45,159 INFO [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-12 23:03:45,159 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:45,160 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-12 23:03:45,160 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-12 23:03:45,160 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 23:03:45,160 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-12 23:03:45,163 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:45,163 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:45,163 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:45,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:45,163 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,163 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 23:03:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 23:03:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 23:03:45,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 23:03:45,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 23:03:45,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-12 23:03:45,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 23:03:45,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-12 23:03:45,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 23:03:45,164 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-12 23:03:45,164 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-12 23:03:45,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 23:03:45,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 23:03:45,164 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 23:03:45,164 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:45,164 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 23:03:45,165 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 23:03:45,165 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 23:03:45,165 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:45,165 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43147,1676243023359' joining acquired barrier for procedure (foo) in zk 2023-02-12 23:03:45,166 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 23:03:45,166 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 23:03:45,166 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34761,1676243023381' joining acquired barrier for procedure (foo) in zk 2023-02-12 23:03:45,167 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 23:03:45,167 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,167 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 23:03:45,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:45,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:45,167 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 23:03:45,167 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:45,167 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 23:03:45,167 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:45,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:45,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:45,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 23:03:45,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:45,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34761,1676243023381' joining acquired barrier for procedure 'foo' on coordinator 2023-02-12 23:03:45,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10e5e5a1[Count = 0] remaining members to acquire global barrier 2023-02-12 23:03:45,169 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-12 23:03:45,169 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-12 23:03:45,170 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 23:03:45,170 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 23:03:45,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 23:03:45,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 23:03:45,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 23:03:45,170 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 23:03:45,170 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,170 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 23:03:45,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 23:03:45,170 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 23:03:45,170 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,43147,1676243023359' in zk 2023-02-12 23:03:45,170 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 23:03:45,170 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 23:03:45,171 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 23:03:45,171 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:45,171 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. started... 2023-02-12 23:03:45,171 INFO [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 1aeee6597470d734a6f59558c60e76de 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 23:03:45,172 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 23:03:45,172 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:45,172 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 23:03:45,184 INFO [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/.tmp/f1/cc6954bfea1e427c9d807ad6f6f9dcc8 2023-02-12 23:03:45,200 INFO [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/.tmp/f2/543c91332ee7493e933be01254491080 2023-02-12 23:03:45,204 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/.tmp/f1/cc6954bfea1e427c9d807ad6f6f9dcc8 as hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f1/cc6954bfea1e427c9d807ad6f6f9dcc8 2023-02-12 23:03:45,207 INFO [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f1/cc6954bfea1e427c9d807ad6f6f9dcc8, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 23:03:45,208 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/.tmp/f2/543c91332ee7493e933be01254491080 as hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f2/543c91332ee7493e933be01254491080 2023-02-12 23:03:45,212 INFO [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f2/543c91332ee7493e933be01254491080, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 23:03:45,212 INFO [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 1aeee6597470d734a6f59558c60e76de in 41ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:45,213 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 23:03:45,213 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1aeee6597470d734a6f59558c60e76de: 2023-02-12 23:03:45,213 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de.' region-info for snapshot=foo 2023-02-12 23:03:45,213 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:45,213 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f1/cc6954bfea1e427c9d807ad6f6f9dcc8] hfiles 2023-02-12 23:03:45,213 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f1/cc6954bfea1e427c9d807ad6f6f9dcc8 for snapshot=foo 2023-02-12 23:03:45,214 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f2/543c91332ee7493e933be01254491080] hfiles 2023-02-12 23:03:45,214 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f2/543c91332ee7493e933be01254491080 for snapshot=foo 2023-02-12 23:03:45,219 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. completed. 2023-02-12 23:03:45,219 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:45,219 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 23:03:45,219 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 23:03:45,219 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,219 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 23:03:45,220 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,34761,1676243023381' in zk 2023-02-12 23:03:45,222 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 23:03:45,222 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,222 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:45,222 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 23:03:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:45,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 23:03:45,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 23:03:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,34761,1676243023381': 2023-02-12 23:03:45,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34761,1676243023381' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-12 23:03:45,225 INFO [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-12 23:03:45,225 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 23:03:45,225 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 23:03:45,225 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-12 23:03:45,225 INFO [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 23:03:45,226 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 23:03:45,226 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 23:03:45,226 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 23:03:45,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 23:03:45,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-12 23:03:45,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:45,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:45,227 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:45,226 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:45,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 23:03:45,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 23:03:45,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 23:03:45,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:45,227 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:45,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:45,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:45,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:45,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 23:03:45,228 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 23:03:45,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 23:03:45,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:45,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 23:03:45,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,229 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:45,229 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 23:03:45,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,234 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,234 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:45,234 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:45,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:45,234 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:45,234 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 23:03:45,234 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-12 23:03:45,234 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:45,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:45,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:45,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:45,234 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:45,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-12 23:03:45,235 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:45,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:45,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:45,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:45,235 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 23:03:45,235 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,235 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 23:03:45,235 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.hbase-snapshot/.tmp/foo 2023-02-12 23:03:45,235 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 23:03:45,235 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 23:03:45,249 DEBUG [Listener at localhost/36827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:45,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-12 23:03:45,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-12 23:03:45,251 DEBUG [Listener at localhost/36827] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 23:03:45,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.hbase-snapshot/.tmp/foo to hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.hbase-snapshot/foo 2023-02-12 23:03:45,279 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-12 23:03:45,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.hbase-snapshot/.tmp/foo 2023-02-12 23:03:45,279 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.hbase-snapshot/.tmp/foo 2023-02-12 23:03:45,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676243025148Consolidate snapshot: foo at 1676243025235 (+87 ms)Loading Region manifests for foo at 1676243025235Writing data manifest for foo at 1676243025238 (+3 ms)Verifying snapshot: foo at 1676243025252 (+14 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676243025279 (+27 ms) 2023-02-12 23:03:45,281 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-12 23:03:45,282 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 132 msec 2023-02-12 23:03:45,452 DEBUG [Listener at localhost/36827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:45,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-12 23:03:45,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 23:03:45,453 INFO [Listener at localhost/36827] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 23:03:45,456 INFO [Listener at localhost/36827] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 23:03:45,461 INFO [Listener at localhost/36827] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 23:03:45,488 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34761] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:45,570 INFO [Listener at localhost/36827] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 23:03:45,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 23:03:45,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,576 INFO [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 23:03:45,576 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:45,577 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-12 23:03:45,577 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-12 23:03:45,578 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,578 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,580 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:45,580 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:45,580 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:45,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:45,581 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,581 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 23:03:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 23:03:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,581 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 23:03:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,581 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,581 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,582 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-12 23:03:45,582 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-12 23:03:45,582 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:45,582 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:45,583 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-12 23:03:45,583 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-12 23:03:45,583 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-12 23:03:45,583 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43147,1676243023359' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-12 23:03:45,583 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 23:03:45,583 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 23:03:45,583 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:45,583 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. started... 2023-02-12 23:03:45,584 INFO [rs(jenkins-hbase4.apache.org,34761,1676243023381)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1aeee6597470d734a6f59558c60e76de 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 23:03:45,585 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,585 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,585 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:45,598 INFO [rs(jenkins-hbase4.apache.org,34761,1676243023381)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/.tmp/f1/6dc7524c42794e08aed89f0c316acdbb 2023-02-12 23:03:45,617 INFO [rs(jenkins-hbase4.apache.org,34761,1676243023381)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/.tmp/f2/4bcd8ca40dfa44298f7172c6f7e179ea 2023-02-12 23:03:45,620 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/.tmp/f1/6dc7524c42794e08aed89f0c316acdbb as hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f1/6dc7524c42794e08aed89f0c316acdbb 2023-02-12 23:03:45,624 INFO [rs(jenkins-hbase4.apache.org,34761,1676243023381)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f1/6dc7524c42794e08aed89f0c316acdbb, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 23:03:45,624 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/.tmp/f2/4bcd8ca40dfa44298f7172c6f7e179ea as hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f2/4bcd8ca40dfa44298f7172c6f7e179ea 2023-02-12 23:03:45,628 INFO [rs(jenkins-hbase4.apache.org,34761,1676243023381)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f2/4bcd8ca40dfa44298f7172c6f7e179ea, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 23:03:45,629 INFO [rs(jenkins-hbase4.apache.org,34761,1676243023381)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 1aeee6597470d734a6f59558c60e76de in 45ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:45,630 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1aeee6597470d734a6f59558c60e76de: 2023-02-12 23:03:45,630 DEBUG [rs(jenkins-hbase4.apache.org,34761,1676243023381)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:45,630 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 23:03:45,630 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 23:03:45,630 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,630 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-12 23:03:45,630 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34761,1676243023381' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-12 23:03:45,632 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,632 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:45,632 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,632 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:45,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34761,1676243023381' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-12 23:03:45,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14da7365[Count = 0] remaining members to acquire global barrier 2023-02-12 23:03:45,634 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-12 23:03:45,634 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,635 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,635 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,635 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-12 23:03:45,635 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-12 23:03:45,635 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-12 23:03:45,635 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-12 23:03:45,635 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,635 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,43147,1676243023359' in zk 2023-02-12 23:03:45,635 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,34761,1676243023381' in zk 2023-02-12 23:03:45,635 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 23:03:45,638 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-12 23:03:45,638 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-12 23:03:45,638 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,638 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:45,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:45,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:45,638 DEBUG [member: 'jenkins-hbase4.apache.org,43147,1676243023359' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-12 23:03:45,638 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:45,638 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676243023381' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-12 23:03:45,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:45,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:45,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:45,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,34761,1676243023381': 2023-02-12 23:03:45,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34761,1676243023381' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-12 23:03:45,641 INFO [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-12 23:03:45,641 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 23:03:45,641 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 23:03:45,641 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,641 INFO [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 23:03:45,642 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,642 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,642 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:45,642 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,642 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:45,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:45,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:45,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:45,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:45,643 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:45,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:45,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:45,643 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:45,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,645 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:45,645 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,647 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:45,647 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:45,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:45,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:45,647 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:45,647 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:45,648 DEBUG [(jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:45,648 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:45,647 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:45,648 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 23:03:45,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 23:03:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:45,648 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,648 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,648 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,648 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:45,648 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,648 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,648 DEBUG [Listener at localhost/36827] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-12 23:03:45,648 DEBUG [Listener at localhost/36827] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 23:03:45,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:45,748 DEBUG [Listener at localhost/36827] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 23:03:45,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 23:03:45,753 INFO [Listener at localhost/36827] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676243025138 type: FLUSH version: 2 ttl: 0 2023-02-12 23:03:45,754 DEBUG [Listener at localhost/36827] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45279/user/jenkins/test-data/546b1613-ddee-cd34-dae2-83a8057af100/foo/21117dc9-43e4-489f-88f4-4be6590beee0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,754 INFO [Listener at localhost/36827] snapshot.RestoreSnapshotHelper(239): region to add: 1aeee6597470d734a6f59558c60e76de 2023-02-12 23:03:45,754 INFO [Listener at localhost/36827] snapshot.RestoreSnapshotHelper(585): clone region=1aeee6597470d734a6f59558c60e76de as 1aeee6597470d734a6f59558c60e76de in snapshot foo 2023-02-12 23:03:45,755 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1aeee6597470d734a6f59558c60e76de, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45279/user/jenkins/test-data/546b1613-ddee-cd34-dae2-83a8057af100/foo/21117dc9-43e4-489f-88f4-4be6590beee0 2023-02-12 23:03:45,760 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:45,760 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cc6954bfea1e427c9d807ad6f6f9dcc8 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,762 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 543c91332ee7493e933be01254491080 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,764 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 1aeee6597470d734a6f59558c60e76de, disabling compactions & flushes 2023-02-12 23:03:45,764 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:45,764 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:45,764 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. after waiting 0 ms 2023-02-12 23:03:45,764 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:45,764 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:45,764 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 1aeee6597470d734a6f59558c60e76de: Waiting for close lock at 1676243025764Disabling compacts and flushes for region at 1676243025764Disabling writes for close at 1676243025764Writing region close event to WAL at 1676243025764Closed at 1676243025764 2023-02-12 23:03:45,765 INFO [Listener at localhost/36827] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676243025138 type: FLUSH version: 2 ttl: 0 2023-02-12 23:03:45,765 DEBUG [Listener at localhost/36827] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45279/user/jenkins/test-data/546b1613-ddee-cd34-dae2-83a8057af100/foo/21117dc9-43e4-489f-88f4-4be6590beee0 2023-02-12 23:03:45,766 DEBUG [Listener at localhost/36827] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45279/user/jenkins/test-data/546b1613-ddee-cd34-dae2-83a8057af100/foo/21117dc9-43e4-489f-88f4-4be6590beee0 2023-02-12 23:03:45,766 DEBUG [Listener at localhost/36827] util.CommonFSUtils(699): |-data/ 2023-02-12 23:03:45,766 DEBUG [Listener at localhost/36827] util.CommonFSUtils(699): |----default/ 2023-02-12 23:03:45,766 DEBUG [Listener at localhost/36827] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-12 23:03:45,767 DEBUG [Listener at localhost/36827] util.CommonFSUtils(699): |----------1aeee6597470d734a6f59558c60e76de/ 2023-02-12 23:03:45,767 DEBUG [Listener at localhost/36827] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:45,767 DEBUG [Listener at localhost/36827] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:45,767 DEBUG [Listener at localhost/36827] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=1aeee6597470d734a6f59558c60e76de-cc6954bfea1e427c9d807ad6f6f9dcc8 2023-02-12 23:03:45,767 DEBUG [Listener at localhost/36827] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:45,767 DEBUG [Listener at localhost/36827] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=1aeee6597470d734a6f59558c60e76de-543c91332ee7493e933be01254491080 hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f1/6dc7524c42794e08aed89f0c316acdbb hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f1/cc6954bfea1e427c9d807ad6f6f9dcc8 hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f2/4bcd8ca40dfa44298f7172c6f7e179ea hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f2/543c91332ee7493e933be01254491080 2023-02-12 23:03:45,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-12 23:03:45,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-12 23:03:45,775 INFO [Listener at localhost/36827] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:45,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 23:03:45,779 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243025779"}]},"ts":"1676243025779"} 2023-02-12 23:03:45,780 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-12 23:03:45,781 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-12 23:03:45,782 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=1aeee6597470d734a6f59558c60e76de, UNASSIGN}] 2023-02-12 23:03:45,786 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=1aeee6597470d734a6f59558c60e76de, UNASSIGN 2023-02-12 23:03:45,786 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1aeee6597470d734a6f59558c60e76de, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:45,787 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676243025786"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243025786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243025786"}]},"ts":"1676243025786"} 2023-02-12 23:03:45,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 1aeee6597470d734a6f59558c60e76de, server=jenkins-hbase4.apache.org,34761,1676243023381}] 2023-02-12 23:03:45,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 23:03:45,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1aeee6597470d734a6f59558c60e76de 2023-02-12 23:03:45,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1aeee6597470d734a6f59558c60e76de, disabling compactions & flushes 2023-02-12 23:03:45,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:45,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:45,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. after waiting 0 ms 2023-02-12 23:03:45,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:45,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:45,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de. 2023-02-12 23:03:45,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1aeee6597470d734a6f59558c60e76de: Waiting for close lock at 1676243025940Running coprocessor pre-close hooks at 1676243025940Disabling compacts and flushes for region at 1676243025940Disabling writes for close at 1676243025940Writing region close event to WAL at 1676243025941 (+1 ms)Running coprocessor post-close hooks at 1676243025944 (+3 ms)Closed at 1676243025945 (+1 ms) 2023-02-12 23:03:45,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1aeee6597470d734a6f59558c60e76de 2023-02-12 23:03:45,947 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1aeee6597470d734a6f59558c60e76de, regionState=CLOSED 2023-02-12 23:03:45,947 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676243025947"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243025947"}]},"ts":"1676243025947"} 2023-02-12 23:03:45,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 23:03:45,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 1aeee6597470d734a6f59558c60e76de, server=jenkins-hbase4.apache.org,34761,1676243023381 in 160 msec 2023-02-12 23:03:45,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 23:03:45,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=1aeee6597470d734a6f59558c60e76de, UNASSIGN in 167 msec 2023-02-12 23:03:45,951 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243025951"}]},"ts":"1676243025951"} 2023-02-12 23:03:45,952 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-12 23:03:45,954 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-12 23:03:45,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 180 msec 2023-02-12 23:03:46,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 23:03:46,082 INFO [Listener at localhost/36827] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-12 23:03:46,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:46,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:46,085 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:46,085 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:46,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 23:03:46,088 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de 2023-02-12 23:03:46,090 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f1, FileablePath, hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f2, FileablePath, hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/recovered.edits] 2023-02-12 23:03:46,093 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f1/6dc7524c42794e08aed89f0c316acdbb to hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f1/6dc7524c42794e08aed89f0c316acdbb 2023-02-12 23:03:46,094 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f1/cc6954bfea1e427c9d807ad6f6f9dcc8 to hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f1/cc6954bfea1e427c9d807ad6f6f9dcc8 2023-02-12 23:03:46,096 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f2/4bcd8ca40dfa44298f7172c6f7e179ea to hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f2/4bcd8ca40dfa44298f7172c6f7e179ea 2023-02-12 23:03:46,097 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f2/543c91332ee7493e933be01254491080 to hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/f2/543c91332ee7493e933be01254491080 2023-02-12 23:03:46,099 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/recovered.edits/12.seqid to hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de/recovered.edits/12.seqid 2023-02-12 23:03:46,099 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1aeee6597470d734a6f59558c60e76de 2023-02-12 23:03:46,100 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-12 23:03:46,101 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:46,102 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-12 23:03:46,104 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-12 23:03:46,107 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:46,107 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-12 23:03:46,107 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676243026107"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:46,108 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 23:03:46,109 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1aeee6597470d734a6f59558c60e76de, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676243024415.1aeee6597470d734a6f59558c60e76de.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 23:03:46,109 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-12 23:03:46,109 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676243026109"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:46,110 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-12 23:03:46,112 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 23:03:46,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 30 msec 2023-02-12 23:03:46,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44559] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 23:03:46,188 INFO [Listener at localhost/36827] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-12 23:03:46,188 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 23:03:46,188 INFO [Listener at localhost/36827] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 23:03:46,188 DEBUG [Listener at localhost/36827] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e4647f1 to 127.0.0.1:59902 2023-02-12 23:03:46,189 DEBUG [Listener at localhost/36827] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:46,189 DEBUG [Listener at localhost/36827] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 23:03:46,189 DEBUG [Listener at localhost/36827] util.JVMClusterUtil(257): Found active master hash=1963078119, stopped=false 2023-02-12 23:03:46,189 INFO [Listener at localhost/36827] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44559,1676243023307 2023-02-12 23:03:46,191 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:46,191 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:46,191 INFO [Listener at localhost/36827] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 23:03:46,191 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:46,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:46,191 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:46,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:46,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:46,193 DEBUG [Listener at localhost/36827] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x126927f5 to 127.0.0.1:59902 2023-02-12 23:03:46,194 DEBUG [Listener at localhost/36827] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:46,194 INFO [Listener at localhost/36827] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43147,1676243023359' ***** 2023-02-12 23:03:46,194 INFO [Listener at localhost/36827] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 23:03:46,194 INFO [Listener at localhost/36827] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34761,1676243023381' ***** 2023-02-12 23:03:46,194 INFO [Listener at localhost/36827] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 23:03:46,194 INFO [RS:0;jenkins-hbase4:43147] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 23:03:46,194 INFO [RS:0;jenkins-hbase4:43147] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 23:03:46,194 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 23:03:46,194 INFO [RS:0;jenkins-hbase4:43147] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 23:03:46,194 INFO [RS:1;jenkins-hbase4:34761] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 23:03:46,194 INFO [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer(3304): Received CLOSE for 9c54aa70cc7be9a373403be60dbd52f8 2023-02-12 23:03:46,194 INFO [RS:1;jenkins-hbase4:34761] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 23:03:46,194 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 23:03:46,195 INFO [RS:1;jenkins-hbase4:34761] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 23:03:46,195 INFO [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:46,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9c54aa70cc7be9a373403be60dbd52f8, disabling compactions & flushes 2023-02-12 23:03:46,196 INFO [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:46,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8. 2023-02-12 23:03:46,196 DEBUG [RS:0;jenkins-hbase4:43147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b9bf488 to 127.0.0.1:59902 2023-02-12 23:03:46,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8. 2023-02-12 23:03:46,196 DEBUG [RS:1;jenkins-hbase4:34761] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ac929e7 to 127.0.0.1:59902 2023-02-12 23:03:46,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8. after waiting 0 ms 2023-02-12 23:03:46,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8. 2023-02-12 23:03:46,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 9c54aa70cc7be9a373403be60dbd52f8 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 23:03:46,196 DEBUG [RS:0;jenkins-hbase4:43147] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:46,196 DEBUG [RS:1;jenkins-hbase4:34761] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:46,196 INFO [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 23:03:46,196 DEBUG [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer(1479): Online Regions={9c54aa70cc7be9a373403be60dbd52f8=hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8.} 2023-02-12 23:03:46,196 INFO [RS:1;jenkins-hbase4:34761] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 23:03:46,196 DEBUG [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer(1505): Waiting on 9c54aa70cc7be9a373403be60dbd52f8 2023-02-12 23:03:46,197 INFO [RS:1;jenkins-hbase4:34761] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 23:03:46,197 INFO [RS:1;jenkins-hbase4:34761] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 23:03:46,197 INFO [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 23:03:46,197 INFO [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 23:03:46,197 DEBUG [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 23:03:46,197 DEBUG [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 23:03:46,197 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 23:03:46,197 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 23:03:46,197 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 23:03:46,197 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 23:03:46,197 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 23:03:46,198 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-12 23:03:46,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/namespace/9c54aa70cc7be9a373403be60dbd52f8/.tmp/info/308147bdd743416d937a1fd966b95942 2023-02-12 23:03:46,214 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/.tmp/info/f9f70893b3b24acf8a1f044153367028 2023-02-12 23:03:46,218 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9f70893b3b24acf8a1f044153367028 2023-02-12 23:03:46,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/namespace/9c54aa70cc7be9a373403be60dbd52f8/.tmp/info/308147bdd743416d937a1fd966b95942 as hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/namespace/9c54aa70cc7be9a373403be60dbd52f8/info/308147bdd743416d937a1fd966b95942 2023-02-12 23:03:46,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/namespace/9c54aa70cc7be9a373403be60dbd52f8/info/308147bdd743416d937a1fd966b95942, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 23:03:46,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 9c54aa70cc7be9a373403be60dbd52f8 in 28ms, sequenceid=6, compaction requested=false 2023-02-12 23:03:46,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/namespace/9c54aa70cc7be9a373403be60dbd52f8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 23:03:46,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8. 2023-02-12 23:03:46,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9c54aa70cc7be9a373403be60dbd52f8: Waiting for close lock at 1676243026196Running coprocessor pre-close hooks at 1676243026196Disabling compacts and flushes for region at 1676243026196Disabling writes for close at 1676243026196Obtaining lock to block concurrent updates at 1676243026196Preparing flush snapshotting stores in 9c54aa70cc7be9a373403be60dbd52f8 at 1676243026196Finished memstore snapshotting hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676243026196Flushing stores of hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8. at 1676243026198 (+2 ms)Flushing 9c54aa70cc7be9a373403be60dbd52f8/info: creating writer at 1676243026198Flushing 9c54aa70cc7be9a373403be60dbd52f8/info: appending metadata at 1676243026200 (+2 ms)Flushing 9c54aa70cc7be9a373403be60dbd52f8/info: closing flushed file at 1676243026200Flushing 9c54aa70cc7be9a373403be60dbd52f8/info: reopening flushed file at 1676243026219 (+19 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 9c54aa70cc7be9a373403be60dbd52f8 in 28ms, sequenceid=6, compaction requested=false at 1676243026224 (+5 ms)Writing region close event to WAL at 1676243026224Running coprocessor post-close hooks at 1676243026234 (+10 ms)Closed at 1676243026235 (+1 ms) 2023-02-12 23:03:46,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676243023946.9c54aa70cc7be9a373403be60dbd52f8. 2023-02-12 23:03:46,254 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:46,255 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:46,397 INFO [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43147,1676243023359; all regions closed. 2023-02-12 23:03:46,397 DEBUG [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 23:03:46,401 DEBUG [RS:0;jenkins-hbase4:43147] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/oldWALs 2023-02-12 23:03:46,401 INFO [RS:0;jenkins-hbase4:43147] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43147%2C1676243023359:(num 1676243024295) 2023-02-12 23:03:46,401 DEBUG [RS:0;jenkins-hbase4:43147] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:46,401 INFO [RS:0;jenkins-hbase4:43147] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:46,401 INFO [RS:0;jenkins-hbase4:43147] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 23:03:46,401 INFO [RS:0;jenkins-hbase4:43147] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 23:03:46,401 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:46,401 INFO [RS:0;jenkins-hbase4:43147] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 23:03:46,401 INFO [RS:0;jenkins-hbase4:43147] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 23:03:46,402 INFO [RS:0;jenkins-hbase4:43147] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43147 2023-02-12 23:03:46,403 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:46,403 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:46,404 ERROR [Listener at localhost/36827-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@51abdc7e rejected from java.util.concurrent.ThreadPoolExecutor@55945293[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:46,404 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43147,1676243023359 2023-02-12 23:03:46,404 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:46,404 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:46,404 ERROR [Listener at localhost/36827-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e8b5695 rejected from java.util.concurrent.ThreadPoolExecutor@55945293[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:46,406 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43147,1676243023359] 2023-02-12 23:03:46,406 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43147,1676243023359; numProcessing=1 2023-02-12 23:03:46,407 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43147,1676243023359 already deleted, retry=false 2023-02-12 23:03:46,407 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43147,1676243023359 expired; onlineServers=1 2023-02-12 23:03:46,593 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:46,594 INFO [RS:0;jenkins-hbase4:43147] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43147,1676243023359; zookeeper connection closed. 2023-02-12 23:03:46,594 ERROR [Listener at localhost/36827-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@563bf976 rejected from java.util.concurrent.ThreadPoolExecutor@55945293[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:46,594 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:43147-0x1004ac69f7d0001, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:46,594 ERROR [Listener at localhost/36827-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@472f676 rejected from java.util.concurrent.ThreadPoolExecutor@55945293[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:46,594 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@694adc9d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@694adc9d 2023-02-12 23:03:46,598 DEBUG [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 23:03:46,634 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/.tmp/rep_barrier/0168593c1b0449eea60e75a48df88ec0 2023-02-12 23:03:46,638 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0168593c1b0449eea60e75a48df88ec0 2023-02-12 23:03:46,644 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/.tmp/table/9d101f6a19a14f7e89dd15e2021a6f43 2023-02-12 23:03:46,648 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d101f6a19a14f7e89dd15e2021a6f43 2023-02-12 23:03:46,648 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/.tmp/info/f9f70893b3b24acf8a1f044153367028 as hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/info/f9f70893b3b24acf8a1f044153367028 2023-02-12 23:03:46,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9f70893b3b24acf8a1f044153367028 2023-02-12 23:03:46,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/info/f9f70893b3b24acf8a1f044153367028, entries=12, sequenceid=21, filesize=6.3 K 2023-02-12 23:03:46,653 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/.tmp/rep_barrier/0168593c1b0449eea60e75a48df88ec0 as hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/rep_barrier/0168593c1b0449eea60e75a48df88ec0 2023-02-12 23:03:46,656 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0168593c1b0449eea60e75a48df88ec0 2023-02-12 23:03:46,656 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/rep_barrier/0168593c1b0449eea60e75a48df88ec0, entries=1, sequenceid=21, filesize=5.1 K 2023-02-12 23:03:46,657 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/.tmp/table/9d101f6a19a14f7e89dd15e2021a6f43 as hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/table/9d101f6a19a14f7e89dd15e2021a6f43 2023-02-12 23:03:46,660 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d101f6a19a14f7e89dd15e2021a6f43 2023-02-12 23:03:46,660 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/table/9d101f6a19a14f7e89dd15e2021a6f43, entries=4, sequenceid=21, filesize=5.1 K 2023-02-12 23:03:46,661 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 463ms, sequenceid=21, compaction requested=false 2023-02-12 23:03:46,664 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 23:03:46,665 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 23:03:46,666 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:46,666 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676243026197Running coprocessor pre-close hooks at 1676243026197Disabling compacts and flushes for region at 1676243026197Disabling writes for close at 1676243026197Obtaining lock to block concurrent updates at 1676243026198 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676243026198Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1676243026198Flushing stores of hbase:meta,,1.1588230740 at 1676243026198Flushing 1588230740/info: creating writer at 1676243026198Flushing 1588230740/info: appending metadata at 1676243026200 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676243026200Flushing 1588230740/rep_barrier: creating writer at 1676243026218 (+18 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676243026220 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676243026220Flushing 1588230740/table: creating writer at 1676243026638 (+418 ms)Flushing 1588230740/table: appending metadata at 1676243026640 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676243026640Flushing 1588230740/info: reopening flushed file at 1676243026649 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676243026653 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676243026657 (+4 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 463ms, sequenceid=21, compaction requested=false at 1676243026661 (+4 ms)Writing region close event to WAL at 1676243026662 (+1 ms)Running coprocessor post-close hooks at 1676243026665 (+3 ms)Closed at 1676243026666 (+1 ms) 2023-02-12 23:03:46,666 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:46,742 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-12 23:03:46,742 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-12 23:03:46,798 INFO [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34761,1676243023381; all regions closed. 2023-02-12 23:03:46,804 DEBUG [RS:1;jenkins-hbase4:34761] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/oldWALs 2023-02-12 23:03:46,804 INFO [RS:1;jenkins-hbase4:34761] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34761%2C1676243023381.meta:.meta(num 1676243023894) 2023-02-12 23:03:46,808 DEBUG [RS:1;jenkins-hbase4:34761] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/oldWALs 2023-02-12 23:03:46,808 INFO [RS:1;jenkins-hbase4:34761] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34761%2C1676243023381:(num 1676243024677) 2023-02-12 23:03:46,808 DEBUG [RS:1;jenkins-hbase4:34761] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:46,808 INFO [RS:1;jenkins-hbase4:34761] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:46,808 INFO [RS:1;jenkins-hbase4:34761] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 23:03:46,810 INFO [RS:1;jenkins-hbase4:34761] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34761 2023-02-12 23:03:46,810 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:46,811 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34761,1676243023381 2023-02-12 23:03:46,811 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:46,811 ERROR [Listener at localhost/36827-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4266f9e8 rejected from java.util.concurrent.ThreadPoolExecutor@4659657c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:46,812 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34761,1676243023381] 2023-02-12 23:03:46,812 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34761,1676243023381; numProcessing=2 2023-02-12 23:03:46,813 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34761,1676243023381 already deleted, retry=false 2023-02-12 23:03:46,813 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34761,1676243023381 expired; onlineServers=0 2023-02-12 23:03:46,813 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44559,1676243023307' ***** 2023-02-12 23:03:46,813 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 23:03:46,814 DEBUG [M:0;jenkins-hbase4:44559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@713dbb9f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:46,814 INFO [M:0;jenkins-hbase4:44559] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44559,1676243023307 2023-02-12 23:03:46,814 INFO [M:0;jenkins-hbase4:44559] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44559,1676243023307; all regions closed. 2023-02-12 23:03:46,814 DEBUG [M:0;jenkins-hbase4:44559] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:46,814 DEBUG [M:0;jenkins-hbase4:44559] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 23:03:46,814 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 23:03:46,814 DEBUG [M:0;jenkins-hbase4:44559] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 23:03:46,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676243023531] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676243023531,5,FailOnTimeoutGroup] 2023-02-12 23:03:46,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676243023531] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676243023531,5,FailOnTimeoutGroup] 2023-02-12 23:03:46,815 INFO [M:0;jenkins-hbase4:44559] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 23:03:46,816 INFO [M:0;jenkins-hbase4:44559] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 23:03:46,816 INFO [M:0;jenkins-hbase4:44559] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 23:03:46,816 DEBUG [M:0;jenkins-hbase4:44559] master.HMaster(1502): Stopping service threads 2023-02-12 23:03:46,816 INFO [M:0;jenkins-hbase4:44559] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 23:03:46,817 ERROR [M:0;jenkins-hbase4:44559] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 23:03:46,817 INFO [M:0;jenkins-hbase4:44559] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 23:03:46,817 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 23:03:46,821 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:46,821 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:46,821 DEBUG [M:0;jenkins-hbase4:44559] zookeeper.ZKUtil(398): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 23:03:46,821 WARN [M:0;jenkins-hbase4:44559] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 23:03:46,821 INFO [M:0;jenkins-hbase4:44559] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 23:03:46,822 INFO [M:0;jenkins-hbase4:44559] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 23:03:46,822 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:46,822 DEBUG [M:0;jenkins-hbase4:44559] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 23:03:46,822 INFO [M:0;jenkins-hbase4:44559] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:46,822 DEBUG [M:0;jenkins-hbase4:44559] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:46,822 DEBUG [M:0;jenkins-hbase4:44559] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 23:03:46,822 DEBUG [M:0;jenkins-hbase4:44559] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:46,822 INFO [M:0;jenkins-hbase4:44559] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.63 KB heapSize=67.59 KB 2023-02-12 23:03:46,830 INFO [M:0;jenkins-hbase4:44559] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.63 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4899b9467dfa4b4d88bf4a3bb76ae56e 2023-02-12 23:03:46,835 DEBUG [M:0;jenkins-hbase4:44559] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4899b9467dfa4b4d88bf4a3bb76ae56e as hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4899b9467dfa4b4d88bf4a3bb76ae56e 2023-02-12 23:03:46,838 INFO [M:0;jenkins-hbase4:44559] regionserver.HStore(1080): Added hdfs://localhost:45279/user/jenkins/test-data/3de1f938-acf0-fa64-c2ba-a26670926f75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4899b9467dfa4b4d88bf4a3bb76ae56e, entries=17, sequenceid=132, filesize=8.7 K 2023-02-12 23:03:46,838 INFO [M:0;jenkins-hbase4:44559] regionserver.HRegion(2947): Finished flush of dataSize ~56.63 KB/57989, heapSize ~67.57 KB/69192, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-12 23:03:46,839 INFO [M:0;jenkins-hbase4:44559] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:46,839 DEBUG [M:0;jenkins-hbase4:44559] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676243026822Disabling compacts and flushes for region at 1676243026822Disabling writes for close at 1676243026822Obtaining lock to block concurrent updates at 1676243026822Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676243026822Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57989, getHeapSize=69192, getOffHeapSize=0, getCellsCount=145 at 1676243026822Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676243026823 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676243026824 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676243026826 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676243026826Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676243026835 (+9 ms)Finished flush of dataSize ~56.63 KB/57989, heapSize ~67.57 KB/69192, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1676243026838 (+3 ms)Writing region close event to WAL at 1676243026839 (+1 ms)Closed at 1676243026839 2023-02-12 23:03:46,841 INFO [M:0;jenkins-hbase4:44559] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 23:03:46,841 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:46,842 INFO [M:0;jenkins-hbase4:44559] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44559 2023-02-12 23:03:46,843 DEBUG [M:0;jenkins-hbase4:44559] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44559,1676243023307 already deleted, retry=false 2023-02-12 23:03:46,912 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:46,912 INFO [RS:1;jenkins-hbase4:34761] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34761,1676243023381; zookeeper connection closed. 2023-02-12 23:03:46,912 ERROR [Listener at localhost/36827-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@47ce5cda rejected from java.util.concurrent.ThreadPoolExecutor@4659657c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:46,913 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x1004ac69f7d0002, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:46,913 ERROR [Listener at localhost/36827-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3feda5d9 rejected from java.util.concurrent.ThreadPoolExecutor@4659657c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:46,913 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@400f0c6d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@400f0c6d 2023-02-12 23:03:46,913 INFO [Listener at localhost/36827] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 23:03:47,012 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:47,013 INFO [M:0;jenkins-hbase4:44559] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44559,1676243023307; zookeeper connection closed. 2023-02-12 23:03:47,013 ERROR [Listener at localhost/36827-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2a926fe8 rejected from java.util.concurrent.ThreadPoolExecutor@2eadfe62[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:47,014 DEBUG [Listener at localhost/36827-EventThread] zookeeper.ZKWatcher(600): master:44559-0x1004ac69f7d0000, quorum=127.0.0.1:59902, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:47,014 ERROR [Listener at localhost/36827-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@63da80b1 rejected from java.util.concurrent.ThreadPoolExecutor@2eadfe62[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:47,014 WARN [Listener at localhost/36827] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 23:03:47,018 INFO [Listener at localhost/36827] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:47,123 WARN [BP-1783808252-172.31.14.131-1676243022697 heartbeating to localhost/127.0.0.1:45279] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 23:03:47,124 WARN [BP-1783808252-172.31.14.131-1676243022697 heartbeating to localhost/127.0.0.1:45279] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1783808252-172.31.14.131-1676243022697 (Datanode Uuid 9c3676bb-7205-4fd9-881c-f1db28b14068) service to localhost/127.0.0.1:45279 2023-02-12 23:03:47,125 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/cluster_4d6dd8fe-b2d8-ef3b-76ee-5bcdabfb1b8e/dfs/data/data3/current/BP-1783808252-172.31.14.131-1676243022697] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:47,125 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/cluster_4d6dd8fe-b2d8-ef3b-76ee-5bcdabfb1b8e/dfs/data/data4/current/BP-1783808252-172.31.14.131-1676243022697] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:47,126 WARN [Listener at localhost/36827] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 23:03:47,129 INFO [Listener at localhost/36827] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:47,233 WARN [BP-1783808252-172.31.14.131-1676243022697 heartbeating to localhost/127.0.0.1:45279] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 23:03:47,233 WARN [BP-1783808252-172.31.14.131-1676243022697 heartbeating to localhost/127.0.0.1:45279] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1783808252-172.31.14.131-1676243022697 (Datanode Uuid b66110aa-0b42-42c4-b351-25e7a87abf1b) service to localhost/127.0.0.1:45279 2023-02-12 23:03:47,234 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/cluster_4d6dd8fe-b2d8-ef3b-76ee-5bcdabfb1b8e/dfs/data/data1/current/BP-1783808252-172.31.14.131-1676243022697] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:47,234 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/cluster_4d6dd8fe-b2d8-ef3b-76ee-5bcdabfb1b8e/dfs/data/data2/current/BP-1783808252-172.31.14.131-1676243022697] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:47,244 INFO [Listener at localhost/36827] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:47,357 INFO [Listener at localhost/36827] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 23:03:47,371 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 23:03:47,383 INFO [Listener at localhost/36827] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=273 (was 253) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36827 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45279 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:45279 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:45279 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44559,1676243023307)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:45279 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:45279 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:45279 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:45279 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=577 (was 658), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 238), ProcessCount=166 (was 166), AvailableMemoryMB=3895 (was 3930) 2023-02-12 23:03:47,394 INFO [Listener at localhost/36827] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=273, OpenFileDescriptor=577, MaxFileDescriptor=60000, SystemLoadAverage=227, ProcessCount=166, AvailableMemoryMB=3894 2023-02-12 23:03:47,404 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/hadoop.log.dir so I do NOT create it in target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab 2023-02-12 23:03:47,404 WARN [Listener at localhost/36827] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 23:03:47,404 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/hadoop.tmp.dir so I do NOT create it in target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab 2023-02-12 23:03:47,404 WARN [Listener at localhost/36827] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cffd278-5da9-8ef7-12b0-c968ec060cd1/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 23:03:47,404 DEBUG [Listener at localhost/36827] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab 2023-02-12 23:03:47,405 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 23:03:47,405 INFO [Listener at localhost/36827] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/cluster_3b47f26f-b1bd-2b99-6704-6491bbe80a58, deleteOnExit=true 2023-02-12 23:03:47,405 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 23:03:47,405 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/test.cache.data in system properties and HBase conf 2023-02-12 23:03:47,405 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 23:03:47,405 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/hadoop.log.dir in system properties and HBase conf 2023-02-12 23:03:47,405 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 23:03:47,405 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 23:03:47,405 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 23:03:47,405 DEBUG [Listener at localhost/36827] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 23:03:47,406 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 23:03:47,406 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 23:03:47,406 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 23:03:47,406 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 23:03:47,406 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 23:03:47,406 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 23:03:47,406 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 23:03:47,406 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 23:03:47,406 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 23:03:47,406 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/nfs.dump.dir in system properties and HBase conf 2023-02-12 23:03:47,407 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/java.io.tmpdir in system properties and HBase conf 2023-02-12 23:03:47,407 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 23:03:47,407 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 23:03:47,407 INFO [Listener at localhost/36827] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 23:03:47,411 WARN [Listener at localhost/36827] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 23:03:47,411 WARN [Listener at localhost/36827] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 23:03:47,459 WARN [Listener at localhost/36827] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:47,461 INFO [Listener at localhost/36827] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:47,464 INFO [Listener at localhost/36827] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/java.io.tmpdir/Jetty_localhost_45893_hdfs____.hbivqd/webapp 2023-02-12 23:03:47,555 INFO [Listener at localhost/36827] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45893 2023-02-12 23:03:47,560 WARN [Listener at localhost/36827] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 23:03:47,560 WARN [Listener at localhost/36827] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 23:03:47,620 WARN [Listener at localhost/35937] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:47,640 WARN [Listener at localhost/35937] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 23:03:47,643 WARN [Listener at localhost/35937] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:47,644 INFO [Listener at localhost/35937] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:47,648 INFO [Listener at localhost/35937] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/java.io.tmpdir/Jetty_localhost_44737_datanode____nt75j6/webapp 2023-02-12 23:03:47,740 INFO [Listener at localhost/35937] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44737 2023-02-12 23:03:47,752 WARN [Listener at localhost/33851] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:47,767 WARN [Listener at localhost/33851] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 23:03:47,769 WARN [Listener at localhost/33851] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 23:03:47,770 INFO [Listener at localhost/33851] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 23:03:47,773 INFO [Listener at localhost/33851] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/java.io.tmpdir/Jetty_localhost_33999_datanode____.4suzk/webapp 2023-02-12 23:03:47,897 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7416e512b3fd5b4d: Processing first storage report for DS-0072ad62-7fb2-41f0-ba90-0a9f66dc7702 from datanode a7a8b8ce-ed75-4ac0-ac84-398d14558302 2023-02-12 23:03:47,897 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7416e512b3fd5b4d: from storage DS-0072ad62-7fb2-41f0-ba90-0a9f66dc7702 node DatanodeRegistration(127.0.0.1:44091, datanodeUuid=a7a8b8ce-ed75-4ac0-ac84-398d14558302, infoPort=33229, infoSecurePort=0, ipcPort=33851, storageInfo=lv=-57;cid=testClusterID;nsid=1252414326;c=1676243027413), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:47,897 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7416e512b3fd5b4d: Processing first storage report for DS-018520f2-7b21-4726-8367-aa969d877fcd from datanode a7a8b8ce-ed75-4ac0-ac84-398d14558302 2023-02-12 23:03:47,897 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7416e512b3fd5b4d: from storage DS-018520f2-7b21-4726-8367-aa969d877fcd node DatanodeRegistration(127.0.0.1:44091, datanodeUuid=a7a8b8ce-ed75-4ac0-ac84-398d14558302, infoPort=33229, infoSecurePort=0, ipcPort=33851, storageInfo=lv=-57;cid=testClusterID;nsid=1252414326;c=1676243027413), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:47,924 INFO [Listener at localhost/33851] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33999 2023-02-12 23:03:47,933 WARN [Listener at localhost/33843] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 23:03:48,023 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc36a7e7ab17c4b3e: Processing first storage report for DS-16665dca-38f5-49ba-8217-030457ba8696 from datanode 6f858d1a-1eda-49f8-a8c9-f13c06a039ae 2023-02-12 23:03:48,023 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc36a7e7ab17c4b3e: from storage DS-16665dca-38f5-49ba-8217-030457ba8696 node DatanodeRegistration(127.0.0.1:43045, datanodeUuid=6f858d1a-1eda-49f8-a8c9-f13c06a039ae, infoPort=42847, infoSecurePort=0, ipcPort=33843, storageInfo=lv=-57;cid=testClusterID;nsid=1252414326;c=1676243027413), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:48,023 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc36a7e7ab17c4b3e: Processing first storage report for DS-6162e513-4ff0-4841-aceb-37069a181785 from datanode 6f858d1a-1eda-49f8-a8c9-f13c06a039ae 2023-02-12 23:03:48,023 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc36a7e7ab17c4b3e: from storage DS-6162e513-4ff0-4841-aceb-37069a181785 node DatanodeRegistration(127.0.0.1:43045, datanodeUuid=6f858d1a-1eda-49f8-a8c9-f13c06a039ae, infoPort=42847, infoSecurePort=0, ipcPort=33843, storageInfo=lv=-57;cid=testClusterID;nsid=1252414326;c=1676243027413), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 23:03:48,040 DEBUG [Listener at localhost/33843] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab 2023-02-12 23:03:48,042 INFO [Listener at localhost/33843] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/cluster_3b47f26f-b1bd-2b99-6704-6491bbe80a58/zookeeper_0, clientPort=59961, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/cluster_3b47f26f-b1bd-2b99-6704-6491bbe80a58/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/cluster_3b47f26f-b1bd-2b99-6704-6491bbe80a58/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 23:03:48,043 INFO [Listener at localhost/33843] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59961 2023-02-12 23:03:48,043 INFO [Listener at localhost/33843] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:48,044 INFO [Listener at localhost/33843] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:48,054 INFO [Listener at localhost/33843] util.FSUtils(479): Created version file at hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93 with version=8 2023-02-12 23:03:48,054 INFO [Listener at localhost/33843] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:48,055 INFO [Listener at localhost/33843] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:48,056 INFO [Listener at localhost/33843] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35937/user/jenkins/test-data/5bd7bc99-b18e-ebe8-f519-37e165c63da7/hbase-staging 2023-02-12 23:03:48,058 INFO [Listener at localhost/33843] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:48,058 INFO [Listener at localhost/33843] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:48,058 INFO [Listener at localhost/33843] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:48,058 INFO [Listener at localhost/33843] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:48,058 INFO [Listener at localhost/33843] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:48,058 INFO [Listener at localhost/33843] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:48,058 INFO [Listener at localhost/33843] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:48,059 INFO [Listener at localhost/33843] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43299 2023-02-12 23:03:48,060 INFO [Listener at localhost/33843] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:48,061 INFO [Listener at localhost/33843] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:48,062 INFO [Listener at localhost/33843] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43299 connecting to ZooKeeper ensemble=127.0.0.1:59961 2023-02-12 23:03:48,069 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:432990x0, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:48,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43299-0x1004ac6b20e0000 connected 2023-02-12 23:03:48,091 DEBUG [Listener at localhost/33843] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:48,092 DEBUG [Listener at localhost/33843] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:48,092 DEBUG [Listener at localhost/33843] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:48,096 DEBUG [Listener at localhost/33843] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43299 2023-02-12 23:03:48,096 DEBUG [Listener at localhost/33843] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43299 2023-02-12 23:03:48,100 DEBUG [Listener at localhost/33843] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43299 2023-02-12 23:03:48,100 DEBUG [Listener at localhost/33843] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43299 2023-02-12 23:03:48,100 DEBUG [Listener at localhost/33843] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43299 2023-02-12 23:03:48,100 INFO [Listener at localhost/33843] master.HMaster(439): hbase.rootdir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93, hbase.cluster.distributed=false 2023-02-12 23:03:48,112 INFO [Listener at localhost/33843] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:48,112 INFO [Listener at localhost/33843] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:48,112 INFO [Listener at localhost/33843] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:48,112 INFO [Listener at localhost/33843] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:48,112 INFO [Listener at localhost/33843] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:48,112 INFO [Listener at localhost/33843] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:48,112 INFO [Listener at localhost/33843] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:48,113 INFO [Listener at localhost/33843] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45953 2023-02-12 23:03:48,113 INFO [Listener at localhost/33843] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 23:03:48,113 DEBUG [Listener at localhost/33843] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:48,114 INFO [Listener at localhost/33843] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:48,115 INFO [Listener at localhost/33843] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:48,115 INFO [Listener at localhost/33843] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45953 connecting to ZooKeeper ensemble=127.0.0.1:59961 2023-02-12 23:03:48,117 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:459530x0, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:48,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45953-0x1004ac6b20e0001 connected 2023-02-12 23:03:48,119 DEBUG [Listener at localhost/33843] zookeeper.ZKUtil(164): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:48,120 DEBUG [Listener at localhost/33843] zookeeper.ZKUtil(164): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:48,121 DEBUG [Listener at localhost/33843] zookeeper.ZKUtil(164): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:48,121 DEBUG [Listener at localhost/33843] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45953 2023-02-12 23:03:48,124 DEBUG [Listener at localhost/33843] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45953 2023-02-12 23:03:48,124 DEBUG [Listener at localhost/33843] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45953 2023-02-12 23:03:48,124 DEBUG [Listener at localhost/33843] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45953 2023-02-12 23:03:48,124 DEBUG [Listener at localhost/33843] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45953 2023-02-12 23:03:48,135 INFO [Listener at localhost/33843] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 23:03:48,135 INFO [Listener at localhost/33843] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:48,135 INFO [Listener at localhost/33843] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:48,135 INFO [Listener at localhost/33843] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 23:03:48,135 INFO [Listener at localhost/33843] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 23:03:48,135 INFO [Listener at localhost/33843] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 23:03:48,135 INFO [Listener at localhost/33843] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 23:03:48,136 INFO [Listener at localhost/33843] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41467 2023-02-12 23:03:48,136 INFO [Listener at localhost/33843] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 23:03:48,136 DEBUG [Listener at localhost/33843] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:48,137 INFO [Listener at localhost/33843] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:48,137 INFO [Listener at localhost/33843] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:48,138 INFO [Listener at localhost/33843] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41467 connecting to ZooKeeper ensemble=127.0.0.1:59961 2023-02-12 23:03:48,140 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:414670x0, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 23:03:48,141 DEBUG [Listener at localhost/33843] zookeeper.ZKUtil(164): regionserver:414670x0, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:48,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41467-0x1004ac6b20e0002 connected 2023-02-12 23:03:48,142 DEBUG [Listener at localhost/33843] zookeeper.ZKUtil(164): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:48,142 DEBUG [Listener at localhost/33843] zookeeper.ZKUtil(164): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 23:03:48,144 DEBUG [Listener at localhost/33843] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41467 2023-02-12 23:03:48,146 DEBUG [Listener at localhost/33843] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41467 2023-02-12 23:03:48,146 DEBUG [Listener at localhost/33843] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41467 2023-02-12 23:03:48,146 DEBUG [Listener at localhost/33843] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41467 2023-02-12 23:03:48,147 DEBUG [Listener at localhost/33843] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41467 2023-02-12 23:03:48,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43299,1676243028057 2023-02-12 23:03:48,150 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 23:03:48,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43299,1676243028057 2023-02-12 23:03:48,152 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:48,152 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:48,152 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:48,152 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:48,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 23:03:48,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43299,1676243028057 from backup master directory 2023-02-12 23:03:48,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 23:03:48,156 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43299,1676243028057 2023-02-12 23:03:48,156 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 23:03:48,156 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:48,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,43299,1676243028057 2023-02-12 23:03:48,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/hbase.id with ID: 596b6f45-ea08-433c-8eb0-4308e2906931 2023-02-12 23:03:48,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 23:03:48,183 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:48,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6eaea8be to 127.0.0.1:59961 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:48,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a277c3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:48,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:48,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 23:03:48,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:48,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/MasterData/data/master/store-tmp 2023-02-12 23:03:48,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:48,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 23:03:48,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:48,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:48,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 23:03:48,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:48,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:48,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676243028207Disabling compacts and flushes for region at 1676243028207Disabling writes for close at 1676243028207Writing region close event to WAL at 1676243028207Closed at 1676243028207 2023-02-12 23:03:48,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/MasterData/WALs/jenkins-hbase4.apache.org,43299,1676243028057 2023-02-12 23:03:48,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43299%2C1676243028057, suffix=, logDir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/MasterData/WALs/jenkins-hbase4.apache.org,43299,1676243028057, archiveDir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/MasterData/oldWALs, maxLogs=10 2023-02-12 23:03:48,221 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44091,DS-0072ad62-7fb2-41f0-ba90-0a9f66dc7702,DISK] 2023-02-12 23:03:48,221 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43045,DS-16665dca-38f5-49ba-8217-030457ba8696,DISK] 2023-02-12 23:03:48,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/MasterData/WALs/jenkins-hbase4.apache.org,43299,1676243028057/jenkins-hbase4.apache.org%2C43299%2C1676243028057.1676243028209 2023-02-12 23:03:48,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44091,DS-0072ad62-7fb2-41f0-ba90-0a9f66dc7702,DISK], DatanodeInfoWithStorage[127.0.0.1:43045,DS-16665dca-38f5-49ba-8217-030457ba8696,DISK]] 2023-02-12 23:03:48,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:48,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:48,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:48,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:48,228 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:48,229 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 23:03:48,229 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 23:03:48,229 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:48,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:48,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:48,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 23:03:48,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:48,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68556652, jitterRate=0.02157372236251831}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 23:03:48,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676243028223Initializing all the Stores at 1676243028224 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243028224Cleaning up temporary data from old regions at 1676243028231 (+7 ms)Cleaning up detritus from prior splits at 1676243028231Region opened successfully at 1676243028234 (+3 ms) 2023-02-12 23:03:48,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 23:03:48,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 23:03:48,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 23:03:48,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 23:03:48,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 23:03:48,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 23:03:48,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 23:03:48,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 23:03:48,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 23:03:48,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 23:03:48,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 23:03:48,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 23:03:48,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 23:03:48,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 23:03:48,249 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:48,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 23:03:48,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 23:03:48,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 23:03:48,251 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:48,252 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:48,252 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:48,252 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:48,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,43299,1676243028057, sessionid=0x1004ac6b20e0000, setting cluster-up flag (Was=false) 2023-02-12 23:03:48,258 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:48,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 23:03:48,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43299,1676243028057 2023-02-12 23:03:48,265 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:48,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 23:03:48,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43299,1676243028057 2023-02-12 23:03:48,269 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.hbase-snapshot/.tmp 2023-02-12 23:03:48,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:48,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:48,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:48,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:48,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 23:03:48,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 23:03:48,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:48,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676243058273 2023-02-12 23:03:48,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 23:03:48,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 23:03:48,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 23:03:48,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 23:03:48,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 23:03:48,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 23:03:48,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,273 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:48,274 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 23:03:48,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 23:03:48,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 23:03:48,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 23:03:48,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 23:03:48,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 23:03:48,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676243028275,5,FailOnTimeoutGroup] 2023-02-12 23:03:48,275 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:48,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676243028275,5,FailOnTimeoutGroup] 2023-02-12 23:03:48,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 23:03:48,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,286 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:48,287 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:48,287 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93 2023-02-12 23:03:48,296 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:48,297 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 23:03:48,298 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/info 2023-02-12 23:03:48,298 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 23:03:48,298 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:48,298 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 23:03:48,299 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:48,300 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 23:03:48,300 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:48,300 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 23:03:48,301 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/table 2023-02-12 23:03:48,301 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 23:03:48,301 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:48,302 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740 2023-02-12 23:03:48,302 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740 2023-02-12 23:03:48,303 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 23:03:48,304 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 23:03:48,305 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:48,305 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73983037, jitterRate=0.10243315994739532}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 23:03:48,306 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676243028296Initializing all the Stores at 1676243028296Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243028296Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243028297 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243028297Cleaning up temporary data from old regions at 1676243028303 (+6 ms)Cleaning up detritus from prior splits at 1676243028303Region opened successfully at 1676243028306 (+3 ms) 2023-02-12 23:03:48,306 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 23:03:48,306 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 23:03:48,306 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 23:03:48,306 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 23:03:48,306 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 23:03:48,306 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:48,306 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676243028306Disabling compacts and flushes for region at 1676243028306Disabling writes for close at 1676243028306Writing region close event to WAL at 1676243028306Closed at 1676243028306 2023-02-12 23:03:48,307 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 23:03:48,307 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 23:03:48,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 23:03:48,307 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 23:03:48,309 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 23:03:48,349 INFO [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer(952): ClusterId : 596b6f45-ea08-433c-8eb0-4308e2906931 2023-02-12 23:03:48,349 INFO [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(952): ClusterId : 596b6f45-ea08-433c-8eb0-4308e2906931 2023-02-12 23:03:48,349 DEBUG [RS:1;jenkins-hbase4:41467] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 23:03:48,349 DEBUG [RS:0;jenkins-hbase4:45953] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 23:03:48,351 DEBUG [RS:0;jenkins-hbase4:45953] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 23:03:48,351 DEBUG [RS:1;jenkins-hbase4:41467] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 23:03:48,351 DEBUG [RS:1;jenkins-hbase4:41467] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 23:03:48,351 DEBUG [RS:0;jenkins-hbase4:45953] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 23:03:48,353 DEBUG [RS:0;jenkins-hbase4:45953] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 23:03:48,353 DEBUG [RS:1;jenkins-hbase4:41467] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 23:03:48,354 DEBUG [RS:1;jenkins-hbase4:41467] zookeeper.ReadOnlyZKClient(139): Connect 0x1592265d to 127.0.0.1:59961 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:48,354 DEBUG [RS:0;jenkins-hbase4:45953] zookeeper.ReadOnlyZKClient(139): Connect 0x1292b289 to 127.0.0.1:59961 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:48,357 DEBUG [RS:1;jenkins-hbase4:41467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b55ca9f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:48,357 DEBUG [RS:0;jenkins-hbase4:45953] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c554eab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:48,357 DEBUG [RS:1;jenkins-hbase4:41467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f6a4d2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:48,357 DEBUG [RS:0;jenkins-hbase4:45953] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@186ad9f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:48,365 DEBUG [RS:1;jenkins-hbase4:41467] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41467 2023-02-12 23:03:48,365 INFO [RS:1;jenkins-hbase4:41467] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 23:03:48,365 INFO [RS:1;jenkins-hbase4:41467] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 23:03:48,365 DEBUG [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 23:03:48,366 INFO [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43299,1676243028057 with isa=jenkins-hbase4.apache.org/172.31.14.131:41467, startcode=1676243028134 2023-02-12 23:03:48,366 DEBUG [RS:1;jenkins-hbase4:41467] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 23:03:48,367 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35073, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 23:03:48,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:48,369 DEBUG [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93 2023-02-12 23:03:48,369 DEBUG [RS:0;jenkins-hbase4:45953] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45953 2023-02-12 23:03:48,369 DEBUG [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35937 2023-02-12 23:03:48,370 DEBUG [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 23:03:48,370 INFO [RS:0;jenkins-hbase4:45953] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 23:03:48,370 INFO [RS:0;jenkins-hbase4:45953] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 23:03:48,370 DEBUG [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 23:03:48,372 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:48,372 INFO [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43299,1676243028057 with isa=jenkins-hbase4.apache.org/172.31.14.131:45953, startcode=1676243028111 2023-02-12 23:03:48,372 DEBUG [RS:0;jenkins-hbase4:45953] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 23:03:48,373 DEBUG [RS:1;jenkins-hbase4:41467] zookeeper.ZKUtil(162): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:48,373 WARN [RS:1;jenkins-hbase4:41467] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:48,373 INFO [RS:1;jenkins-hbase4:41467] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:48,373 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41467,1676243028134] 2023-02-12 23:03:48,373 DEBUG [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/WALs/jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:48,375 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39323, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 23:03:48,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:48,375 DEBUG [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93 2023-02-12 23:03:48,375 DEBUG [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35937 2023-02-12 23:03:48,375 DEBUG [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 23:03:48,381 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:48,381 DEBUG [RS:0;jenkins-hbase4:45953] zookeeper.ZKUtil(162): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:48,381 WARN [RS:0;jenkins-hbase4:45953] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 23:03:48,381 INFO [RS:0;jenkins-hbase4:45953] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:48,381 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45953,1676243028111] 2023-02-12 23:03:48,381 DEBUG [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/WALs/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:48,381 DEBUG [RS:1;jenkins-hbase4:41467] zookeeper.ZKUtil(162): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:48,382 DEBUG [RS:1;jenkins-hbase4:41467] zookeeper.ZKUtil(162): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:48,383 DEBUG [RS:1;jenkins-hbase4:41467] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 23:03:48,383 INFO [RS:1;jenkins-hbase4:41467] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 23:03:48,384 DEBUG [RS:0;jenkins-hbase4:45953] zookeeper.ZKUtil(162): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:48,384 DEBUG [RS:0;jenkins-hbase4:45953] zookeeper.ZKUtil(162): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:48,385 DEBUG [RS:0;jenkins-hbase4:45953] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 23:03:48,385 INFO [RS:1;jenkins-hbase4:41467] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 23:03:48,385 INFO [RS:0;jenkins-hbase4:45953] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 23:03:48,385 INFO [RS:1;jenkins-hbase4:41467] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 23:03:48,385 INFO [RS:1;jenkins-hbase4:41467] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,388 INFO [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 23:03:48,390 INFO [RS:0;jenkins-hbase4:45953] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 23:03:48,390 INFO [RS:0;jenkins-hbase4:45953] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 23:03:48,390 INFO [RS:0;jenkins-hbase4:45953] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,391 INFO [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 23:03:48,392 INFO [RS:1;jenkins-hbase4:41467] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,392 DEBUG [RS:1;jenkins-hbase4:41467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,392 DEBUG [RS:1;jenkins-hbase4:41467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,392 DEBUG [RS:1;jenkins-hbase4:41467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,392 INFO [RS:0;jenkins-hbase4:45953] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,392 DEBUG [RS:1;jenkins-hbase4:41467] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,394 DEBUG [RS:1;jenkins-hbase4:41467] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,394 DEBUG [RS:0;jenkins-hbase4:45953] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,394 DEBUG [RS:1;jenkins-hbase4:41467] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:48,394 DEBUG [RS:1;jenkins-hbase4:41467] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,394 DEBUG [RS:1;jenkins-hbase4:41467] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,394 DEBUG [RS:0;jenkins-hbase4:45953] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,394 DEBUG [RS:1;jenkins-hbase4:41467] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,394 DEBUG [RS:0;jenkins-hbase4:45953] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,394 DEBUG [RS:1;jenkins-hbase4:41467] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,394 DEBUG [RS:0;jenkins-hbase4:45953] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,395 DEBUG [RS:0;jenkins-hbase4:45953] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,395 DEBUG [RS:0;jenkins-hbase4:45953] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 23:03:48,395 DEBUG [RS:0;jenkins-hbase4:45953] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,395 DEBUG [RS:0;jenkins-hbase4:45953] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,395 DEBUG [RS:0;jenkins-hbase4:45953] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,395 DEBUG [RS:0;jenkins-hbase4:45953] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 23:03:48,395 INFO [RS:1;jenkins-hbase4:41467] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,395 INFO [RS:1;jenkins-hbase4:41467] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,396 INFO [RS:1;jenkins-hbase4:41467] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,400 INFO [RS:0;jenkins-hbase4:45953] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,401 INFO [RS:0;jenkins-hbase4:45953] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,401 INFO [RS:0;jenkins-hbase4:45953] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,411 INFO [RS:1;jenkins-hbase4:41467] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 23:03:48,411 INFO [RS:1;jenkins-hbase4:41467] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41467,1676243028134-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,411 INFO [RS:0;jenkins-hbase4:45953] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 23:03:48,411 INFO [RS:0;jenkins-hbase4:45953] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45953,1676243028111-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,421 INFO [RS:1;jenkins-hbase4:41467] regionserver.Replication(203): jenkins-hbase4.apache.org,41467,1676243028134 started 2023-02-12 23:03:48,421 INFO [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41467,1676243028134, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41467, sessionid=0x1004ac6b20e0002 2023-02-12 23:03:48,421 DEBUG [RS:1;jenkins-hbase4:41467] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 23:03:48,421 DEBUG [RS:1;jenkins-hbase4:41467] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:48,421 DEBUG [RS:1;jenkins-hbase4:41467] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41467,1676243028134' 2023-02-12 23:03:48,421 DEBUG [RS:1;jenkins-hbase4:41467] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:48,421 INFO [RS:0;jenkins-hbase4:45953] regionserver.Replication(203): jenkins-hbase4.apache.org,45953,1676243028111 started 2023-02-12 23:03:48,421 INFO [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45953,1676243028111, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45953, sessionid=0x1004ac6b20e0001 2023-02-12 23:03:48,421 DEBUG [RS:0;jenkins-hbase4:45953] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 23:03:48,421 DEBUG [RS:0;jenkins-hbase4:45953] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:48,421 DEBUG [RS:0;jenkins-hbase4:45953] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45953,1676243028111' 2023-02-12 23:03:48,421 DEBUG [RS:0;jenkins-hbase4:45953] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:48,421 DEBUG [RS:1;jenkins-hbase4:41467] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:48,422 DEBUG [RS:0;jenkins-hbase4:45953] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:48,422 DEBUG [RS:1;jenkins-hbase4:41467] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 23:03:48,422 DEBUG [RS:1;jenkins-hbase4:41467] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 23:03:48,422 DEBUG [RS:1;jenkins-hbase4:41467] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:48,422 DEBUG [RS:1;jenkins-hbase4:41467] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41467,1676243028134' 2023-02-12 23:03:48,422 DEBUG [RS:1;jenkins-hbase4:41467] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:48,422 DEBUG [RS:0;jenkins-hbase4:45953] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 23:03:48,422 DEBUG [RS:0;jenkins-hbase4:45953] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 23:03:48,422 DEBUG [RS:0;jenkins-hbase4:45953] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:48,422 DEBUG [RS:0;jenkins-hbase4:45953] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45953,1676243028111' 2023-02-12 23:03:48,422 DEBUG [RS:0;jenkins-hbase4:45953] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:48,422 DEBUG [RS:1;jenkins-hbase4:41467] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:48,422 DEBUG [RS:1;jenkins-hbase4:41467] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 23:03:48,422 DEBUG [RS:0;jenkins-hbase4:45953] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:48,422 INFO [RS:1;jenkins-hbase4:41467] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 23:03:48,423 INFO [RS:1;jenkins-hbase4:41467] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 23:03:48,423 DEBUG [RS:0;jenkins-hbase4:45953] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 23:03:48,423 INFO [RS:0;jenkins-hbase4:45953] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 23:03:48,423 INFO [RS:0;jenkins-hbase4:45953] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 23:03:48,459 DEBUG [jenkins-hbase4:43299] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 23:03:48,459 DEBUG [jenkins-hbase4:43299] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:48,461 DEBUG [jenkins-hbase4:43299] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:48,461 DEBUG [jenkins-hbase4:43299] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:48,461 DEBUG [jenkins-hbase4:43299] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:48,461 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45953,1676243028111, state=OPENING 2023-02-12 23:03:48,462 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 23:03:48,464 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:48,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45953,1676243028111}] 2023-02-12 23:03:48,464 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 23:03:48,618 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:48,619 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 23:03:48,620 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46988, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 23:03:48,624 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 23:03:48,624 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 23:03:48,625 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45953%2C1676243028111.meta, suffix=.meta, logDir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/WALs/jenkins-hbase4.apache.org,45953,1676243028111, archiveDir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/oldWALs, maxLogs=32 2023-02-12 23:03:48,640 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44091,DS-0072ad62-7fb2-41f0-ba90-0a9f66dc7702,DISK] 2023-02-12 23:03:48,640 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43045,DS-16665dca-38f5-49ba-8217-030457ba8696,DISK] 2023-02-12 23:03:48,641 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/WALs/jenkins-hbase4.apache.org,45953,1676243028111/jenkins-hbase4.apache.org%2C45953%2C1676243028111.meta.1676243028625.meta 2023-02-12 23:03:48,643 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44091,DS-0072ad62-7fb2-41f0-ba90-0a9f66dc7702,DISK], DatanodeInfoWithStorage[127.0.0.1:43045,DS-16665dca-38f5-49ba-8217-030457ba8696,DISK]] 2023-02-12 23:03:48,643 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:48,643 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 23:03:48,643 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 23:03:48,643 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 23:03:48,643 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 23:03:48,643 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:48,643 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 23:03:48,644 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 23:03:48,645 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 23:03:48,645 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/info 2023-02-12 23:03:48,645 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/info 2023-02-12 23:03:48,646 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 23:03:48,646 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:48,646 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 23:03:48,647 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:48,647 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/rep_barrier 2023-02-12 23:03:48,647 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 23:03:48,647 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:48,647 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 23:03:48,648 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/table 2023-02-12 23:03:48,648 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/table 2023-02-12 23:03:48,648 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 23:03:48,649 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:48,649 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740 2023-02-12 23:03:48,650 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740 2023-02-12 23:03:48,651 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 23:03:48,652 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 23:03:48,653 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59587675, jitterRate=-0.11207444965839386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 23:03:48,653 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676243028644Writing region info on filesystem at 1676243028644Initializing all the Stores at 1676243028644Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243028644Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243028644Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243028644Cleaning up temporary data from old regions at 1676243028650 (+6 ms)Cleaning up detritus from prior splits at 1676243028651 (+1 ms)Running coprocessor post-open hooks at 1676243028653 (+2 ms)Region opened successfully at 1676243028653 2023-02-12 23:03:48,653 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676243028618 2023-02-12 23:03:48,656 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 23:03:48,657 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 23:03:48,657 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45953,1676243028111, state=OPEN 2023-02-12 23:03:48,658 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 23:03:48,658 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 23:03:48,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 23:03:48,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45953,1676243028111 in 194 msec 2023-02-12 23:03:48,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 23:03:48,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 353 msec 2023-02-12 23:03:48,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 391 msec 2023-02-12 23:03:48,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676243028151, completionTime=-1 2023-02-12 23:03:48,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 23:03:48,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 23:03:48,664 DEBUG [hconnection-0x275ecaa3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:48,666 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46994, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:48,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 23:03:48,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676243088667 2023-02-12 23:03:48,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676243148667 2023-02-12 23:03:48,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-12 23:03:48,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43299,1676243028057-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43299,1676243028057-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43299,1676243028057-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43299, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 23:03:48,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 23:03:48,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:48,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 23:03:48,673 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 23:03:48,673 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 23:03:48,674 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 23:03:48,675 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/hbase/namespace/62136688e39f6b7225186a0573132e41 2023-02-12 23:03:48,675 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/hbase/namespace/62136688e39f6b7225186a0573132e41 empty. 2023-02-12 23:03:48,675 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/hbase/namespace/62136688e39f6b7225186a0573132e41 2023-02-12 23:03:48,675 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 23:03:48,686 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:48,687 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 62136688e39f6b7225186a0573132e41, NAME => 'hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp 2023-02-12 23:03:48,692 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:48,692 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 62136688e39f6b7225186a0573132e41, disabling compactions & flushes 2023-02-12 23:03:48,693 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41. 2023-02-12 23:03:48,693 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41. 2023-02-12 23:03:48,693 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41. after waiting 0 ms 2023-02-12 23:03:48,693 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41. 2023-02-12 23:03:48,693 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41. 2023-02-12 23:03:48,693 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 62136688e39f6b7225186a0573132e41: Waiting for close lock at 1676243028692Disabling compacts and flushes for region at 1676243028692Disabling writes for close at 1676243028693 (+1 ms)Writing region close event to WAL at 1676243028693Closed at 1676243028693 2023-02-12 23:03:48,694 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 23:03:48,695 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676243028695"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243028695"}]},"ts":"1676243028695"} 2023-02-12 23:03:48,696 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 23:03:48,697 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 23:03:48,697 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243028697"}]},"ts":"1676243028697"} 2023-02-12 23:03:48,698 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 23:03:48,701 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:48,702 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:48,702 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:48,702 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:48,702 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=62136688e39f6b7225186a0573132e41, ASSIGN}] 2023-02-12 23:03:48,703 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=62136688e39f6b7225186a0573132e41, ASSIGN 2023-02-12 23:03:48,704 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=62136688e39f6b7225186a0573132e41, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41467,1676243028134; forceNewPlan=false, retain=false 2023-02-12 23:03:48,854 INFO [jenkins-hbase4:43299] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 23:03:48,854 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=62136688e39f6b7225186a0573132e41, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:48,855 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676243028854"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243028854"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243028854"}]},"ts":"1676243028854"} 2023-02-12 23:03:48,856 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 62136688e39f6b7225186a0573132e41, server=jenkins-hbase4.apache.org,41467,1676243028134}] 2023-02-12 23:03:49,009 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:49,009 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 23:03:49,010 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55946, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 23:03:49,014 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41. 2023-02-12 23:03:49,015 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41467%2C1676243028134, suffix=, logDir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/WALs/jenkins-hbase4.apache.org,41467,1676243028134, archiveDir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/oldWALs, maxLogs=32 2023-02-12 23:03:49,028 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43045,DS-16665dca-38f5-49ba-8217-030457ba8696,DISK] 2023-02-12 23:03:49,028 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44091,DS-0072ad62-7fb2-41f0-ba90-0a9f66dc7702,DISK] 2023-02-12 23:03:49,030 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/WALs/jenkins-hbase4.apache.org,41467,1676243028134/jenkins-hbase4.apache.org%2C41467%2C1676243028134.1676243029016 2023-02-12 23:03:49,030 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43045,DS-16665dca-38f5-49ba-8217-030457ba8696,DISK], DatanodeInfoWithStorage[127.0.0.1:44091,DS-0072ad62-7fb2-41f0-ba90-0a9f66dc7702,DISK]] 2023-02-12 23:03:49,030 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 62136688e39f6b7225186a0573132e41, NAME => 'hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:49,030 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 62136688e39f6b7225186a0573132e41 2023-02-12 23:03:49,030 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:49,030 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 62136688e39f6b7225186a0573132e41 2023-02-12 23:03:49,030 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 62136688e39f6b7225186a0573132e41 2023-02-12 23:03:49,031 INFO [StoreOpener-62136688e39f6b7225186a0573132e41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 62136688e39f6b7225186a0573132e41 2023-02-12 23:03:49,032 DEBUG [StoreOpener-62136688e39f6b7225186a0573132e41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/namespace/62136688e39f6b7225186a0573132e41/info 2023-02-12 23:03:49,032 DEBUG [StoreOpener-62136688e39f6b7225186a0573132e41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/namespace/62136688e39f6b7225186a0573132e41/info 2023-02-12 23:03:49,033 INFO [StoreOpener-62136688e39f6b7225186a0573132e41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62136688e39f6b7225186a0573132e41 columnFamilyName info 2023-02-12 23:03:49,033 INFO [StoreOpener-62136688e39f6b7225186a0573132e41-1] regionserver.HStore(310): Store=62136688e39f6b7225186a0573132e41/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:49,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/namespace/62136688e39f6b7225186a0573132e41 2023-02-12 23:03:49,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/namespace/62136688e39f6b7225186a0573132e41 2023-02-12 23:03:49,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 62136688e39f6b7225186a0573132e41 2023-02-12 23:03:49,037 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/namespace/62136688e39f6b7225186a0573132e41/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:49,037 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 62136688e39f6b7225186a0573132e41; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73740554, jitterRate=0.09881988167762756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 23:03:49,037 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 62136688e39f6b7225186a0573132e41: Running coprocessor pre-open hook at 1676243029031Writing region info on filesystem at 1676243029031Initializing all the Stores at 1676243029031Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676243029031Cleaning up temporary data from old regions at 1676243029034 (+3 ms)Cleaning up detritus from prior splits at 1676243029034Running coprocessor post-open hooks at 1676243029037 (+3 ms)Region opened successfully at 1676243029037 2023-02-12 23:03:49,038 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41., pid=6, masterSystemTime=1676243029009 2023-02-12 23:03:49,040 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41. 2023-02-12 23:03:49,043 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41. 2023-02-12 23:03:49,043 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=62136688e39f6b7225186a0573132e41, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:49,043 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676243029043"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243029043"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243029043"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243029043"}]},"ts":"1676243029043"} 2023-02-12 23:03:49,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 23:03:49,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 62136688e39f6b7225186a0573132e41, server=jenkins-hbase4.apache.org,41467,1676243028134 in 188 msec 2023-02-12 23:03:49,047 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 23:03:49,047 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=62136688e39f6b7225186a0573132e41, ASSIGN in 343 msec 2023-02-12 23:03:49,048 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 23:03:49,048 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243029048"}]},"ts":"1676243029048"} 2023-02-12 23:03:49,049 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 23:03:49,051 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 23:03:49,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 380 msec 2023-02-12 23:03:49,073 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 23:03:49,074 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:49,074 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:49,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:49,077 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55954, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:49,078 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 23:03:49,086 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:49,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-12 23:03:49,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 23:03:49,104 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 23:03:49,106 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-12 23:03:49,113 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 23:03:49,115 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 23:03:49,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.958sec 2023-02-12 23:03:49,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 23:03:49,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 23:03:49,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 23:03:49,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43299,1676243028057-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 23:03:49,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43299,1676243028057-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 23:03:49,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 23:03:49,149 DEBUG [Listener at localhost/33843] zookeeper.ReadOnlyZKClient(139): Connect 0x1e712f2e to 127.0.0.1:59961 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:49,152 DEBUG [Listener at localhost/33843] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cb714e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:49,154 DEBUG [hconnection-0x607a2c5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:49,155 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47008, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:49,157 INFO [Listener at localhost/33843] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43299,1676243028057 2023-02-12 23:03:49,157 DEBUG [Listener at localhost/33843] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 23:03:49,159 DEBUG [Listener at localhost/33843] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 23:03:49,160 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54986, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 23:03:49,160 INFO [Listener at localhost/33843] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 23:03:49,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-12 23:03:49,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 23:03:49,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:54986 deadline: 1676243089161, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-12 23:03:49,161 INFO [Listener at localhost/33843] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-12 23:03:49,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 23:03:49,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-12 23:03:49,165 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 23:03:49,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-12 23:03:49,166 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 23:03:49,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:49,167 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:49,167 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec empty. 2023-02-12 23:03:49,167 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:49,167 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 23:03:49,175 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-12 23:03:49,176 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5f7bd93688155031cdc93f6176fd93ec, NAME => 'testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp 2023-02-12 23:03:49,181 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:49,181 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 5f7bd93688155031cdc93f6176fd93ec, disabling compactions & flushes 2023-02-12 23:03:49,181 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:49,181 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:49,181 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. after waiting 0 ms 2023-02-12 23:03:49,181 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:49,181 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:49,181 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 5f7bd93688155031cdc93f6176fd93ec: Waiting for close lock at 1676243029181Disabling compacts and flushes for region at 1676243029181Disabling writes for close at 1676243029181Writing region close event to WAL at 1676243029181Closed at 1676243029181 2023-02-12 23:03:49,183 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 23:03:49,184 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676243029184"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243029184"}]},"ts":"1676243029184"} 2023-02-12 23:03:49,185 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 23:03:49,185 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 23:03:49,186 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243029185"}]},"ts":"1676243029185"} 2023-02-12 23:03:49,187 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-12 23:03:49,189 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 23:03:49,190 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 23:03:49,190 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 23:03:49,190 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 23:03:49,190 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5f7bd93688155031cdc93f6176fd93ec, ASSIGN}] 2023-02-12 23:03:49,191 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5f7bd93688155031cdc93f6176fd93ec, ASSIGN 2023-02-12 23:03:49,191 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5f7bd93688155031cdc93f6176fd93ec, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45953,1676243028111; forceNewPlan=false, retain=false 2023-02-12 23:03:49,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:49,341 INFO [jenkins-hbase4:43299] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 23:03:49,341 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5f7bd93688155031cdc93f6176fd93ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:49,342 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676243029341"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243029341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243029341"}]},"ts":"1676243029341"} 2023-02-12 23:03:49,343 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 5f7bd93688155031cdc93f6176fd93ec, server=jenkins-hbase4.apache.org,45953,1676243028111}] 2023-02-12 23:03:49,424 INFO [RS:0;jenkins-hbase4:45953] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45953%2C1676243028111, suffix=, logDir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/WALs/jenkins-hbase4.apache.org,45953,1676243028111, archiveDir=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/oldWALs, maxLogs=32 2023-02-12 23:03:49,443 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44091,DS-0072ad62-7fb2-41f0-ba90-0a9f66dc7702,DISK] 2023-02-12 23:03:49,443 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43045,DS-16665dca-38f5-49ba-8217-030457ba8696,DISK] 2023-02-12 23:03:49,444 INFO [RS:0;jenkins-hbase4:45953] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/WALs/jenkins-hbase4.apache.org,45953,1676243028111/jenkins-hbase4.apache.org%2C45953%2C1676243028111.1676243029425 2023-02-12 23:03:49,444 DEBUG [RS:0;jenkins-hbase4:45953] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44091,DS-0072ad62-7fb2-41f0-ba90-0a9f66dc7702,DISK], DatanodeInfoWithStorage[127.0.0.1:43045,DS-16665dca-38f5-49ba-8217-030457ba8696,DISK]] 2023-02-12 23:03:49,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:49,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:49,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5f7bd93688155031cdc93f6176fd93ec, NAME => 'testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec.', STARTKEY => '', ENDKEY => ''} 2023-02-12 23:03:49,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:49,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:49,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:49,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:49,499 INFO [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:49,500 DEBUG [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f1 2023-02-12 23:03:49,500 DEBUG [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f1 2023-02-12 23:03:49,501 INFO [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f7bd93688155031cdc93f6176fd93ec columnFamilyName f1 2023-02-12 23:03:49,501 INFO [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] regionserver.HStore(310): Store=5f7bd93688155031cdc93f6176fd93ec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:49,501 INFO [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:49,502 DEBUG [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f2 2023-02-12 23:03:49,502 DEBUG [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f2 2023-02-12 23:03:49,502 INFO [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f7bd93688155031cdc93f6176fd93ec columnFamilyName f2 2023-02-12 23:03:49,503 INFO [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] regionserver.HStore(310): Store=5f7bd93688155031cdc93f6176fd93ec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:49,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:49,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:49,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:49,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:49,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 23:03:49,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5f7bd93688155031cdc93f6176fd93ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60752561, jitterRate=-0.09471629559993744}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:49,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5f7bd93688155031cdc93f6176fd93ec: Running coprocessor pre-open hook at 1676243029498Writing region info on filesystem at 1676243029498Initializing all the Stores at 1676243029499 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243029499Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243029499Cleaning up temporary data from old regions at 1676243029504 (+5 ms)Cleaning up detritus from prior splits at 1676243029504Running coprocessor post-open hooks at 1676243029508 (+4 ms)Region opened successfully at 1676243029508 2023-02-12 23:03:49,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec., pid=12, masterSystemTime=1676243029495 2023-02-12 23:03:49,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:49,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:49,510 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5f7bd93688155031cdc93f6176fd93ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:49,511 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676243029510"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676243029510"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676243029510"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676243029510"}]},"ts":"1676243029510"} 2023-02-12 23:03:49,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 23:03:49,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 5f7bd93688155031cdc93f6176fd93ec, server=jenkins-hbase4.apache.org,45953,1676243028111 in 169 msec 2023-02-12 23:03:49,514 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 23:03:49,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5f7bd93688155031cdc93f6176fd93ec, ASSIGN in 323 msec 2023-02-12 23:03:49,515 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 23:03:49,515 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243029515"}]},"ts":"1676243029515"} 2023-02-12 23:03:49,516 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-12 23:03:49,518 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 23:03:49,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 355 msec 2023-02-12 23:03:49,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 23:03:49,770 INFO [Listener at localhost/33843] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-12 23:03:49,771 DEBUG [Listener at localhost/33843] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-12 23:03:49,771 INFO [Listener at localhost/33843] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 23:03:49,773 INFO [Listener at localhost/33843] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-12 23:03:49,773 INFO [Listener at localhost/33843] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 23:03:49,773 INFO [Listener at localhost/33843] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-12 23:03:49,773 INFO [Listener at localhost/33843] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 23:03:49,807 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45953] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:49,817 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 23:03:49,914 INFO [Listener at localhost/33843] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 23:03:49,915 INFO [Listener at localhost/33843] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 23:03:49,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 23:03:49,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676243029916 (current time:1676243029916). 2023-02-12 23:03:49,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 23:03:49,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] zookeeper.ReadOnlyZKClient(139): Connect 0x6ba96649 to 127.0.0.1:59961 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 23:03:49,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f6a5398, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 23:03:49,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 23:03:49,923 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47014, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 23:03:49,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ba96649 to 127.0.0.1:59961 2023-02-12 23:03:49,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:49,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 23:03:49,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 23:03:49,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 23:03:49,927 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 23:03:49,927 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676243629927 2023-02-12 23:03:49,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 23:03:49,928 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-12 23:03:49,929 DEBUG [Listener at localhost/33843] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 23:03:49,929 DEBUG [Listener at localhost/33843] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 23:03:49,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 23:03:49,929 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 23:03:49,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-12 23:03:49,931 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 23:03:49,931 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676243629931 2023-02-12 23:03:49,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-12 23:03:49,942 INFO [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-12 23:03:49,942 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:49,943 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-12 23:03:49,943 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-12 23:03:49,943 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 23:03:49,944 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 23:03:49,945 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:49,945 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:49,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:49,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:49,945 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:49,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:49,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:49,945 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:49,945 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 23:03:49,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 23:03:49,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 23:03:49,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 23:03:49,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 23:03:49,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-12 23:03:49,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 23:03:49,946 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-12 23:03:49,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-12 23:03:49,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 23:03:49,946 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-12 23:03:49,947 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-12 23:03:49,947 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-12 23:03:49,948 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-12 23:03:49,948 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-12 23:03:49,948 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:49,948 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 23:03:49,949 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 23:03:49,949 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-12 23:03:49,951 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 23:03:49,951 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41467,1676243028134' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-12 23:03:49,951 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-12 23:03:49,951 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45953,1676243028111' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-12 23:03:49,952 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:49,952 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 23:03:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:49,952 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 23:03:49,953 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 23:03:49,953 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:49,953 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 23:03:49,953 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 23:03:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:49,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45953,1676243028111' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-12 23:03:49,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b70978b[Count = 0] remaining members to acquire global barrier 2023-02-12 23:03:49,955 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-12 23:03:49,955 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 23:03:49,957 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 23:03:49,957 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 23:03:49,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 23:03:49,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 23:03:49,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 23:03:49,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 23:03:49,957 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 23:03:49,957 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 23:03:49,957 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-12 23:03:49,957 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,41467,1676243028134' in zk 2023-02-12 23:03:49,959 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-12 23:03:49,959 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:49,959 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-12 23:03:49,959 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:49,959 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 23:03:49,960 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 23:03:49,960 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 23:03:49,960 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:49,960 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. started... 2023-02-12 23:03:49,960 INFO [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5f7bd93688155031cdc93f6176fd93ec 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 23:03:49,981 INFO [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/.tmp/f1/51e7228019b94af2addc2bd18a5d2064 2023-02-12 23:03:50,001 INFO [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/.tmp/f2/ee11f3e5b8d64fb79e5797f51c07bf81 2023-02-12 23:03:50,005 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/.tmp/f1/51e7228019b94af2addc2bd18a5d2064 as hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f1/51e7228019b94af2addc2bd18a5d2064 2023-02-12 23:03:50,009 INFO [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f1/51e7228019b94af2addc2bd18a5d2064, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 23:03:50,009 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/.tmp/f2/ee11f3e5b8d64fb79e5797f51c07bf81 as hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f2/ee11f3e5b8d64fb79e5797f51c07bf81 2023-02-12 23:03:50,013 INFO [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f2/ee11f3e5b8d64fb79e5797f51c07bf81, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 23:03:50,014 INFO [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 5f7bd93688155031cdc93f6176fd93ec in 54ms, sequenceid=5, compaction requested=false 2023-02-12 23:03:50,014 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5f7bd93688155031cdc93f6176fd93ec: 2023-02-12 23:03:50,014 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-12 23:03:50,014 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 23:03:50,014 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f1/51e7228019b94af2addc2bd18a5d2064] hfiles 2023-02-12 23:03:50,015 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f1/51e7228019b94af2addc2bd18a5d2064 for snapshot=testWithMapReduceSingleRegion 2023-02-12 23:03:50,015 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f2/ee11f3e5b8d64fb79e5797f51c07bf81] hfiles 2023-02-12 23:03:50,015 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f2/ee11f3e5b8d64fb79e5797f51c07bf81 for snapshot=testWithMapReduceSingleRegion 2023-02-12 23:03:50,028 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. completed. 2023-02-12 23:03:50,028 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 23:03:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 23:03:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-12 23:03:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,45953,1676243028111' in zk 2023-02-12 23:03:50,029 DEBUG [Listener at localhost/33843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:50,030 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,030 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-12 23:03:50,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:50,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:50,030 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:50,030 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-12 23:03:50,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 23:03:50,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 23:03:50,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:50,031 DEBUG [Listener at localhost/33843] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 23:03:50,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:50,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 23:03:50,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:50,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 23:03:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,45953,1676243028111': 2023-02-12 23:03:50,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45953,1676243028111' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-12 23:03:50,033 INFO [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-12 23:03:50,033 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 23:03:50,034 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 23:03:50,034 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-12 23:03:50,034 INFO [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 23:03:50,035 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 23:03:50,035 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 23:03:50,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 23:03:50,035 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 23:03:50,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 23:03:50,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 23:03:50,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:50,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 23:03:50,035 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:50,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 23:03:50,035 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:50,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 23:03:50,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:50,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:50,036 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:50,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:50,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:50,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 23:03:50,036 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 23:03:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 23:03:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 23:03:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,038 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:50,038 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 23:03:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,045 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,045 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:50,045 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 23:03:50,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:50,045 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:50,045 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 23:03:50,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:50,045 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-12 23:03:50,045 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:50,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-12 23:03:50,045 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 23:03:50,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 23:03:50,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 23:03:50,045 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,045 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 23:03:50,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:50,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:50,045 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,045 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 23:03:50,046 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,046 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 23:03:50,046 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 23:03:50,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-12 23:03:50,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 23:03:50,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 23:03:50,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-12 23:03:50,086 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-12 23:03:50,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-12 23:03:50,087 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-12 23:03:50,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676243029928Consolidate snapshot: testWithMapReduceSingleRegion at 1676243030045 (+117 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676243030045Writing data manifest for testWithMapReduceSingleRegion at 1676243030048 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676243030058 (+10 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676243030086 (+28 ms) 2023-02-12 23:03:50,088 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 23:03:50,089 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 159 msec 2023-02-12 23:03:50,231 DEBUG [Listener at localhost/33843] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 23:03:50,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 23:03:50,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 23:03:50,232 INFO [Listener at localhost/33843] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 23:03:50,236 INFO [Listener at localhost/33843] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 23:03:50,240 INFO [Listener at localhost/33843] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 23:03:50,271 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45953] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:50,352 INFO [Listener at localhost/33843] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 23:03:50,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 23:03:50,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-12 23:03:50,358 INFO [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-12 23:03:50,358 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:50,358 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-12 23:03:50,358 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-12 23:03:50,359 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:50,359 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:50,360 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:50,360 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:50,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:50,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:50,360 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:50,361 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,361 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 23:03:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:50,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:50,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 23:03:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:50,361 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 23:03:50,362 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 23:03:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 23:03:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:50,362 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 23:03:50,362 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 23:03:50,362 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:50,362 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 23:03:50,362 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 23:03:50,362 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41467,1676243028134' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 23:03:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:50,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 23:03:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 23:03:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 23:03:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 23:03:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 23:03:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 23:03:50,364 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:50,364 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. started... 2023-02-12 23:03:50,365 INFO [rs(jenkins-hbase4.apache.org,45953,1676243028111)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5f7bd93688155031cdc93f6176fd93ec 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 23:03:50,380 INFO [rs(jenkins-hbase4.apache.org,45953,1676243028111)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/.tmp/f1/d570156239fe440b84feeed37ff08c59 2023-02-12 23:03:50,405 INFO [rs(jenkins-hbase4.apache.org,45953,1676243028111)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/.tmp/f2/c44bd558b94d440bb9a2f701c9e69db8 2023-02-12 23:03:50,409 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/.tmp/f1/d570156239fe440b84feeed37ff08c59 as hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f1/d570156239fe440b84feeed37ff08c59 2023-02-12 23:03:50,413 INFO [rs(jenkins-hbase4.apache.org,45953,1676243028111)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f1/d570156239fe440b84feeed37ff08c59, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 23:03:50,414 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/.tmp/f2/c44bd558b94d440bb9a2f701c9e69db8 as hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f2/c44bd558b94d440bb9a2f701c9e69db8 2023-02-12 23:03:50,418 INFO [rs(jenkins-hbase4.apache.org,45953,1676243028111)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f2/c44bd558b94d440bb9a2f701c9e69db8, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 23:03:50,418 INFO [rs(jenkins-hbase4.apache.org,45953,1676243028111)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 5f7bd93688155031cdc93f6176fd93ec in 53ms, sequenceid=9, compaction requested=false 2023-02-12 23:03:50,418 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5f7bd93688155031cdc93f6176fd93ec: 2023-02-12 23:03:50,418 DEBUG [rs(jenkins-hbase4.apache.org,45953,1676243028111)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:50,418 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 23:03:50,419 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 23:03:50,419 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,419 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 23:03:50,419 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45953,1676243028111' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 23:03:50,420 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,420 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:50,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:50,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:50,421 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:50,421 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 23:03:50,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:50,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:50,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:50,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:50,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45953,1676243028111' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 23:03:50,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f4f1c3d[Count = 0] remaining members to acquire global barrier 2023-02-12 23:03:50,423 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-12 23:03:50,423 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:50,428 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:50,428 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:50,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:50,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:50,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:50,428 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,428 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 23:03:50,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:50,428 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 23:03:50,428 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 23:03:50,428 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 23:03:50,429 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 23:03:50,429 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,45953,1676243028111' in zk 2023-02-12 23:03:50,428 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,41467,1676243028134' in zk 2023-02-12 23:03:50,430 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 23:03:50,430 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:50,430 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,430 DEBUG [member: 'jenkins-hbase4.apache.org,41467,1676243028134' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 23:03:50,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:50,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:50,431 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 23:03:50,431 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:50,431 DEBUG [member: 'jenkins-hbase4.apache.org,45953,1676243028111' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 23:03:50,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:50,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:50,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:50,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:50,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:50,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,45953,1676243028111': 2023-02-12 23:03:50,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45953,1676243028111' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-12 23:03:50,434 INFO [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-12 23:03:50,434 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 23:03:50,434 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 23:03:50,434 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-12 23:03:50,434 INFO [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 23:03:50,436 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:50,436 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:50,436 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:50,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:50,436 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:50,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:50,436 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:50,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:50,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:50,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:50,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 23:03:50,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 23:03:50,436 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:50,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:50,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:50,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:50,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:50,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:50,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 23:03:50,438 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:50,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 23:03:50,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:50,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,439 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,440 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 23:03:50,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 23:03:50,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,442 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,442 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:50,442 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:50,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:50,442 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 23:03:50,442 DEBUG [(jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 23:03:50,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 23:03:50,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:50,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMapReduce because node does not exist (not an error) 2023-02-12 23:03:50,442 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:50,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-12 23:03:50,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 23:03:50,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 23:03:50,442 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 23:03:50,442 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,443 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 23:03:50,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:50,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:50,443 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:50,443 DEBUG [Listener at localhost/33843] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-12 23:03:50,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 23:03:50,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 23:03:50,443 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:50,443 DEBUG [Listener at localhost/33843] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 23:03:50,443 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:50,444 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 23:03:50,444 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 23:03:50,544 DEBUG [Listener at localhost/33843] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 23:03:50,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 23:03:50,631 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/hadoop-3416328492674558457.jar 2023-02-12 23:03:50,635 INFO [Listener at localhost/33843] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676243029916 type: FLUSH version: 2 ttl: 0 2023-02-12 23:03:50,635 DEBUG [Listener at localhost/33843] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35937/user/jenkins/test-data/5bd7bc99-b18e-ebe8-f519-37e165c63da7/testWithMapReduceSingleRegion/3b6f2ef1-7fa9-4029-810f-d3e189694b9a/data/default/testWithMapReduce 2023-02-12 23:03:50,635 INFO [Listener at localhost/33843] snapshot.RestoreSnapshotHelper(239): region to add: 5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:50,635 INFO [Listener at localhost/33843] snapshot.RestoreSnapshotHelper(585): clone region=5f7bd93688155031cdc93f6176fd93ec as 5f7bd93688155031cdc93f6176fd93ec in snapshot testWithMapReduceSingleRegion 2023-02-12 23:03:50,636 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5f7bd93688155031cdc93f6176fd93ec, NAME => 'testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35937/user/jenkins/test-data/5bd7bc99-b18e-ebe8-f519-37e165c63da7/testWithMapReduceSingleRegion/3b6f2ef1-7fa9-4029-810f-d3e189694b9a 2023-02-12 23:03:50,642 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:50,642 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 51e7228019b94af2addc2bd18a5d2064 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-12 23:03:50,644 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ee11f3e5b8d64fb79e5797f51c07bf81 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-12 23:03:50,645 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 5f7bd93688155031cdc93f6176fd93ec, disabling compactions & flushes 2023-02-12 23:03:50,645 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:50,645 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:50,645 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. after waiting 0 ms 2023-02-12 23:03:50,645 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:50,645 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:50,645 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 5f7bd93688155031cdc93f6176fd93ec: Waiting for close lock at 1676243030645Disabling compacts and flushes for region at 1676243030645Disabling writes for close at 1676243030645Writing region close event to WAL at 1676243030645Closed at 1676243030645 2023-02-12 23:03:50,645 INFO [Listener at localhost/33843] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676243029916 type: FLUSH version: 2 ttl: 0 2023-02-12 23:03:50,646 DEBUG [Listener at localhost/33843] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35937/user/jenkins/test-data/5bd7bc99-b18e-ebe8-f519-37e165c63da7/testWithMapReduceSingleRegion/3b6f2ef1-7fa9-4029-810f-d3e189694b9a 2023-02-12 23:03:50,646 DEBUG [Listener at localhost/33843] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35937/user/jenkins/test-data/5bd7bc99-b18e-ebe8-f519-37e165c63da7/testWithMapReduceSingleRegion/3b6f2ef1-7fa9-4029-810f-d3e189694b9a 2023-02-12 23:03:50,646 DEBUG [Listener at localhost/33843] util.CommonFSUtils(699): |-data/ 2023-02-12 23:03:50,646 DEBUG [Listener at localhost/33843] util.CommonFSUtils(699): |----default/ 2023-02-12 23:03:50,647 DEBUG [Listener at localhost/33843] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-12 23:03:50,647 DEBUG [Listener at localhost/33843] util.CommonFSUtils(699): |----------5f7bd93688155031cdc93f6176fd93ec/ 2023-02-12 23:03:50,647 DEBUG [Listener at localhost/33843] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 23:03:50,647 DEBUG [Listener at localhost/33843] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 23:03:50,648 DEBUG [Listener at localhost/33843] util.CommonFSUtils(702): |----------------testWithMapReduce=5f7bd93688155031cdc93f6176fd93ec-51e7228019b94af2addc2bd18a5d2064 2023-02-12 23:03:50,648 DEBUG [Listener at localhost/33843] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 23:03:50,648 DEBUG [Listener at localhost/33843] util.CommonFSUtils(702): |----------------testWithMapReduce=5f7bd93688155031cdc93f6176fd93ec-ee11f3e5b8d64fb79e5797f51c07bf81 2023-02-12 23:03:50,648 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:50,649 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:50,649 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:50,650 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:50,650 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:50,651 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:50,651 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:50,717 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/hadoop-7114061200907540385.jar 2023-02-12 23:03:50,717 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:50,718 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:50,718 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:50,718 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:50,719 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:50,719 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:50,719 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-12 23:03:50,720 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-12 23:03:50,720 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-12 23:03:50,720 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-12 23:03:50,721 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-12 23:03:50,721 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-12 23:03:50,721 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-12 23:03:50,722 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-12 23:03:50,722 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-12 23:03:50,723 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-12 23:03:50,723 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 23:03:50,723 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 23:03:50,723 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 23:03:50,724 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 23:03:50,724 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 23:03:50,790 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/hadoop-2574259741840144612.jar 2023-02-12 23:03:50,790 DEBUG [Listener at localhost/33843] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 23:03:50,795 WARN [Listener at localhost/33843] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-12 23:03:50,826 INFO [Listener at localhost/33843] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 23:03:50,903 WARN [Listener at localhost/33843] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/mapreduce.cluster.local.dir/1676243030870/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-12 23:03:50,904 WARN [Listener at localhost/33843] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/mapreduce.cluster.local.dir/1676243030870/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-12 23:03:50,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 23:03:50,934 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 23:03:50,934 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 23:03:50,936 INFO [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:50,937 DEBUG [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/5bd7bc99-b18e-ebe8-f519-37e165c63da7/testWithMapReduceSingleRegion/3b6f2ef1-7fa9-4029-810f-d3e189694b9a/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f1 2023-02-12 23:03:50,937 INFO [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f7bd93688155031cdc93f6176fd93ec columnFamilyName f1 2023-02-12 23:03:50,941 DEBUG [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] regionserver.HStore(539): loaded hdfs://localhost:35937/user/jenkins/test-data/5bd7bc99-b18e-ebe8-f519-37e165c63da7/testWithMapReduceSingleRegion/3b6f2ef1-7fa9-4029-810f-d3e189694b9a/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f1/testWithMapReduce=5f7bd93688155031cdc93f6176fd93ec-51e7228019b94af2addc2bd18a5d2064 2023-02-12 23:03:50,941 INFO [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] regionserver.HStore(310): Store=5f7bd93688155031cdc93f6176fd93ec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:50,941 INFO [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:50,942 DEBUG [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35937/user/jenkins/test-data/5bd7bc99-b18e-ebe8-f519-37e165c63da7/testWithMapReduceSingleRegion/3b6f2ef1-7fa9-4029-810f-d3e189694b9a/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f2 2023-02-12 23:03:50,942 INFO [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f7bd93688155031cdc93f6176fd93ec columnFamilyName f2 2023-02-12 23:03:50,946 DEBUG [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] regionserver.HStore(539): loaded hdfs://localhost:35937/user/jenkins/test-data/5bd7bc99-b18e-ebe8-f519-37e165c63da7/testWithMapReduceSingleRegion/3b6f2ef1-7fa9-4029-810f-d3e189694b9a/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f2/testWithMapReduce=5f7bd93688155031cdc93f6176fd93ec-ee11f3e5b8d64fb79e5797f51c07bf81 2023-02-12 23:03:50,946 INFO [StoreOpener-5f7bd93688155031cdc93f6176fd93ec-1] regionserver.HStore(310): Store=5f7bd93688155031cdc93f6176fd93ec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 23:03:50,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 23:03:50,946 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5f7bd93688155031cdc93f6176fd93ec; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66932099, jitterRate=-0.002634003758430481}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 23:03:50,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5f7bd93688155031cdc93f6176fd93ec: Writing region info on filesystem at 1676243030934Initializing all the Stores at 1676243030935 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243030935Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676243030935Region opened successfully at 1676243030946 (+11 ms) 2023-02-12 23:03:51,074 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5f7bd93688155031cdc93f6176fd93ec, disabling compactions & flushes 2023-02-12 23:03:51,074 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:51,074 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:51,074 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. after waiting 0 ms 2023-02-12 23:03:51,074 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:51,075 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:51,075 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5f7bd93688155031cdc93f6176fd93ec: Waiting for close lock at 1676243031074Disabling compacts and flushes for region at 1676243031074Disabling writes for close at 1676243031074Writing region close event to WAL at 1676243031075 (+1 ms)Closed at 1676243031075 2023-02-12 23:03:51,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-12 23:03:51,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-12 23:03:51,940 INFO [Listener at localhost/33843] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 23:03:51,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-12 23:03:51,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-12 23:03:51,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 23:03:51,944 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243031944"}]},"ts":"1676243031944"} 2023-02-12 23:03:51,945 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-12 23:03:51,947 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-12 23:03:51,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5f7bd93688155031cdc93f6176fd93ec, UNASSIGN}] 2023-02-12 23:03:51,948 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5f7bd93688155031cdc93f6176fd93ec, UNASSIGN 2023-02-12 23:03:51,948 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5f7bd93688155031cdc93f6176fd93ec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:51,949 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676243031948"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676243031948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676243031948"}]},"ts":"1676243031948"} 2023-02-12 23:03:51,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 5f7bd93688155031cdc93f6176fd93ec, server=jenkins-hbase4.apache.org,45953,1676243028111}] 2023-02-12 23:03:52,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 23:03:52,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:52,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5f7bd93688155031cdc93f6176fd93ec, disabling compactions & flushes 2023-02-12 23:03:52,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:52,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:52,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. after waiting 0 ms 2023-02-12 23:03:52,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:52,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 23:03:52,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec. 2023-02-12 23:03:52,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5f7bd93688155031cdc93f6176fd93ec: Waiting for close lock at 1676243032102Running coprocessor pre-close hooks at 1676243032102Disabling compacts and flushes for region at 1676243032102Disabling writes for close at 1676243032102Writing region close event to WAL at 1676243032103 (+1 ms)Running coprocessor post-close hooks at 1676243032107 (+4 ms)Closed at 1676243032109 (+2 ms) 2023-02-12 23:03:52,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:52,111 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5f7bd93688155031cdc93f6176fd93ec, regionState=CLOSED 2023-02-12 23:03:52,111 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676243032111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676243032111"}]},"ts":"1676243032111"} 2023-02-12 23:03:52,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 23:03:52,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 5f7bd93688155031cdc93f6176fd93ec, server=jenkins-hbase4.apache.org,45953,1676243028111 in 162 msec 2023-02-12 23:03:52,115 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 23:03:52,115 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5f7bd93688155031cdc93f6176fd93ec, UNASSIGN in 167 msec 2023-02-12 23:03:52,116 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676243032115"}]},"ts":"1676243032115"} 2023-02-12 23:03:52,117 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-12 23:03:52,118 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-12 23:03:52,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 178 msec 2023-02-12 23:03:52,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 23:03:52,246 INFO [Listener at localhost/33843] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-12 23:03:52,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-12 23:03:52,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-12 23:03:52,249 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 23:03:52,250 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 23:03:52,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 23:03:52,253 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:52,254 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f1, FileablePath, hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f2, FileablePath, hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/recovered.edits] 2023-02-12 23:03:52,257 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f1/51e7228019b94af2addc2bd18a5d2064 to hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/archive/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f1/51e7228019b94af2addc2bd18a5d2064 2023-02-12 23:03:52,258 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f1/d570156239fe440b84feeed37ff08c59 to hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/archive/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f1/d570156239fe440b84feeed37ff08c59 2023-02-12 23:03:52,261 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f2/c44bd558b94d440bb9a2f701c9e69db8 to hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/archive/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f2/c44bd558b94d440bb9a2f701c9e69db8 2023-02-12 23:03:52,262 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f2/ee11f3e5b8d64fb79e5797f51c07bf81 to hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/archive/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/f2/ee11f3e5b8d64fb79e5797f51c07bf81 2023-02-12 23:03:52,264 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/recovered.edits/12.seqid to hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/archive/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec/recovered.edits/12.seqid 2023-02-12 23:03:52,264 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/.tmp/data/default/testWithMapReduce/5f7bd93688155031cdc93f6176fd93ec 2023-02-12 23:03:52,264 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 23:03:52,266 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 23:03:52,267 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-12 23:03:52,269 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-12 23:03:52,270 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 23:03:52,270 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-12 23:03:52,270 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676243032270"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:52,271 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 23:03:52,271 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5f7bd93688155031cdc93f6176fd93ec, NAME => 'testWithMapReduce,,1676243029163.5f7bd93688155031cdc93f6176fd93ec.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 23:03:52,271 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-12 23:03:52,271 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676243032271"}]},"ts":"9223372036854775807"} 2023-02-12 23:03:52,273 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-12 23:03:52,275 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 23:03:52,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 28 msec 2023-02-12 23:03:52,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 23:03:52,352 INFO [Listener at localhost/33843] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-12 23:03:52,352 INFO [Listener at localhost/33843] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 23:03:52,352 INFO [Listener at localhost/33843] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 23:03:52,352 DEBUG [Listener at localhost/33843] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e712f2e to 127.0.0.1:59961 2023-02-12 23:03:52,352 DEBUG [Listener at localhost/33843] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:52,352 DEBUG [Listener at localhost/33843] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 23:03:52,352 DEBUG [Listener at localhost/33843] util.JVMClusterUtil(257): Found active master hash=1351999188, stopped=false 2023-02-12 23:03:52,353 INFO [Listener at localhost/33843] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43299,1676243028057 2023-02-12 23:03:52,355 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:52,355 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:52,355 INFO [Listener at localhost/33843] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 23:03:52,355 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 23:03:52,355 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:52,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:52,358 DEBUG [Listener at localhost/33843] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6eaea8be to 127.0.0.1:59961 2023-02-12 23:03:52,358 DEBUG [Listener at localhost/33843] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:52,359 INFO [Listener at localhost/33843] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45953,1676243028111' ***** 2023-02-12 23:03:52,359 INFO [Listener at localhost/33843] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 23:03:52,359 INFO [Listener at localhost/33843] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41467,1676243028134' ***** 2023-02-12 23:03:52,359 INFO [Listener at localhost/33843] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 23:03:52,359 INFO [RS:1;jenkins-hbase4:41467] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 23:03:52,359 INFO [RS:0;jenkins-hbase4:45953] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 23:03:52,359 INFO [RS:0;jenkins-hbase4:45953] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 23:03:52,359 INFO [RS:1;jenkins-hbase4:41467] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 23:03:52,359 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 23:03:52,359 INFO [RS:1;jenkins-hbase4:41467] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 23:03:52,359 INFO [RS:0;jenkins-hbase4:45953] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 23:03:52,360 INFO [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer(3304): Received CLOSE for 62136688e39f6b7225186a0573132e41 2023-02-12 23:03:52,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:52,359 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 23:03:52,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 23:03:52,360 INFO [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:52,361 INFO [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:52,361 DEBUG [RS:1;jenkins-hbase4:41467] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1592265d to 127.0.0.1:59961 2023-02-12 23:03:52,361 DEBUG [RS:0;jenkins-hbase4:45953] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1292b289 to 127.0.0.1:59961 2023-02-12 23:03:52,361 DEBUG [RS:1;jenkins-hbase4:41467] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:52,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 62136688e39f6b7225186a0573132e41, disabling compactions & flushes 2023-02-12 23:03:52,361 DEBUG [RS:0;jenkins-hbase4:45953] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:52,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41. 2023-02-12 23:03:52,362 INFO [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 23:03:52,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41. 2023-02-12 23:03:52,362 INFO [RS:0;jenkins-hbase4:45953] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 23:03:52,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41. after waiting 0 ms 2023-02-12 23:03:52,362 DEBUG [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer(1479): Online Regions={62136688e39f6b7225186a0573132e41=hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41.} 2023-02-12 23:03:52,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41. 2023-02-12 23:03:52,362 INFO [RS:0;jenkins-hbase4:45953] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 23:03:52,362 INFO [RS:0;jenkins-hbase4:45953] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 23:03:52,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 62136688e39f6b7225186a0573132e41 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 23:03:52,362 DEBUG [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer(1505): Waiting on 62136688e39f6b7225186a0573132e41 2023-02-12 23:03:52,362 INFO [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 23:03:52,362 INFO [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 23:03:52,362 DEBUG [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 23:03:52,362 DEBUG [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 23:03:52,362 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 23:03:52,363 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 23:03:52,363 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 23:03:52,363 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 23:03:52,363 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 23:03:52,363 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-12 23:03:52,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/namespace/62136688e39f6b7225186a0573132e41/.tmp/info/e24afa7312f34e0aa9d57791eaa667d5 2023-02-12 23:03:52,375 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/.tmp/info/26401dce246f4f3c830b7bd6f737509c 2023-02-12 23:03:52,378 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26401dce246f4f3c830b7bd6f737509c 2023-02-12 23:03:52,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/namespace/62136688e39f6b7225186a0573132e41/.tmp/info/e24afa7312f34e0aa9d57791eaa667d5 as hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/namespace/62136688e39f6b7225186a0573132e41/info/e24afa7312f34e0aa9d57791eaa667d5 2023-02-12 23:03:52,429 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:52,429 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:52,429 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-12 23:03:52,431 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-12 23:03:52,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/namespace/62136688e39f6b7225186a0573132e41/info/e24afa7312f34e0aa9d57791eaa667d5, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 23:03:52,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 62136688e39f6b7225186a0573132e41 in 74ms, sequenceid=6, compaction requested=false 2023-02-12 23:03:52,437 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-12 23:03:52,437 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-12 23:03:52,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/namespace/62136688e39f6b7225186a0573132e41/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 23:03:52,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41. 2023-02-12 23:03:52,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 62136688e39f6b7225186a0573132e41: Waiting for close lock at 1676243032361Running coprocessor pre-close hooks at 1676243032361Disabling compacts and flushes for region at 1676243032361Disabling writes for close at 1676243032362 (+1 ms)Obtaining lock to block concurrent updates at 1676243032362Preparing flush snapshotting stores in 62136688e39f6b7225186a0573132e41 at 1676243032362Finished memstore snapshotting hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676243032362Flushing stores of hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41. at 1676243032363 (+1 ms)Flushing 62136688e39f6b7225186a0573132e41/info: creating writer at 1676243032363Flushing 62136688e39f6b7225186a0573132e41/info: appending metadata at 1676243032365 (+2 ms)Flushing 62136688e39f6b7225186a0573132e41/info: closing flushed file at 1676243032365Flushing 62136688e39f6b7225186a0573132e41/info: reopening flushed file at 1676243032379 (+14 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 62136688e39f6b7225186a0573132e41 in 74ms, sequenceid=6, compaction requested=false at 1676243032437 (+58 ms)Writing region close event to WAL at 1676243032437Running coprocessor post-close hooks at 1676243032440 (+3 ms)Closed at 1676243032440 2023-02-12 23:03:52,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676243028671.62136688e39f6b7225186a0573132e41. 2023-02-12 23:03:52,562 INFO [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41467,1676243028134; all regions closed. 2023-02-12 23:03:52,563 DEBUG [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 23:03:52,566 DEBUG [RS:1;jenkins-hbase4:41467] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/oldWALs 2023-02-12 23:03:52,566 INFO [RS:1;jenkins-hbase4:41467] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41467%2C1676243028134:(num 1676243029016) 2023-02-12 23:03:52,566 DEBUG [RS:1;jenkins-hbase4:41467] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:52,566 INFO [RS:1;jenkins-hbase4:41467] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:52,566 INFO [RS:1;jenkins-hbase4:41467] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 23:03:52,566 INFO [RS:1;jenkins-hbase4:41467] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 23:03:52,566 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:52,566 INFO [RS:1;jenkins-hbase4:41467] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 23:03:52,566 INFO [RS:1;jenkins-hbase4:41467] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 23:03:52,568 INFO [RS:1;jenkins-hbase4:41467] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41467 2023-02-12 23:03:52,569 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:52,569 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:52,569 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:52,569 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41467,1676243028134 2023-02-12 23:03:52,569 ERROR [Listener at localhost/33843-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@fec2fd2 rejected from java.util.concurrent.ThreadPoolExecutor@bd3baf7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:52,569 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:52,569 ERROR [Listener at localhost/33843-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1129725d rejected from java.util.concurrent.ThreadPoolExecutor@bd3baf7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:52,570 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41467,1676243028134] 2023-02-12 23:03:52,570 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41467,1676243028134; numProcessing=1 2023-02-12 23:03:52,571 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41467,1676243028134 already deleted, retry=false 2023-02-12 23:03:52,571 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41467,1676243028134 expired; onlineServers=1 2023-02-12 23:03:52,763 DEBUG [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 23:03:52,839 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/.tmp/rep_barrier/8ae87af7375c40b8a4e0340460d30cdc 2023-02-12 23:03:52,843 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ae87af7375c40b8a4e0340460d30cdc 2023-02-12 23:03:52,849 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/.tmp/table/0bde5969934e4da19af020a77c6792ef 2023-02-12 23:03:52,852 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0bde5969934e4da19af020a77c6792ef 2023-02-12 23:03:52,853 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/.tmp/info/26401dce246f4f3c830b7bd6f737509c as hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/info/26401dce246f4f3c830b7bd6f737509c 2023-02-12 23:03:52,856 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:52,856 INFO [RS:1;jenkins-hbase4:41467] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41467,1676243028134; zookeeper connection closed. 2023-02-12 23:03:52,856 ERROR [Listener at localhost/33843-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6947440a rejected from java.util.concurrent.ThreadPoolExecutor@bd3baf7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:52,856 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:41467-0x1004ac6b20e0002, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:52,856 ERROR [Listener at localhost/33843-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@749ffebe rejected from java.util.concurrent.ThreadPoolExecutor@bd3baf7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:52,856 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1d50b293] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1d50b293 2023-02-12 23:03:52,857 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26401dce246f4f3c830b7bd6f737509c 2023-02-12 23:03:52,857 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/info/26401dce246f4f3c830b7bd6f737509c, entries=12, sequenceid=21, filesize=6.2 K 2023-02-12 23:03:52,858 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/.tmp/rep_barrier/8ae87af7375c40b8a4e0340460d30cdc as hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/rep_barrier/8ae87af7375c40b8a4e0340460d30cdc 2023-02-12 23:03:52,861 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ae87af7375c40b8a4e0340460d30cdc 2023-02-12 23:03:52,861 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/rep_barrier/8ae87af7375c40b8a4e0340460d30cdc, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 23:03:52,861 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/.tmp/table/0bde5969934e4da19af020a77c6792ef as hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/table/0bde5969934e4da19af020a77c6792ef 2023-02-12 23:03:52,864 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0bde5969934e4da19af020a77c6792ef 2023-02-12 23:03:52,864 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/table/0bde5969934e4da19af020a77c6792ef, entries=4, sequenceid=21, filesize=5.0 K 2023-02-12 23:03:52,865 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 502ms, sequenceid=21, compaction requested=false 2023-02-12 23:03:52,868 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 23:03:52,868 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 23:03:52,868 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:52,868 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676243032362Running coprocessor pre-close hooks at 1676243032362Disabling compacts and flushes for region at 1676243032362Disabling writes for close at 1676243032363 (+1 ms)Obtaining lock to block concurrent updates at 1676243032363Preparing flush snapshotting stores in 1588230740 at 1676243032363Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1676243032363Flushing stores of hbase:meta,,1.1588230740 at 1676243032363Flushing 1588230740/info: creating writer at 1676243032363Flushing 1588230740/info: appending metadata at 1676243032365 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676243032365Flushing 1588230740/rep_barrier: creating writer at 1676243032378 (+13 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676243032433 (+55 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676243032433Flushing 1588230740/table: creating writer at 1676243032843 (+410 ms)Flushing 1588230740/table: appending metadata at 1676243032845 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676243032845Flushing 1588230740/info: reopening flushed file at 1676243032853 (+8 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676243032858 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676243032862 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 502ms, sequenceid=21, compaction requested=false at 1676243032865 (+3 ms)Writing region close event to WAL at 1676243032866 (+1 ms)Running coprocessor post-close hooks at 1676243032868 (+2 ms)Closed at 1676243032868 2023-02-12 23:03:52,868 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 23:03:52,963 INFO [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45953,1676243028111; all regions closed. 2023-02-12 23:03:52,967 DEBUG [RS:0;jenkins-hbase4:45953] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/oldWALs 2023-02-12 23:03:52,967 INFO [RS:0;jenkins-hbase4:45953] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45953%2C1676243028111.meta:.meta(num 1676243028625) 2023-02-12 23:03:52,970 DEBUG [RS:0;jenkins-hbase4:45953] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/oldWALs 2023-02-12 23:03:52,970 INFO [RS:0;jenkins-hbase4:45953] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45953%2C1676243028111:(num 1676243029425) 2023-02-12 23:03:52,970 DEBUG [RS:0;jenkins-hbase4:45953] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:52,970 INFO [RS:0;jenkins-hbase4:45953] regionserver.LeaseManager(133): Closed leases 2023-02-12 23:03:52,970 INFO [RS:0;jenkins-hbase4:45953] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 23:03:52,970 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:52,973 INFO [RS:0;jenkins-hbase4:45953] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45953 2023-02-12 23:03:52,975 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45953,1676243028111 2023-02-12 23:03:52,975 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 23:03:52,975 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45953,1676243028111] 2023-02-12 23:03:52,975 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45953,1676243028111; numProcessing=2 2023-02-12 23:03:52,976 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45953,1676243028111 already deleted, retry=false 2023-02-12 23:03:52,976 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45953,1676243028111 expired; onlineServers=0 2023-02-12 23:03:52,976 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43299,1676243028057' ***** 2023-02-12 23:03:52,976 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 23:03:52,977 DEBUG [M:0;jenkins-hbase4:43299] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54aa401e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 23:03:52,977 INFO [M:0;jenkins-hbase4:43299] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43299,1676243028057 2023-02-12 23:03:52,977 INFO [M:0;jenkins-hbase4:43299] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43299,1676243028057; all regions closed. 2023-02-12 23:03:52,977 DEBUG [M:0;jenkins-hbase4:43299] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 23:03:52,977 DEBUG [M:0;jenkins-hbase4:43299] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 23:03:52,977 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 23:03:52,977 DEBUG [M:0;jenkins-hbase4:43299] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 23:03:52,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676243028275] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676243028275,5,FailOnTimeoutGroup] 2023-02-12 23:03:52,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676243028275] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676243028275,5,FailOnTimeoutGroup] 2023-02-12 23:03:52,977 INFO [M:0;jenkins-hbase4:43299] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 23:03:52,979 INFO [M:0;jenkins-hbase4:43299] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 23:03:52,979 INFO [M:0;jenkins-hbase4:43299] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 23:03:52,979 DEBUG [M:0;jenkins-hbase4:43299] master.HMaster(1502): Stopping service threads 2023-02-12 23:03:52,979 INFO [M:0;jenkins-hbase4:43299] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 23:03:52,980 ERROR [M:0;jenkins-hbase4:43299] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 23:03:52,980 INFO [M:0;jenkins-hbase4:43299] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 23:03:52,980 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 23:03:52,980 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 23:03:52,980 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 23:03:52,980 DEBUG [M:0;jenkins-hbase4:43299] zookeeper.ZKUtil(398): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 23:03:52,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 23:03:52,980 WARN [M:0;jenkins-hbase4:43299] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 23:03:52,980 INFO [M:0;jenkins-hbase4:43299] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 23:03:52,981 INFO [M:0;jenkins-hbase4:43299] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 23:03:52,981 DEBUG [M:0;jenkins-hbase4:43299] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 23:03:52,981 INFO [M:0;jenkins-hbase4:43299] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:52,981 DEBUG [M:0;jenkins-hbase4:43299] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:52,981 DEBUG [M:0;jenkins-hbase4:43299] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 23:03:52,981 DEBUG [M:0;jenkins-hbase4:43299] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:52,981 INFO [M:0;jenkins-hbase4:43299] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.67 KB heapSize=65.63 KB 2023-02-12 23:03:52,988 INFO [M:0;jenkins-hbase4:43299] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.67 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4f17e4fe87604eb69903f8ae4af954f9 2023-02-12 23:03:52,992 DEBUG [M:0;jenkins-hbase4:43299] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4f17e4fe87604eb69903f8ae4af954f9 as hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4f17e4fe87604eb69903f8ae4af954f9 2023-02-12 23:03:52,995 INFO [M:0;jenkins-hbase4:43299] regionserver.HStore(1080): Added hdfs://localhost:35937/user/jenkins/test-data/46ef3065-aacf-dc29-9d90-f91885464a93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4f17e4fe87604eb69903f8ae4af954f9, entries=17, sequenceid=132, filesize=8.6 K 2023-02-12 23:03:52,995 INFO [M:0;jenkins-hbase4:43299] regionserver.HRegion(2947): Finished flush of dataSize ~54.67 KB/55987, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 14ms, sequenceid=132, compaction requested=false 2023-02-12 23:03:52,996 INFO [M:0;jenkins-hbase4:43299] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 23:03:52,996 DEBUG [M:0;jenkins-hbase4:43299] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676243032981Disabling compacts and flushes for region at 1676243032981Disabling writes for close at 1676243032981Obtaining lock to block concurrent updates at 1676243032981Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676243032981Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=55987, getHeapSize=67184, getOffHeapSize=0, getCellsCount=145 at 1676243032982 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676243032983 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676243032983Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676243032984 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676243032984Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676243032992 (+8 ms)Finished flush of dataSize ~54.67 KB/55987, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 14ms, sequenceid=132, compaction requested=false at 1676243032996 (+4 ms)Writing region close event to WAL at 1676243032996Closed at 1676243032996 2023-02-12 23:03:52,998 INFO [M:0;jenkins-hbase4:43299] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 23:03:52,998 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 23:03:52,998 INFO [M:0;jenkins-hbase4:43299] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43299 2023-02-12 23:03:53,006 DEBUG [M:0;jenkins-hbase4:43299] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43299,1676243028057 already deleted, retry=false 2023-02-12 23:03:53,076 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:53,076 INFO [RS:0;jenkins-hbase4:45953] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45953,1676243028111; zookeeper connection closed. 2023-02-12 23:03:53,076 ERROR [Listener at localhost/33843-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@fcfea82 rejected from java.util.concurrent.ThreadPoolExecutor@bf06fa3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:53,076 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): regionserver:45953-0x1004ac6b20e0001, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:53,076 ERROR [Listener at localhost/33843-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@f1d5b28 rejected from java.util.concurrent.ThreadPoolExecutor@bf06fa3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:53,076 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@f6c93af] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@f6c93af 2023-02-12 23:03:53,077 INFO [Listener at localhost/33843] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 23:03:53,176 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:53,176 INFO [M:0;jenkins-hbase4:43299] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43299,1676243028057; zookeeper connection closed. 2023-02-12 23:03:53,176 ERROR [Listener at localhost/33843-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@55473b9a rejected from java.util.concurrent.ThreadPoolExecutor@5178a5ea[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:53,178 DEBUG [Listener at localhost/33843-EventThread] zookeeper.ZKWatcher(600): master:43299-0x1004ac6b20e0000, quorum=127.0.0.1:59961, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 23:03:53,178 ERROR [Listener at localhost/33843-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@49d3c9aa rejected from java.util.concurrent.ThreadPoolExecutor@5178a5ea[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 23:03:53,178 WARN [Listener at localhost/33843] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 23:03:53,181 INFO [Listener at localhost/33843] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:53,289 WARN [BP-1813186310-172.31.14.131-1676243027413 heartbeating to localhost/127.0.0.1:35937] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 23:03:53,289 WARN [BP-1813186310-172.31.14.131-1676243027413 heartbeating to localhost/127.0.0.1:35937] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1813186310-172.31.14.131-1676243027413 (Datanode Uuid 6f858d1a-1eda-49f8-a8c9-f13c06a039ae) service to localhost/127.0.0.1:35937 2023-02-12 23:03:53,289 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/cluster_3b47f26f-b1bd-2b99-6704-6491bbe80a58/dfs/data/data3/current/BP-1813186310-172.31.14.131-1676243027413] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:53,290 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/cluster_3b47f26f-b1bd-2b99-6704-6491bbe80a58/dfs/data/data4/current/BP-1813186310-172.31.14.131-1676243027413] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:53,291 WARN [Listener at localhost/33843] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 23:03:53,294 INFO [Listener at localhost/33843] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:53,395 WARN [BP-1813186310-172.31.14.131-1676243027413 heartbeating to localhost/127.0.0.1:35937] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 23:03:53,395 WARN [BP-1813186310-172.31.14.131-1676243027413 heartbeating to localhost/127.0.0.1:35937] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1813186310-172.31.14.131-1676243027413 (Datanode Uuid a7a8b8ce-ed75-4ac0-ac84-398d14558302) service to localhost/127.0.0.1:35937 2023-02-12 23:03:53,395 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/cluster_3b47f26f-b1bd-2b99-6704-6491bbe80a58/dfs/data/data1/current/BP-1813186310-172.31.14.131-1676243027413] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:53,396 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3a963cc-2bc3-d3b0-fcaf-10beffe523ab/cluster_3b47f26f-b1bd-2b99-6704-6491bbe80a58/dfs/data/data2/current/BP-1813186310-172.31.14.131-1676243027413] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 23:03:53,407 INFO [Listener at localhost/33843] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 23:03:53,519 INFO [Listener at localhost/33843] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 23:03:53,538 INFO [Listener at localhost/33843] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 23:03:53,550 INFO [Listener at localhost/33843] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=295 (was 273) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33843 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:35937 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:35937 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:35937 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:35937 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35937 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,43299,1676243028057)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:35937 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:35937 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=600 (was 577) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=241 (was 227) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3749 (was 3894)