2023-08-27 17:58:09,478 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b 2023-08-27 17:58:09,494 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRolling timeout: 13 mins 2023-08-27 17:58:09,530 INFO [Time-limited test] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=194, ProcessCount=168, AvailableMemoryMB=11692 2023-08-27 17:58:09,538 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-27 17:58:09,538 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428, deleteOnExit=true 2023-08-27 17:58:09,539 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-27 17:58:09,539 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/test.cache.data in system properties and HBase conf 2023-08-27 17:58:09,540 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/hadoop.tmp.dir in system properties and HBase conf 2023-08-27 17:58:09,541 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/hadoop.log.dir in system properties and HBase conf 2023-08-27 17:58:09,541 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-27 17:58:09,542 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-27 17:58:09,542 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-27 17:58:09,671 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-08-27 17:58:10,107 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-27 17:58:10,112 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-27 17:58:10,112 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-27 17:58:10,113 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-27 17:58:10,113 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-27 17:58:10,114 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-27 17:58:10,114 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-27 17:58:10,115 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-27 17:58:10,115 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-27 17:58:10,115 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-27 17:58:10,116 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/nfs.dump.dir in system properties and HBase conf 2023-08-27 17:58:10,116 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/java.io.tmpdir in system properties and HBase conf 2023-08-27 17:58:10,117 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-27 17:58:10,117 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-27 17:58:10,118 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-27 17:58:10,694 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-27 17:58:10,700 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-27 17:58:11,101 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-08-27 17:58:11,278 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-08-27 17:58:11,295 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 17:58:11,334 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 17:58:11,392 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/java.io.tmpdir/Jetty_localhost_46715_hdfs____.j91lkt/webapp 2023-08-27 17:58:11,516 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46715 2023-08-27 17:58:11,526 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-27 17:58:11,527 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-27 17:58:11,967 WARN [Listener at localhost/33667] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 17:58:12,031 WARN [Listener at localhost/33667] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-27 17:58:12,048 WARN [Listener at localhost/33667] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 17:58:12,054 INFO [Listener at localhost/33667] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 17:58:12,058 INFO [Listener at localhost/33667] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/java.io.tmpdir/Jetty_localhost_38595_datanode____je4ynn/webapp 2023-08-27 17:58:12,156 INFO [Listener at localhost/33667] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38595 2023-08-27 17:58:12,463 WARN [Listener at localhost/35363] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 17:58:12,474 WARN [Listener at localhost/35363] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-27 17:58:12,480 WARN [Listener at localhost/35363] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 17:58:12,482 INFO [Listener at localhost/35363] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 17:58:12,487 INFO [Listener at localhost/35363] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/java.io.tmpdir/Jetty_localhost_38291_datanode____z1be7g/webapp 2023-08-27 17:58:12,592 INFO [Listener at localhost/35363] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38291 2023-08-27 17:58:12,603 WARN [Listener at localhost/35181] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 17:58:12,964 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd388bcb8721dca8: Processing first storage report for DS-86c4e2af-7858-4746-be88-2273088e48c2 from datanode d093ab70-9f85-494b-bafc-8c553b8656b5 2023-08-27 17:58:12,966 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd388bcb8721dca8: from storage DS-86c4e2af-7858-4746-be88-2273088e48c2 node DatanodeRegistration(127.0.0.1:38267, datanodeUuid=d093ab70-9f85-494b-bafc-8c553b8656b5, infoPort=39725, infoSecurePort=0, ipcPort=35363, storageInfo=lv=-57;cid=testClusterID;nsid=1578471101;c=1693159090802), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-08-27 17:58:12,967 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x598f02147d383c62: Processing first storage report for DS-2567c637-5684-4f18-8ca8-3b3fbd061d95 from datanode 44b734cd-4bab-4f39-b26d-b26488c08ca4 2023-08-27 17:58:12,967 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x598f02147d383c62: from storage DS-2567c637-5684-4f18-8ca8-3b3fbd061d95 node DatanodeRegistration(127.0.0.1:44957, datanodeUuid=44b734cd-4bab-4f39-b26d-b26488c08ca4, infoPort=44989, infoSecurePort=0, ipcPort=35181, storageInfo=lv=-57;cid=testClusterID;nsid=1578471101;c=1693159090802), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:58:12,967 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd388bcb8721dca8: Processing first storage report for DS-9cd8d5be-c93a-469a-8d5c-af6f32d553fd from datanode d093ab70-9f85-494b-bafc-8c553b8656b5 2023-08-27 17:58:12,967 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd388bcb8721dca8: from storage DS-9cd8d5be-c93a-469a-8d5c-af6f32d553fd node DatanodeRegistration(127.0.0.1:38267, datanodeUuid=d093ab70-9f85-494b-bafc-8c553b8656b5, infoPort=39725, infoSecurePort=0, ipcPort=35363, storageInfo=lv=-57;cid=testClusterID;nsid=1578471101;c=1693159090802), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-27 17:58:12,967 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x598f02147d383c62: Processing first storage report for DS-f0939227-5a7e-4561-aeda-d74279c1c15b from datanode 44b734cd-4bab-4f39-b26d-b26488c08ca4 2023-08-27 17:58:12,968 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x598f02147d383c62: from storage DS-f0939227-5a7e-4561-aeda-d74279c1c15b node DatanodeRegistration(127.0.0.1:44957, datanodeUuid=44b734cd-4bab-4f39-b26d-b26488c08ca4, infoPort=44989, infoSecurePort=0, ipcPort=35181, storageInfo=lv=-57;cid=testClusterID;nsid=1578471101;c=1693159090802), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:58:13,043 DEBUG [Listener at localhost/35181] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b 2023-08-27 17:58:13,118 INFO [Listener at localhost/35181] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428/zookeeper_0, clientPort=52976, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-27 17:58:13,132 INFO [Listener at localhost/35181] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52976 2023-08-27 17:58:13,144 INFO [Listener at localhost/35181] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:13,146 INFO [Listener at localhost/35181] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:13,830 INFO [Listener at localhost/35181] util.FSUtils(471): Created version file at hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d with version=8 2023-08-27 17:58:13,830 INFO [Listener at localhost/35181] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/hbase-staging 2023-08-27 17:58:14,156 INFO [Listener at localhost/35181] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-08-27 17:58:14,626 INFO [Listener at localhost/35181] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-27 17:58:14,659 INFO [Listener at localhost/35181] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 17:58:14,659 INFO [Listener at localhost/35181] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-27 17:58:14,660 INFO [Listener at localhost/35181] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-27 17:58:14,660 INFO [Listener at localhost/35181] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 17:58:14,660 INFO [Listener at localhost/35181] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-27 17:58:14,804 INFO [Listener at localhost/35181] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-27 17:58:14,881 DEBUG [Listener at localhost/35181] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-08-27 17:58:14,972 INFO [Listener at localhost/35181] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35739 2023-08-27 17:58:14,982 INFO [Listener at localhost/35181] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:14,984 INFO [Listener at localhost/35181] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:15,006 INFO [Listener at localhost/35181] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35739 connecting to ZooKeeper ensemble=127.0.0.1:52976 2023-08-27 17:58:15,048 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:357390x0, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-27 17:58:15,050 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35739-0x1004ee4ab140000 connected 2023-08-27 17:58:15,073 DEBUG [Listener at localhost/35181] zookeeper.ZKUtil(164): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-27 17:58:15,074 DEBUG [Listener at localhost/35181] zookeeper.ZKUtil(164): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 17:58:15,077 DEBUG [Listener at localhost/35181] zookeeper.ZKUtil(164): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-27 17:58:15,085 DEBUG [Listener at localhost/35181] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35739 2023-08-27 17:58:15,085 DEBUG [Listener at localhost/35181] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35739 2023-08-27 17:58:15,086 DEBUG [Listener at localhost/35181] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35739 2023-08-27 17:58:15,086 DEBUG [Listener at localhost/35181] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35739 2023-08-27 17:58:15,086 DEBUG [Listener at localhost/35181] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35739 2023-08-27 17:58:15,092 INFO [Listener at localhost/35181] master.HMaster(444): hbase.rootdir=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d, hbase.cluster.distributed=false 2023-08-27 17:58:15,159 INFO [Listener at localhost/35181] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-27 17:58:15,160 INFO [Listener at localhost/35181] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 17:58:15,160 INFO [Listener at localhost/35181] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-27 17:58:15,160 INFO [Listener at localhost/35181] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-27 17:58:15,160 INFO [Listener at localhost/35181] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 17:58:15,160 INFO [Listener at localhost/35181] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-27 17:58:15,165 INFO [Listener at localhost/35181] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-27 17:58:15,167 INFO [Listener at localhost/35181] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37459 2023-08-27 17:58:15,170 INFO [Listener at localhost/35181] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-27 17:58:15,175 DEBUG [Listener at localhost/35181] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-27 17:58:15,176 INFO [Listener at localhost/35181] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:15,178 INFO [Listener at localhost/35181] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:15,180 INFO [Listener at localhost/35181] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37459 connecting to ZooKeeper ensemble=127.0.0.1:52976 2023-08-27 17:58:15,184 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): regionserver:374590x0, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-27 17:58:15,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37459-0x1004ee4ab140001 connected 2023-08-27 17:58:15,185 DEBUG [Listener at localhost/35181] zookeeper.ZKUtil(164): regionserver:37459-0x1004ee4ab140001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-27 17:58:15,186 DEBUG [Listener at localhost/35181] zookeeper.ZKUtil(164): regionserver:37459-0x1004ee4ab140001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 17:58:15,187 DEBUG [Listener at localhost/35181] zookeeper.ZKUtil(164): regionserver:37459-0x1004ee4ab140001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-27 17:58:15,188 DEBUG [Listener at localhost/35181] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37459 2023-08-27 17:58:15,188 DEBUG [Listener at localhost/35181] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37459 2023-08-27 17:58:15,188 DEBUG [Listener at localhost/35181] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37459 2023-08-27 17:58:15,189 DEBUG [Listener at localhost/35181] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37459 2023-08-27 17:58:15,190 DEBUG [Listener at localhost/35181] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37459 2023-08-27 17:58:15,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35739,1693159093983 2023-08-27 17:58:15,202 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-27 17:58:15,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35739,1693159093983 2023-08-27 17:58:15,220 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-27 17:58:15,220 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x1004ee4ab140001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-27 17:58:15,220 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:15,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-27 17:58:15,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35739,1693159093983 from backup master directory 2023-08-27 17:58:15,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-27 17:58:15,225 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35739,1693159093983 2023-08-27 17:58:15,225 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-27 17:58:15,226 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-27 17:58:15,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35739,1693159093983 2023-08-27 17:58:15,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-08-27 17:58:15,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-08-27 17:58:15,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/hbase.id with ID: 602dcdc7-1f75-495d-97d7-c50db4146e70 2023-08-27 17:58:15,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:15,365 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:15,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x372a477c to 127.0.0.1:52976 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-27 17:58:15,448 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18131fbd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-27 17:58:15,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-27 17:58:15,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-27 17:58:15,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-27 17:58:15,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/data/master/store-tmp 2023-08-27 17:58:15,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:15,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-27 17:58:15,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:58:15,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:58:15,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-27 17:58:15,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:58:15,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:58:15,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-27 17:58:15,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/WALs/jenkins-hbase4.apache.org,35739,1693159093983 2023-08-27 17:58:15,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35739%2C1693159093983, suffix=, logDir=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/WALs/jenkins-hbase4.apache.org,35739,1693159093983, archiveDir=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/oldWALs, maxLogs=10 2023-08-27 17:58:15,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-08-27 17:58:15,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-08-27 17:58:15,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:53) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:190) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:116) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:719) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:128) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:881) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:574) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.init(AbstractFSWAL.java:515) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:160) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:295) at org.apache.hadoop.hbase.master.region.MasterRegion.createWAL(MasterRegion.java:200) at org.apache.hadoop.hbase.master.region.MasterRegion.bootstrap(MasterRegion.java:220) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:348) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:15,662 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:417) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:15,664 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38267,DS-86c4e2af-7858-4746-be88-2273088e48c2,DISK] 2023-08-27 17:58:15,664 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44957,DS-2567c637-5684-4f18-8ca8-3b3fbd061d95,DISK] 2023-08-27 17:58:15,672 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:15,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/WALs/jenkins-hbase4.apache.org,35739,1693159093983/jenkins-hbase4.apache.org%2C35739%2C1693159093983.1693159095599 2023-08-27 17:58:15,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44957,DS-2567c637-5684-4f18-8ca8-3b3fbd061d95,DISK], DatanodeInfoWithStorage[127.0.0.1:38267,DS-86c4e2af-7858-4746-be88-2273088e48c2,DISK]] 2023-08-27 17:58:15,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-27 17:58:15,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:15,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:58:15,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:58:15,828 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:58:15,837 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-27 17:58:15,868 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-27 17:58:15,880 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:15,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:58:15,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:58:15,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:58:15,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-27 17:58:15,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=715009, jitterRate=-0.09081980586051941}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-27 17:58:15,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-27 17:58:15,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-27 17:58:15,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-27 17:58:15,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-27 17:58:15,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-27 17:58:15,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-08-27 17:58:15,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 35 msec 2023-08-27 17:58:15,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-27 17:58:16,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-27 17:58:16,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-27 17:58:16,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-27 17:58:16,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-27 17:58:16,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-27 17:58:16,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-27 17:58:16,057 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-27 17:58:16,060 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:16,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-27 17:58:16,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-27 17:58:16,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-27 17:58:16,081 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x1004ee4ab140001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-27 17:58:16,081 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-27 17:58:16,081 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:16,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35739,1693159093983, sessionid=0x1004ee4ab140000, setting cluster-up flag (Was=false) 2023-08-27 17:58:16,099 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:16,105 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-27 17:58:16,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35739,1693159093983 2023-08-27 17:58:16,129 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:16,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-27 17:58:16,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35739,1693159093983 2023-08-27 17:58:16,140 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/.hbase-snapshot/.tmp 2023-08-27 17:58:16,195 INFO [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(951): ClusterId : 602dcdc7-1f75-495d-97d7-c50db4146e70 2023-08-27 17:58:16,200 DEBUG [RS:0;jenkins-hbase4:37459] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-27 17:58:16,205 DEBUG [RS:0;jenkins-hbase4:37459] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-27 17:58:16,206 DEBUG [RS:0;jenkins-hbase4:37459] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-27 17:58:16,210 DEBUG [RS:0;jenkins-hbase4:37459] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-27 17:58:16,211 DEBUG [RS:0;jenkins-hbase4:37459] zookeeper.ReadOnlyZKClient(139): Connect 0x659b1c9a to 127.0.0.1:52976 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-27 17:58:16,216 DEBUG [RS:0;jenkins-hbase4:37459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b5cfe59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-27 17:58:16,216 DEBUG [RS:0;jenkins-hbase4:37459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f6377ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-27 17:58:16,242 DEBUG [RS:0;jenkins-hbase4:37459] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37459 2023-08-27 17:58:16,247 INFO [RS:0;jenkins-hbase4:37459] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-27 17:58:16,247 INFO [RS:0;jenkins-hbase4:37459] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-27 17:58:16,247 DEBUG [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(1022): About to register with Master. 2023-08-27 17:58:16,250 INFO [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35739,1693159093983 with isa=jenkins-hbase4.apache.org/172.31.14.131:37459, startcode=1693159095159 2023-08-27 17:58:16,268 DEBUG [RS:0;jenkins-hbase4:37459] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-27 17:58:16,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-27 17:58:16,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 17:58:16,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 17:58:16,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 17:58:16,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 17:58:16,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-27 17:58:16,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:16,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-27 17:58:16,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:16,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1693159126292 2023-08-27 17:58:16,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-27 17:58:16,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-27 17:58:16,315 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-27 17:58:16,315 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-27 17:58:16,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-27 17:58:16,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-27 17:58:16,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-27 17:58:16,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-27 17:58:16,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:16,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-27 17:58:16,328 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-27 17:58:16,329 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-27 17:58:16,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-27 17:58:16,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-27 17:58:16,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-27 17:58:16,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1693159096334,5,FailOnTimeoutGroup] 2023-08-27 17:58:16,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1693159096336,5,FailOnTimeoutGroup] 2023-08-27 17:58:16,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:16,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-27 17:58:16,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:16,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:16,343 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44907, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-08-27 17:58:16,357 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35739] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37459,1693159095159 2023-08-27 17:58:16,378 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-27 17:58:16,380 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-27 17:58:16,380 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d 2023-08-27 17:58:16,381 DEBUG [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d 2023-08-27 17:58:16,382 DEBUG [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33667 2023-08-27 17:58:16,382 DEBUG [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-27 17:58:16,389 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-27 17:58:16,391 DEBUG [RS:0;jenkins-hbase4:37459] zookeeper.ZKUtil(162): regionserver:37459-0x1004ee4ab140001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37459,1693159095159 2023-08-27 17:58:16,391 WARN [RS:0;jenkins-hbase4:37459] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-27 17:58:16,401 INFO [RS:0;jenkins-hbase4:37459] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-27 17:58:16,410 DEBUG [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159 2023-08-27 17:58:16,412 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37459,1693159095159] 2023-08-27 17:58:16,427 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:16,427 DEBUG [RS:0;jenkins-hbase4:37459] zookeeper.ZKUtil(162): regionserver:37459-0x1004ee4ab140001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37459,1693159095159 2023-08-27 17:58:16,429 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-27 17:58:16,432 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/info 2023-08-27 17:58:16,433 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-27 17:58:16,435 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:16,435 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-27 17:58:16,440 DEBUG [RS:0;jenkins-hbase4:37459] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-27 17:58:16,443 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/rep_barrier 2023-08-27 17:58:16,444 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-27 17:58:16,445 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:16,446 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-27 17:58:16,448 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/table 2023-08-27 17:58:16,449 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-27 17:58:16,450 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:16,450 INFO [RS:0;jenkins-hbase4:37459] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-27 17:58:16,452 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740 2023-08-27 17:58:16,453 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740 2023-08-27 17:58:16,457 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-27 17:58:16,460 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-27 17:58:16,464 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-27 17:58:16,465 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=727846, jitterRate=-0.07449610531330109}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-27 17:58:16,465 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-27 17:58:16,465 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-27 17:58:16,465 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-27 17:58:16,465 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-27 17:58:16,466 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-27 17:58:16,466 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-27 17:58:16,466 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-27 17:58:16,467 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-27 17:58:16,472 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-27 17:58:16,472 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-27 17:58:16,475 INFO [RS:0;jenkins-hbase4:37459] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-27 17:58:16,480 INFO [RS:0;jenkins-hbase4:37459] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-27 17:58:16,480 INFO [RS:0;jenkins-hbase4:37459] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:16,481 INFO [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-27 17:58:16,484 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-27 17:58:16,490 INFO [RS:0;jenkins-hbase4:37459] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:16,490 DEBUG [RS:0;jenkins-hbase4:37459] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:16,491 DEBUG [RS:0;jenkins-hbase4:37459] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:16,491 DEBUG [RS:0;jenkins-hbase4:37459] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:16,491 DEBUG [RS:0;jenkins-hbase4:37459] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:16,491 DEBUG [RS:0;jenkins-hbase4:37459] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:16,492 DEBUG [RS:0;jenkins-hbase4:37459] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-27 17:58:16,492 DEBUG [RS:0;jenkins-hbase4:37459] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:16,492 DEBUG [RS:0;jenkins-hbase4:37459] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:16,492 DEBUG [RS:0;jenkins-hbase4:37459] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:16,492 DEBUG [RS:0;jenkins-hbase4:37459] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:16,497 INFO [RS:0;jenkins-hbase4:37459] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:16,497 INFO [RS:0;jenkins-hbase4:37459] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:16,497 INFO [RS:0;jenkins-hbase4:37459] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:16,498 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-27 17:58:16,503 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-27 17:58:16,517 INFO [RS:0;jenkins-hbase4:37459] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-27 17:58:16,520 INFO [RS:0;jenkins-hbase4:37459] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37459,1693159095159-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:16,537 INFO [RS:0;jenkins-hbase4:37459] regionserver.Replication(203): jenkins-hbase4.apache.org,37459,1693159095159 started 2023-08-27 17:58:16,537 INFO [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37459,1693159095159, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37459, sessionid=0x1004ee4ab140001 2023-08-27 17:58:16,537 DEBUG [RS:0;jenkins-hbase4:37459] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-27 17:58:16,537 DEBUG [RS:0;jenkins-hbase4:37459] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37459,1693159095159 2023-08-27 17:58:16,537 DEBUG [RS:0;jenkins-hbase4:37459] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37459,1693159095159' 2023-08-27 17:58:16,538 DEBUG [RS:0;jenkins-hbase4:37459] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-27 17:58:16,538 DEBUG [RS:0;jenkins-hbase4:37459] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-27 17:58:16,539 DEBUG [RS:0;jenkins-hbase4:37459] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-27 17:58:16,539 DEBUG [RS:0;jenkins-hbase4:37459] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-27 17:58:16,539 DEBUG [RS:0;jenkins-hbase4:37459] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37459,1693159095159 2023-08-27 17:58:16,539 DEBUG [RS:0;jenkins-hbase4:37459] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37459,1693159095159' 2023-08-27 17:58:16,539 DEBUG [RS:0;jenkins-hbase4:37459] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-27 17:58:16,540 DEBUG [RS:0;jenkins-hbase4:37459] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-27 17:58:16,540 DEBUG [RS:0;jenkins-hbase4:37459] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-27 17:58:16,540 INFO [RS:0;jenkins-hbase4:37459] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-27 17:58:16,541 INFO [RS:0;jenkins-hbase4:37459] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-27 17:58:16,653 INFO [RS:0;jenkins-hbase4:37459] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37459%2C1693159095159, suffix=, logDir=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159, archiveDir=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/oldWALs, maxLogs=32 2023-08-27 17:58:16,656 DEBUG [jenkins-hbase4:35739] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-27 17:58:16,659 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37459,1693159095159, state=OPENING 2023-08-27 17:58:16,666 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-27 17:58:16,667 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:16,668 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-27 17:58:16,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37459,1693159095159}] 2023-08-27 17:58:16,676 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44957,DS-2567c637-5684-4f18-8ca8-3b3fbd061d95,DISK] 2023-08-27 17:58:16,677 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38267,DS-86c4e2af-7858-4746-be88-2273088e48c2,DISK] 2023-08-27 17:58:16,682 INFO [RS:0;jenkins-hbase4:37459] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.1693159096658 2023-08-27 17:58:16,684 DEBUG [RS:0;jenkins-hbase4:37459] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44957,DS-2567c637-5684-4f18-8ca8-3b3fbd061d95,DISK], DatanodeInfoWithStorage[127.0.0.1:38267,DS-86c4e2af-7858-4746-be88-2273088e48c2,DISK]] 2023-08-27 17:58:16,862 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37459,1693159095159 2023-08-27 17:58:16,865 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-27 17:58:16,868 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-27 17:58:16,881 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-27 17:58:16,882 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-27 17:58:16,886 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37459%2C1693159095159.meta, suffix=.meta, logDir=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159, archiveDir=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/oldWALs, maxLogs=32 2023-08-27 17:58:16,905 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44957,DS-2567c637-5684-4f18-8ca8-3b3fbd061d95,DISK] 2023-08-27 17:58:16,909 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38267,DS-86c4e2af-7858-4746-be88-2273088e48c2,DISK] 2023-08-27 17:58:16,916 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.meta.1693159096887.meta 2023-08-27 17:58:16,917 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44957,DS-2567c637-5684-4f18-8ca8-3b3fbd061d95,DISK], DatanodeInfoWithStorage[127.0.0.1:38267,DS-86c4e2af-7858-4746-be88-2273088e48c2,DISK]] 2023-08-27 17:58:16,917 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-27 17:58:16,919 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-27 17:58:16,941 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-27 17:58:16,947 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-27 17:58:16,954 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-27 17:58:16,954 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:16,954 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-27 17:58:16,954 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-27 17:58:16,958 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-27 17:58:16,960 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/info 2023-08-27 17:58:16,960 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/info 2023-08-27 17:58:16,960 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-27 17:58:16,962 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:16,962 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-27 17:58:16,963 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/rep_barrier 2023-08-27 17:58:16,963 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/rep_barrier 2023-08-27 17:58:16,964 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-27 17:58:16,965 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:16,965 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-27 17:58:16,967 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/table 2023-08-27 17:58:16,967 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/table 2023-08-27 17:58:16,968 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-27 17:58:16,968 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:16,970 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740 2023-08-27 17:58:16,973 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740 2023-08-27 17:58:16,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-27 17:58:16,979 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-27 17:58:16,981 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=825976, jitterRate=0.05028364062309265}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-27 17:58:16,981 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-27 17:58:16,991 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1693159096854 2023-08-27 17:58:17,010 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-27 17:58:17,011 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-27 17:58:17,011 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37459,1693159095159, state=OPEN 2023-08-27 17:58:17,014 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-27 17:58:17,015 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-27 17:58:17,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-27 17:58:17,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37459,1693159095159 in 343 msec 2023-08-27 17:58:17,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-27 17:58:17,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 537 msec 2023-08-27 17:58:17,030 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 835 msec 2023-08-27 17:58:17,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1693159097031, completionTime=-1 2023-08-27 17:58:17,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-27 17:58:17,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-27 17:58:17,101 DEBUG [hconnection-0x319ff842-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-27 17:58:17,104 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-27 17:58:17,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-27 17:58:17,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1693159157121 2023-08-27 17:58:17,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1693159217121 2023-08-27 17:58:17,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 89 msec 2023-08-27 17:58:17,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35739,1693159093983-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:17,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35739,1693159093983-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:17,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35739,1693159093983-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:17,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35739, period=300000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:17,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:17,157 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-27 17:58:17,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-27 17:58:17,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-27 17:58:17,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-27 17:58:17,181 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-27 17:58:17,183 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-27 17:58:17,206 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/.tmp/data/hbase/namespace/bdfe61e18393efd14c6a431559814e82 2023-08-27 17:58:17,208 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/.tmp/data/hbase/namespace/bdfe61e18393efd14c6a431559814e82 empty. 2023-08-27 17:58:17,209 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/.tmp/data/hbase/namespace/bdfe61e18393efd14c6a431559814e82 2023-08-27 17:58:17,209 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-27 17:58:17,239 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-27 17:58:17,244 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => bdfe61e18393efd14c6a431559814e82, NAME => 'hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/.tmp 2023-08-27 17:58:17,261 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:17,261 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing bdfe61e18393efd14c6a431559814e82, disabling compactions & flushes 2023-08-27 17:58:17,261 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82. 2023-08-27 17:58:17,261 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82. 2023-08-27 17:58:17,261 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82. after waiting 0 ms 2023-08-27 17:58:17,261 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82. 2023-08-27 17:58:17,261 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82. 2023-08-27 17:58:17,261 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for bdfe61e18393efd14c6a431559814e82: 2023-08-27 17:58:17,267 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-27 17:58:17,284 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1693159097270"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1693159097270"}]},"ts":"1693159097270"} 2023-08-27 17:58:17,313 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-27 17:58:17,315 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-27 17:58:17,320 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1693159097316"}]},"ts":"1693159097316"} 2023-08-27 17:58:17,325 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-27 17:58:17,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bdfe61e18393efd14c6a431559814e82, ASSIGN}] 2023-08-27 17:58:17,342 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bdfe61e18393efd14c6a431559814e82, ASSIGN 2023-08-27 17:58:17,344 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=bdfe61e18393efd14c6a431559814e82, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37459,1693159095159; forceNewPlan=false, retain=false 2023-08-27 17:58:17,495 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bdfe61e18393efd14c6a431559814e82, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37459,1693159095159 2023-08-27 17:58:17,495 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1693159097495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1693159097495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1693159097495"}]},"ts":"1693159097495"} 2023-08-27 17:58:17,501 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure bdfe61e18393efd14c6a431559814e82, server=jenkins-hbase4.apache.org,37459,1693159095159}] 2023-08-27 17:58:17,664 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82. 2023-08-27 17:58:17,666 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bdfe61e18393efd14c6a431559814e82, NAME => 'hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82.', STARTKEY => '', ENDKEY => ''} 2023-08-27 17:58:17,667 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace bdfe61e18393efd14c6a431559814e82 2023-08-27 17:58:17,667 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:17,667 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bdfe61e18393efd14c6a431559814e82 2023-08-27 17:58:17,667 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bdfe61e18393efd14c6a431559814e82 2023-08-27 17:58:17,670 INFO [StoreOpener-bdfe61e18393efd14c6a431559814e82-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region bdfe61e18393efd14c6a431559814e82 2023-08-27 17:58:17,673 DEBUG [StoreOpener-bdfe61e18393efd14c6a431559814e82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/namespace/bdfe61e18393efd14c6a431559814e82/info 2023-08-27 17:58:17,673 DEBUG [StoreOpener-bdfe61e18393efd14c6a431559814e82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/namespace/bdfe61e18393efd14c6a431559814e82/info 2023-08-27 17:58:17,673 INFO [StoreOpener-bdfe61e18393efd14c6a431559814e82-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bdfe61e18393efd14c6a431559814e82 columnFamilyName info 2023-08-27 17:58:17,674 INFO [StoreOpener-bdfe61e18393efd14c6a431559814e82-1] regionserver.HStore(310): Store=bdfe61e18393efd14c6a431559814e82/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:17,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/namespace/bdfe61e18393efd14c6a431559814e82 2023-08-27 17:58:17,677 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/namespace/bdfe61e18393efd14c6a431559814e82 2023-08-27 17:58:17,682 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bdfe61e18393efd14c6a431559814e82 2023-08-27 17:58:17,685 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/namespace/bdfe61e18393efd14c6a431559814e82/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-27 17:58:17,686 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bdfe61e18393efd14c6a431559814e82; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=805327, jitterRate=0.02402636408805847}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-27 17:58:17,686 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bdfe61e18393efd14c6a431559814e82: 2023-08-27 17:58:17,689 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82., pid=6, masterSystemTime=1693159097655 2023-08-27 17:58:17,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82. 2023-08-27 17:58:17,693 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82. 2023-08-27 17:58:17,695 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bdfe61e18393efd14c6a431559814e82, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37459,1693159095159 2023-08-27 17:58:17,695 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1693159097694"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1693159097694"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1693159097694"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1693159097694"}]},"ts":"1693159097694"} 2023-08-27 17:58:17,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-27 17:58:17,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure bdfe61e18393efd14c6a431559814e82, server=jenkins-hbase4.apache.org,37459,1693159095159 in 201 msec 2023-08-27 17:58:17,710 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-27 17:58:17,710 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=bdfe61e18393efd14c6a431559814e82, ASSIGN in 367 msec 2023-08-27 17:58:17,711 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-27 17:58:17,712 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1693159097712"}]},"ts":"1693159097712"} 2023-08-27 17:58:17,715 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-27 17:58:17,719 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-27 17:58:17,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 550 msec 2023-08-27 17:58:17,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-27 17:58:17,783 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-27 17:58:17,783 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:17,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-27 17:58:17,847 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-27 17:58:17,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-08-27 17:58:17,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-27 17:58:17,877 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-27 17:58:17,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 20 msec 2023-08-27 17:58:17,892 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-27 17:58:17,894 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-27 17:58:17,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.668sec 2023-08-27 17:58:17,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-27 17:58:17,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-27 17:58:17,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-27 17:58:17,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35739,1693159093983-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-27 17:58:17,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35739,1693159093983-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-27 17:58:17,905 DEBUG [Listener at localhost/35181] zookeeper.ReadOnlyZKClient(139): Connect 0x3f579f2e to 127.0.0.1:52976 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-27 17:58:17,919 DEBUG [Listener at localhost/35181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d5d8e74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-27 17:58:17,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-27 17:58:17,965 DEBUG [hconnection-0x13a086d6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-27 17:58:17,979 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-27 17:58:17,990 INFO [Listener at localhost/35181] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35739,1693159093983 2023-08-27 17:58:17,991 INFO [Listener at localhost/35181] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:18,001 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-27 17:58:18,001 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:18,003 INFO [Listener at localhost/35181] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-27 17:58:18,024 WARN [Listener at localhost/35181] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-27 17:58:18,028 WARN [Listener at localhost/35181] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 17:58:18,029 INFO [Listener at localhost/35181] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 17:58:18,036 INFO [Listener at localhost/35181] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/java.io.tmpdir/Jetty_localhost_43745_datanode____xlj340/webapp 2023-08-27 17:58:18,151 INFO [Listener at localhost/35181] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43745 2023-08-27 17:58:18,163 WARN [Listener at localhost/43967] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 17:58:18,195 WARN [Listener at localhost/43967] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-27 17:58:18,198 WARN [Listener at localhost/43967] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 17:58:18,200 INFO [Listener at localhost/43967] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 17:58:18,204 INFO [Listener at localhost/43967] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/java.io.tmpdir/Jetty_localhost_46415_datanode____tl30cd/webapp 2023-08-27 17:58:18,318 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x23488013d500967a: Processing first storage report for DS-b00d89d2-6584-46ed-8a87-3c4a79eff8d1 from datanode b4b9bedc-3057-4c13-a562-f1443eb831e1 2023-08-27 17:58:18,318 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x23488013d500967a: from storage DS-b00d89d2-6584-46ed-8a87-3c4a79eff8d1 node DatanodeRegistration(127.0.0.1:41151, datanodeUuid=b4b9bedc-3057-4c13-a562-f1443eb831e1, infoPort=44889, infoSecurePort=0, ipcPort=43967, storageInfo=lv=-57;cid=testClusterID;nsid=1578471101;c=1693159090802), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:58:18,319 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x23488013d500967a: Processing first storage report for DS-b05046a4-d3e7-4196-87b7-f6d6a73c1a5d from datanode b4b9bedc-3057-4c13-a562-f1443eb831e1 2023-08-27 17:58:18,319 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x23488013d500967a: from storage DS-b05046a4-d3e7-4196-87b7-f6d6a73c1a5d node DatanodeRegistration(127.0.0.1:41151, datanodeUuid=b4b9bedc-3057-4c13-a562-f1443eb831e1, infoPort=44889, infoSecurePort=0, ipcPort=43967, storageInfo=lv=-57;cid=testClusterID;nsid=1578471101;c=1693159090802), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:58:18,329 INFO [Listener at localhost/43967] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46415 2023-08-27 17:58:18,343 WARN [Listener at localhost/46689] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 17:58:18,409 WARN [Listener at localhost/46689] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-27 17:58:18,412 WARN [Listener at localhost/46689] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 17:58:18,413 INFO [Listener at localhost/46689] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 17:58:18,418 INFO [Listener at localhost/46689] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/java.io.tmpdir/Jetty_localhost_39649_datanode____.cr4qro/webapp 2023-08-27 17:58:18,550 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc18308e7b2a924b: Processing first storage report for DS-d2b9b994-fd9e-4f7c-82ed-dc69d92784a5 from datanode d3dbcc57-26c7-4429-85c9-225fe173ce72 2023-08-27 17:58:18,551 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc18308e7b2a924b: from storage DS-d2b9b994-fd9e-4f7c-82ed-dc69d92784a5 node DatanodeRegistration(127.0.0.1:32817, datanodeUuid=d3dbcc57-26c7-4429-85c9-225fe173ce72, infoPort=35797, infoSecurePort=0, ipcPort=46689, storageInfo=lv=-57;cid=testClusterID;nsid=1578471101;c=1693159090802), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:58:18,551 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc18308e7b2a924b: Processing first storage report for DS-1c5ea15e-06a3-456a-8d84-0e92aa4a40d7 from datanode d3dbcc57-26c7-4429-85c9-225fe173ce72 2023-08-27 17:58:18,551 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc18308e7b2a924b: from storage DS-1c5ea15e-06a3-456a-8d84-0e92aa4a40d7 node DatanodeRegistration(127.0.0.1:32817, datanodeUuid=d3dbcc57-26c7-4429-85c9-225fe173ce72, infoPort=35797, infoSecurePort=0, ipcPort=46689, storageInfo=lv=-57;cid=testClusterID;nsid=1578471101;c=1693159090802), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:58:18,577 INFO [Listener at localhost/46689] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39649 2023-08-27 17:58:18,590 WARN [Listener at localhost/45101] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 17:58:18,689 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8dddd6205d8cbc72: Processing first storage report for DS-8bee91b4-66db-4405-b727-2c46f46480de from datanode f5928fa8-54e9-4202-b248-7fa489c9d71c 2023-08-27 17:58:18,689 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8dddd6205d8cbc72: from storage DS-8bee91b4-66db-4405-b727-2c46f46480de node DatanodeRegistration(127.0.0.1:45265, datanodeUuid=f5928fa8-54e9-4202-b248-7fa489c9d71c, infoPort=42673, infoSecurePort=0, ipcPort=45101, storageInfo=lv=-57;cid=testClusterID;nsid=1578471101;c=1693159090802), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:58:18,689 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8dddd6205d8cbc72: Processing first storage report for DS-6de75c26-9c83-4081-a415-ebffc0413f9b from datanode f5928fa8-54e9-4202-b248-7fa489c9d71c 2023-08-27 17:58:18,689 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8dddd6205d8cbc72: from storage DS-6de75c26-9c83-4081-a415-ebffc0413f9b node DatanodeRegistration(127.0.0.1:45265, datanodeUuid=f5928fa8-54e9-4202-b248-7fa489c9d71c, infoPort=42673, infoSecurePort=0, ipcPort=45101, storageInfo=lv=-57;cid=testClusterID;nsid=1578471101;c=1693159090802), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:58:18,715 DEBUG [Listener at localhost/45101] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-27 17:58:18,719 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-27 17:58:18,729 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35739] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-27 17:58:18,729 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35739] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-27 17:58:18,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35739] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-27 17:58:18,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35739] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath 2023-08-27 17:58:18,737 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_PRE_OPERATION 2023-08-27 17:58:18,739 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-27 17:58:18,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35739] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRollOnDatanodeDeath" procId is: 9 2023-08-27 17:58:18,742 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/f91ef2c3585d4082c445f8ec893782b8 2023-08-27 17:58:18,744 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/f91ef2c3585d4082c445f8ec893782b8 empty. 2023-08-27 17:58:18,747 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/f91ef2c3585d4082c445f8ec893782b8 2023-08-27 17:58:18,747 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRollOnDatanodeDeath regions 2023-08-27 17:58:18,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35739] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-27 17:58:18,768 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/.tabledesc/.tableinfo.0000000001 2023-08-27 17:58:18,769 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(7675): creating {ENCODED => f91ef2c3585d4082c445f8ec893782b8, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/.tmp 2023-08-27 17:58:18,788 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:18,788 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1604): Closing f91ef2c3585d4082c445f8ec893782b8, disabling compactions & flushes 2023-08-27 17:58:18,788 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8. 2023-08-27 17:58:18,788 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8. 2023-08-27 17:58:18,788 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8. after waiting 0 ms 2023-08-27 17:58:18,788 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8. 2023-08-27 17:58:18,789 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8. 2023-08-27 17:58:18,789 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1558): Region close journal for f91ef2c3585d4082c445f8ec893782b8: 2023-08-27 17:58:18,792 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ADD_TO_META 2023-08-27 17:58:18,794 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1693159098794"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1693159098794"}]},"ts":"1693159098794"} 2023-08-27 17:58:18,804 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-27 17:58:18,806 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-27 17:58:18,806 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1693159098806"}]},"ts":"1693159098806"} 2023-08-27 17:58:18,809 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLING in hbase:meta 2023-08-27 17:58:18,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=f91ef2c3585d4082c445f8ec893782b8, ASSIGN}] 2023-08-27 17:58:18,817 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=f91ef2c3585d4082c445f8ec893782b8, ASSIGN 2023-08-27 17:58:18,820 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=f91ef2c3585d4082c445f8ec893782b8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37459,1693159095159; forceNewPlan=false, retain=false 2023-08-27 17:58:18,971 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f91ef2c3585d4082c445f8ec893782b8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37459,1693159095159 2023-08-27 17:58:18,972 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1693159098971"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1693159098971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1693159098971"}]},"ts":"1693159098971"} 2023-08-27 17:58:18,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure f91ef2c3585d4082c445f8ec893782b8, server=jenkins-hbase4.apache.org,37459,1693159095159}] 2023-08-27 17:58:19,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8. 2023-08-27 17:58:19,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f91ef2c3585d4082c445f8ec893782b8, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8.', STARTKEY => '', ENDKEY => ''} 2023-08-27 17:58:19,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRollOnDatanodeDeath f91ef2c3585d4082c445f8ec893782b8 2023-08-27 17:58:19,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:19,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f91ef2c3585d4082c445f8ec893782b8 2023-08-27 17:58:19,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f91ef2c3585d4082c445f8ec893782b8 2023-08-27 17:58:19,140 INFO [StoreOpener-f91ef2c3585d4082c445f8ec893782b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f91ef2c3585d4082c445f8ec893782b8 2023-08-27 17:58:19,142 DEBUG [StoreOpener-f91ef2c3585d4082c445f8ec893782b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/f91ef2c3585d4082c445f8ec893782b8/info 2023-08-27 17:58:19,142 DEBUG [StoreOpener-f91ef2c3585d4082c445f8ec893782b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/f91ef2c3585d4082c445f8ec893782b8/info 2023-08-27 17:58:19,143 INFO [StoreOpener-f91ef2c3585d4082c445f8ec893782b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f91ef2c3585d4082c445f8ec893782b8 columnFamilyName info 2023-08-27 17:58:19,144 INFO [StoreOpener-f91ef2c3585d4082c445f8ec893782b8-1] regionserver.HStore(310): Store=f91ef2c3585d4082c445f8ec893782b8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:19,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/f91ef2c3585d4082c445f8ec893782b8 2023-08-27 17:58:19,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/f91ef2c3585d4082c445f8ec893782b8 2023-08-27 17:58:19,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f91ef2c3585d4082c445f8ec893782b8 2023-08-27 17:58:19,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/f91ef2c3585d4082c445f8ec893782b8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-27 17:58:19,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f91ef2c3585d4082c445f8ec893782b8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=788669, jitterRate=0.0028445571660995483}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-27 17:58:19,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f91ef2c3585d4082c445f8ec893782b8: 2023-08-27 17:58:19,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8., pid=11, masterSystemTime=1693159099128 2023-08-27 17:58:19,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8. 2023-08-27 17:58:19,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8. 2023-08-27 17:58:19,158 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f91ef2c3585d4082c445f8ec893782b8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37459,1693159095159 2023-08-27 17:58:19,158 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1693159099158"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1693159099158"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1693159099158"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1693159099158"}]},"ts":"1693159099158"} 2023-08-27 17:58:19,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-27 17:58:19,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure f91ef2c3585d4082c445f8ec893782b8, server=jenkins-hbase4.apache.org,37459,1693159095159 in 186 msec 2023-08-27 17:58:19,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-27 17:58:19,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=f91ef2c3585d4082c445f8ec893782b8, ASSIGN in 349 msec 2023-08-27 17:58:19,169 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-27 17:58:19,170 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1693159099169"}]},"ts":"1693159099169"} 2023-08-27 17:58:19,172 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLED in hbase:meta 2023-08-27 17:58:19,175 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_POST_OPERATION 2023-08-27 17:58:19,178 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath in 442 msec 2023-08-27 17:58:22,481 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-27 17:58:22,548 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-27 17:58:22,550 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-27 17:58:22,551 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRollOnDatanodeDeath' 2023-08-27 17:58:24,150 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-27 17:58:24,151 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-08-27 17:58:28,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35739] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-27 17:58:28,760 INFO [Listener at localhost/45101] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRollOnDatanodeDeath, procId: 9 completed 2023-08-27 17:58:28,760 DEBUG [Listener at localhost/45101] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestLogRolling-testLogRollOnDatanodeDeath get assigned. Timeout = 60000ms 2023-08-27 17:58:28,762 INFO [Listener at localhost/45101] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-08-27 17:58:28,766 INFO [Listener at localhost/45101] hbase.HBaseTestingUtility(3484): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned to meta. Checking AM states. 2023-08-27 17:58:28,766 INFO [Listener at localhost/45101] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-08-27 17:58:28,766 INFO [Listener at localhost/45101] hbase.HBaseTestingUtility(3504): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned. 2023-08-27 17:58:28,776 DEBUG [Listener at localhost/45101] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRollOnDatanodeDeath 2023-08-27 17:58:28,777 DEBUG [Listener at localhost/45101] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8. 2023-08-27 17:58:28,778 WARN [Listener at localhost/45101] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-27 17:58:28,781 INFO [Listener at localhost/45101] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 17:58:28,786 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-379354125_17 at /127.0.0.1:58628 [Receiving block BP-2038357685-172.31.14.131-1693159090802:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:38267:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:58628 dst: /127.0.0.1:38267 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:28,786 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-2126862787_17 at /127.0.0.1:58660 [Receiving block BP-2038357685-172.31.14.131-1693159090802:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:38267:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:58660 dst: /127.0.0.1:38267 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:28,786 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-2126862787_17 at /127.0.0.1:58664 [Receiving block BP-2038357685-172.31.14.131-1693159090802:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:38267:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:58664 dst: /127.0.0.1:38267 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:28,884 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-2126862787_17 at /127.0.0.1:37288 [Receiving block BP-2038357685-172.31.14.131-1693159090802:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:44957:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:37288 dst: /127.0.0.1:44957 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:28,884 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-379354125_17 at /127.0.0.1:37262 [Receiving block BP-2038357685-172.31.14.131-1693159090802:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:44957:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:37262 dst: /127.0.0.1:44957 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:28,884 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-2126862787_17 at /127.0.0.1:37304 [Receiving block BP-2038357685-172.31.14.131-1693159090802:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:44957:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:37304 dst: /127.0.0.1:44957 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:28,886 WARN [BP-2038357685-172.31.14.131-1693159090802 heartbeating to localhost/127.0.0.1:33667] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-27 17:58:28,887 WARN [BP-2038357685-172.31.14.131-1693159090802 heartbeating to localhost/127.0.0.1:33667] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2038357685-172.31.14.131-1693159090802 (Datanode Uuid 44b734cd-4bab-4f39-b26d-b26488c08ca4) service to localhost/127.0.0.1:33667 2023-08-27 17:58:28,889 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428/dfs/data/data3/current/BP-2038357685-172.31.14.131-1693159090802] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:58:28,890 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428/dfs/data/data4/current/BP-2038357685-172.31.14.131-1693159090802] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:58:28,908 WARN [Listener at localhost/45101] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-27 17:58:28,910 WARN [Listener at localhost/45101] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 17:58:28,911 INFO [Listener at localhost/45101] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 17:58:28,917 INFO [Listener at localhost/45101] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/java.io.tmpdir/Jetty_localhost_37043_datanode____pprvaq/webapp 2023-08-27 17:58:29,016 INFO [Listener at localhost/45101] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37043 2023-08-27 17:58:29,028 WARN [Listener at localhost/44443] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 17:58:29,033 WARN [AsyncFSWAL-0-hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d-prefix:jenkins-hbase4.apache.org,37459,1693159095159] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:29,034 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase4.apache.org%2C37459%2C1693159095159:(num 1693159096658) roll requested 2023-08-27 17:58:29,053 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45265,DS-8bee91b4-66db-4405-b727-2c46f46480de,DISK] 2023-08-27 17:58:29,054 WARN [regionserver/jenkins-hbase4:0.logRoller] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(571): create fan-out dfs output /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.1693159109034 failed, retry = 0 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: /127.0.0.1:44957 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:29,139 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7b63ed91c09c2cc3: Processing first storage report for DS-2567c637-5684-4f18-8ca8-3b3fbd061d95 from datanode 44b734cd-4bab-4f39-b26d-b26488c08ca4 2023-08-27 17:58:29,140 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7b63ed91c09c2cc3: from storage DS-2567c637-5684-4f18-8ca8-3b3fbd061d95 node DatanodeRegistration(127.0.0.1:34641, datanodeUuid=44b734cd-4bab-4f39-b26d-b26488c08ca4, infoPort=43767, infoSecurePort=0, ipcPort=44443, storageInfo=lv=-57;cid=testClusterID;nsid=1578471101;c=1693159090802), blocks: 6, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-27 17:58:29,141 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7b63ed91c09c2cc3: Processing first storage report for DS-f0939227-5a7e-4561-aeda-d74279c1c15b from datanode 44b734cd-4bab-4f39-b26d-b26488c08ca4 2023-08-27 17:58:29,141 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7b63ed91c09c2cc3: from storage DS-f0939227-5a7e-4561-aeda-d74279c1c15b node DatanodeRegistration(127.0.0.1:34641, datanodeUuid=44b734cd-4bab-4f39-b26d-b26488c08ca4, infoPort=43767, infoSecurePort=0, ipcPort=44443, storageInfo=lv=-57;cid=testClusterID;nsid=1578471101;c=1693159090802), blocks: 5, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:58:29,162 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-2126862787_17 at /127.0.0.1:44644 [Receiving block BP-2038357685-172.31.14.131-1693159090802:blk_1073741838_1014]] datanode.DataXceiver(323): 127.0.0.1:45265:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:44644 dst: /127.0.0.1:45265 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:29,168 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34641,DS-2567c637-5684-4f18-8ca8-3b3fbd061d95,DISK] 2023-08-27 17:58:29,170 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45265,DS-8bee91b4-66db-4405-b727-2c46f46480de,DISK] 2023-08-27 17:58:29,178 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.1693159096658 with entries=6, filesize=3.19 KB; new WAL /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.1693159109034 2023-08-27 17:58:29,179 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34641,DS-2567c637-5684-4f18-8ca8-3b3fbd061d95,DISK], DatanodeInfoWithStorage[127.0.0.1:45265,DS-8bee91b4-66db-4405-b727-2c46f46480de,DISK]] 2023-08-27 17:58:29,179 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.1693159096658 is not closed yet, will try archiving it next time 2023-08-27 17:58:29,182 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:29,182 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:29,183 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-27 17:58:29,183 INFO [Listener at localhost/44443] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-27 17:58:29,186 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.1693159096658 2023-08-27 17:58:29,186 DEBUG [Listener at localhost/44443] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f579f2e to 127.0.0.1:52976 2023-08-27 17:58:29,186 DEBUG [Listener at localhost/44443] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 17:58:29,187 DEBUG [Listener at localhost/44443] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-27 17:58:29,187 DEBUG [Listener at localhost/44443] util.JVMClusterUtil(257): Found active master hash=318254385, stopped=false 2023-08-27 17:58:29,187 INFO [Listener at localhost/44443] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35739,1693159093983 2023-08-27 17:58:29,190 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x1004ee4ab140001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-27 17:58:29,190 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-27 17:58:29,190 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:29,190 INFO [Listener at localhost/44443] procedure2.ProcedureExecutor(629): Stopping 2023-08-27 17:58:29,190 DEBUG [Listener at localhost/44443] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x372a477c to 127.0.0.1:52976 2023-08-27 17:58:29,191 DEBUG [Listener at localhost/44443] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 17:58:29,191 INFO [Listener at localhost/44443] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37459,1693159095159' ***** 2023-08-27 17:58:29,192 INFO [Listener at localhost/44443] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-27 17:58:29,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 17:58:29,192 INFO [RS:0;jenkins-hbase4:37459] regionserver.HeapMemoryManager(220): Stopping 2023-08-27 17:58:29,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x1004ee4ab140001, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 17:58:29,192 INFO [RS:0;jenkins-hbase4:37459] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-27 17:58:29,192 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-27 17:58:29,192 INFO [RS:0;jenkins-hbase4:37459] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-27 17:58:29,193 INFO [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(3305): Received CLOSE for f91ef2c3585d4082c445f8ec893782b8 2023-08-27 17:58:29,194 WARN [IPC Server handler 0 on default port 33667] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.1693159096658 has not been closed. Lease recovery is in progress. RecoveryId = 1016 for block blk_1073741832_1008 2023-08-27 17:58:29,194 INFO [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(3305): Received CLOSE for bdfe61e18393efd14c6a431559814e82 2023-08-27 17:58:29,195 INFO [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37459,1693159095159 2023-08-27 17:58:29,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f91ef2c3585d4082c445f8ec893782b8, disabling compactions & flushes 2023-08-27 17:58:29,195 DEBUG [RS:0;jenkins-hbase4:37459] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x659b1c9a to 127.0.0.1:52976 2023-08-27 17:58:29,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8. 2023-08-27 17:58:29,196 DEBUG [RS:0;jenkins-hbase4:37459] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 17:58:29,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8. 2023-08-27 17:58:29,196 INFO [RS:0;jenkins-hbase4:37459] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-27 17:58:29,196 INFO [RS:0;jenkins-hbase4:37459] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-27 17:58:29,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8. after waiting 0 ms 2023-08-27 17:58:29,196 INFO [RS:0;jenkins-hbase4:37459] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-27 17:58:29,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8. 2023-08-27 17:58:29,196 INFO [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-27 17:58:29,197 INFO [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-08-27 17:58:29,197 DEBUG [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(1478): Online Regions={f91ef2c3585d4082c445f8ec893782b8=TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8., 1588230740=hbase:meta,,1.1588230740, bdfe61e18393efd14c6a431559814e82=hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82.} 2023-08-27 17:58:29,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f91ef2c3585d4082c445f8ec893782b8 1/1 column families, dataSize=2.05 KB heapSize=2.45 KB 2023-08-27 17:58:29,198 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-27 17:58:29,198 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-27 17:58:29,198 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.1693159096658 after 12ms 2023-08-27 17:58:29,198 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-27 17:58:29,199 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-27 17:58:29,199 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-27 17:58:29,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.92 KB heapSize=5.45 KB 2023-08-27 17:58:29,199 DEBUG [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(1504): Waiting on 1588230740, bdfe61e18393efd14c6a431559814e82, f91ef2c3585d4082c445f8ec893782b8 2023-08-27 17:58:29,207 WARN [AsyncFSWAL-0-hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d-prefix:jenkins-hbase4.apache.org,37459,1693159095159.meta] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:29,209 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase4.apache.org%2C37459%2C1693159095159.meta:.meta(num 1693159096887) roll requested 2023-08-27 17:58:29,230 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38267,DS-86c4e2af-7858-4746-be88-2273088e48c2,DISK] 2023-08-27 17:58:29,232 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41151,DS-b00d89d2-6584-46ed-8a87-3c4a79eff8d1,DISK] 2023-08-27 17:58:29,245 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.meta.1693159096887.meta with entries=12, filesize=3.87 KB; new WAL /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.meta.1693159109209.meta 2023-08-27 17:58:29,249 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38267,DS-86c4e2af-7858-4746-be88-2273088e48c2,DISK], DatanodeInfoWithStorage[127.0.0.1:41151,DS-b00d89d2-6584-46ed-8a87-3c4a79eff8d1,DISK]] 2023-08-27 17:58:29,249 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.meta.1693159096887.meta is not closed yet, will try archiving it next time 2023-08-27 17:58:29,249 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:29,250 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:29,252 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.meta.1693159096887.meta 2023-08-27 17:58:29,253 WARN [IPC Server handler 3 on default port 33667] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.meta.1693159096887.meta has not been closed. Lease recovery is in progress. RecoveryId = 1018 for block blk_1073741833_1009 2023-08-27 17:58:29,254 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.meta.1693159096887.meta after 1ms 2023-08-27 17:58:29,298 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.69 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/.tmp/info/f806449ec87a48db906e3fb9a53a71ef 2023-08-27 17:58:29,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.05 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/f91ef2c3585d4082c445f8ec893782b8/.tmp/info/2e1df84671cc4e09b07a9858029fd270 2023-08-27 17:58:29,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/f91ef2c3585d4082c445f8ec893782b8/.tmp/info/2e1df84671cc4e09b07a9858029fd270 as hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/f91ef2c3585d4082c445f8ec893782b8/info/2e1df84671cc4e09b07a9858029fd270 2023-08-27 17:58:29,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/f91ef2c3585d4082c445f8ec893782b8/info/2e1df84671cc4e09b07a9858029fd270, entries=2, sequenceid=6, filesize=6.8 K 2023-08-27 17:58:29,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.05 KB/2102, heapSize ~2.44 KB/2496, currentSize=0 B/0 for f91ef2c3585d4082c445f8ec893782b8 in 172ms, sequenceid=6, compaction requested=false 2023-08-27 17:58:29,376 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=240 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/.tmp/table/c53d39b36d6e404584c9cfba7c4324b3 2023-08-27 17:58:29,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/f91ef2c3585d4082c445f8ec893782b8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-27 17:58:29,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8. 2023-08-27 17:58:29,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f91ef2c3585d4082c445f8ec893782b8: 2023-08-27 17:58:29,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1693159098729.f91ef2c3585d4082c445f8ec893782b8. 2023-08-27 17:58:29,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bdfe61e18393efd14c6a431559814e82, disabling compactions & flushes 2023-08-27 17:58:29,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82. 2023-08-27 17:58:29,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82. 2023-08-27 17:58:29,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82. after waiting 0 ms 2023-08-27 17:58:29,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82. 2023-08-27 17:58:29,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing bdfe61e18393efd14c6a431559814e82 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-27 17:58:29,394 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/.tmp/info/f806449ec87a48db906e3fb9a53a71ef as hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/info/f806449ec87a48db906e3fb9a53a71ef 2023-08-27 17:58:29,399 DEBUG [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(1504): Waiting on 1588230740, bdfe61e18393efd14c6a431559814e82 2023-08-27 17:58:29,415 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/info/f806449ec87a48db906e3fb9a53a71ef, entries=20, sequenceid=14, filesize=7.4 K 2023-08-27 17:58:29,418 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/.tmp/table/c53d39b36d6e404584c9cfba7c4324b3 as hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/table/c53d39b36d6e404584c9cfba7c4324b3 2023-08-27 17:58:29,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/namespace/bdfe61e18393efd14c6a431559814e82/.tmp/info/3368d034344147b7afcf00b0aac6551d 2023-08-27 17:58:29,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/table/c53d39b36d6e404584c9cfba7c4324b3, entries=4, sequenceid=14, filesize=4.8 K 2023-08-27 17:58:29,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/namespace/bdfe61e18393efd14c6a431559814e82/.tmp/info/3368d034344147b7afcf00b0aac6551d as hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/namespace/bdfe61e18393efd14c6a431559814e82/info/3368d034344147b7afcf00b0aac6551d 2023-08-27 17:58:29,434 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.92 KB/2994, heapSize ~5.16 KB/5288, currentSize=0 B/0 for 1588230740 in 234ms, sequenceid=14, compaction requested=false 2023-08-27 17:58:29,444 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-08-27 17:58:29,445 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-27 17:58:29,446 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-27 17:58:29,446 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-27 17:58:29,447 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-27 17:58:29,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/namespace/bdfe61e18393efd14c6a431559814e82/info/3368d034344147b7afcf00b0aac6551d, entries=2, sequenceid=6, filesize=4.8 K 2023-08-27 17:58:29,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for bdfe61e18393efd14c6a431559814e82 in 60ms, sequenceid=6, compaction requested=false 2023-08-27 17:58:29,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/data/hbase/namespace/bdfe61e18393efd14c6a431559814e82/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-27 17:58:29,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82. 2023-08-27 17:58:29,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bdfe61e18393efd14c6a431559814e82: 2023-08-27 17:58:29,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1693159097168.bdfe61e18393efd14c6a431559814e82. 2023-08-27 17:58:29,497 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-08-27 17:58:29,497 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-08-27 17:58:29,599 INFO [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37459,1693159095159; all regions closed. 2023-08-27 17:58:30,500 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-27 17:58:33,199 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.1693159096658 after 4013ms 2023-08-27 17:58:33,201 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.1693159096658 to hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/oldWALs/jenkins-hbase4.apache.org%2C37459%2C1693159095159.1693159096658 2023-08-27 17:58:33,255 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.meta.1693159096887.meta after 4002ms 2023-08-27 17:58:33,256 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/WALs/jenkins-hbase4.apache.org,37459,1693159095159/jenkins-hbase4.apache.org%2C37459%2C1693159095159.meta.1693159096887.meta to hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/oldWALs/jenkins-hbase4.apache.org%2C37459%2C1693159095159.meta.1693159096887.meta 2023-08-27 17:58:33,261 DEBUG [RS:0;jenkins-hbase4:37459] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/oldWALs 2023-08-27 17:58:33,261 INFO [RS:0;jenkins-hbase4:37459] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37459%2C1693159095159.meta:.meta(num 1693159109209) 2023-08-27 17:58:33,270 DEBUG [RS:0;jenkins-hbase4:37459] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/oldWALs 2023-08-27 17:58:33,271 INFO [RS:0;jenkins-hbase4:37459] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37459%2C1693159095159:(num 1693159109034) 2023-08-27 17:58:33,271 DEBUG [RS:0;jenkins-hbase4:37459] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 17:58:33,271 INFO [RS:0;jenkins-hbase4:37459] regionserver.LeaseManager(133): Closed leases 2023-08-27 17:58:33,271 INFO [RS:0;jenkins-hbase4:37459] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-08-27 17:58:33,271 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-27 17:58:33,272 INFO [RS:0;jenkins-hbase4:37459] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37459 2023-08-27 17:58:33,278 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x1004ee4ab140001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37459,1693159095159 2023-08-27 17:58:33,278 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-27 17:58:33,278 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x1004ee4ab140001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-27 17:58:33,282 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37459,1693159095159] 2023-08-27 17:58:33,282 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37459,1693159095159; numProcessing=1 2023-08-27 17:58:33,285 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37459,1693159095159 already deleted, retry=false 2023-08-27 17:58:33,285 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37459,1693159095159 expired; onlineServers=0 2023-08-27 17:58:33,285 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35739,1693159093983' ***** 2023-08-27 17:58:33,285 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-27 17:58:33,286 DEBUG [M:0;jenkins-hbase4:35739] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53c5270a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-27 17:58:33,286 INFO [M:0;jenkins-hbase4:35739] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35739,1693159093983 2023-08-27 17:58:33,286 INFO [M:0;jenkins-hbase4:35739] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35739,1693159093983; all regions closed. 2023-08-27 17:58:33,286 DEBUG [M:0;jenkins-hbase4:35739] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 17:58:33,286 DEBUG [M:0;jenkins-hbase4:35739] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-27 17:58:33,286 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-27 17:58:33,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1693159096334] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1693159096334,5,FailOnTimeoutGroup] 2023-08-27 17:58:33,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1693159096336] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1693159096336,5,FailOnTimeoutGroup] 2023-08-27 17:58:33,286 DEBUG [M:0;jenkins-hbase4:35739] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-27 17:58:33,287 INFO [M:0;jenkins-hbase4:35739] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-27 17:58:33,287 INFO [M:0;jenkins-hbase4:35739] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-27 17:58:33,288 INFO [M:0;jenkins-hbase4:35739] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-27 17:58:33,288 DEBUG [M:0;jenkins-hbase4:35739] master.HMaster(1512): Stopping service threads 2023-08-27 17:58:33,288 INFO [M:0;jenkins-hbase4:35739] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-27 17:58:33,289 ERROR [M:0;jenkins-hbase4:35739] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] 2023-08-27 17:58:33,289 INFO [M:0;jenkins-hbase4:35739] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-27 17:58:33,289 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-27 17:58:33,290 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-27 17:58:33,290 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:33,290 DEBUG [M:0;jenkins-hbase4:35739] zookeeper.ZKUtil(398): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-27 17:58:33,290 WARN [M:0;jenkins-hbase4:35739] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-27 17:58:33,290 INFO [M:0;jenkins-hbase4:35739] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-27 17:58:33,291 INFO [M:0;jenkins-hbase4:35739] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-27 17:58:33,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-27 17:58:33,291 DEBUG [M:0;jenkins-hbase4:35739] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-27 17:58:33,291 INFO [M:0;jenkins-hbase4:35739] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:58:33,291 DEBUG [M:0;jenkins-hbase4:35739] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:58:33,291 DEBUG [M:0;jenkins-hbase4:35739] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-27 17:58:33,291 DEBUG [M:0;jenkins-hbase4:35739] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:58:33,291 INFO [M:0;jenkins-hbase4:35739] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.08 KB heapSize=45.73 KB 2023-08-27 17:58:33,292 WARN [AsyncFSWAL-0-hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData-prefix:jenkins-hbase4.apache.org,35739,1693159093983] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:33,292 DEBUG [master:store-WAL-Roller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase4.apache.org%2C35739%2C1693159093983:(num 1693159095599) roll requested 2023-08-27 17:58:33,312 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34641,DS-2567c637-5684-4f18-8ca8-3b3fbd061d95,DISK] 2023-08-27 17:58:33,312 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41151,DS-b00d89d2-6584-46ed-8a87-3c4a79eff8d1,DISK] 2023-08-27 17:58:33,319 INFO [master:store-WAL-Roller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/WALs/jenkins-hbase4.apache.org,35739,1693159093983/jenkins-hbase4.apache.org%2C35739%2C1693159093983.1693159095599 with entries=89, filesize=43.93 KB; new WAL /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/WALs/jenkins-hbase4.apache.org,35739,1693159093983/jenkins-hbase4.apache.org%2C35739%2C1693159093983.1693159113293 2023-08-27 17:58:33,322 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34641,DS-2567c637-5684-4f18-8ca8-3b3fbd061d95,DISK], DatanodeInfoWithStorage[127.0.0.1:41151,DS-b00d89d2-6584-46ed-8a87-3c4a79eff8d1,DISK]] 2023-08-27 17:58:33,322 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(716): hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/WALs/jenkins-hbase4.apache.org,35739,1693159093983/jenkins-hbase4.apache.org%2C35739%2C1693159093983.1693159095599 is not closed yet, will try archiving it next time 2023-08-27 17:58:33,322 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:33,323 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-27 17:58:33,323 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/WALs/jenkins-hbase4.apache.org,35739,1693159093983/jenkins-hbase4.apache.org%2C35739%2C1693159093983.1693159095599 2023-08-27 17:58:33,324 WARN [IPC Server handler 3 on default port 33667] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/WALs/jenkins-hbase4.apache.org,35739,1693159093983/jenkins-hbase4.apache.org%2C35739%2C1693159093983.1693159095599 has not been closed. Lease recovery is in progress. RecoveryId = 1024 for block blk_1073741829_1005 2023-08-27 17:58:33,324 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/WALs/jenkins-hbase4.apache.org,35739,1693159093983/jenkins-hbase4.apache.org%2C35739%2C1693159093983.1693159095599 after 1ms 2023-08-27 17:58:33,341 INFO [M:0;jenkins-hbase4:35739] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.08 KB at sequenceid=91 (bloomFilter=true), to=hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c96bf68336043fb82acdcd5563f46cb 2023-08-27 17:58:33,350 DEBUG [M:0;jenkins-hbase4:35739] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c96bf68336043fb82acdcd5563f46cb as hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c96bf68336043fb82acdcd5563f46cb 2023-08-27 17:58:33,357 INFO [M:0;jenkins-hbase4:35739] regionserver.HStore(1080): Added hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c96bf68336043fb82acdcd5563f46cb, entries=11, sequenceid=91, filesize=7.0 K 2023-08-27 17:58:33,358 INFO [M:0;jenkins-hbase4:35739] regionserver.HRegion(2948): Finished flush of dataSize ~38.08 KB/38997, heapSize ~45.72 KB/46816, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 67ms, sequenceid=91, compaction requested=false 2023-08-27 17:58:33,360 INFO [M:0;jenkins-hbase4:35739] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:58:33,360 DEBUG [M:0;jenkins-hbase4:35739] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-27 17:58:33,382 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x1004ee4ab140001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 17:58:33,382 INFO [RS:0;jenkins-hbase4:37459] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37459,1693159095159; zookeeper connection closed. 2023-08-27 17:58:33,382 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x1004ee4ab140001, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 17:58:33,383 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@20a07aad] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@20a07aad 2023-08-27 17:58:33,383 INFO [Listener at localhost/44443] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-27 17:58:34,150 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-27 17:58:34,933 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-27 17:58:37,325 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/WALs/jenkins-hbase4.apache.org,35739,1693159093983/jenkins-hbase4.apache.org%2C35739%2C1693159093983.1693159095599 after 4002ms 2023-08-27 17:58:37,326 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/WALs/jenkins-hbase4.apache.org,35739,1693159093983/jenkins-hbase4.apache.org%2C35739%2C1693159093983.1693159095599 to hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/oldWALs/jenkins-hbase4.apache.org%2C35739%2C1693159093983.1693159095599 2023-08-27 17:58:37,333 INFO [WAL-Archive-0] region.MasterRegionUtils(50): Moved hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/MasterData/oldWALs/jenkins-hbase4.apache.org%2C35739%2C1693159093983.1693159095599 to hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/oldWALs/jenkins-hbase4.apache.org%2C35739%2C1693159093983.1693159095599$masterlocalwal$ 2023-08-27 17:58:37,333 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-27 17:58:37,333 INFO [M:0;jenkins-hbase4:35739] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-27 17:58:37,334 INFO [M:0;jenkins-hbase4:35739] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35739 2023-08-27 17:58:37,338 DEBUG [M:0;jenkins-hbase4:35739] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35739,1693159093983 already deleted, retry=false 2023-08-27 17:58:37,440 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 17:58:37,440 INFO [M:0;jenkins-hbase4:35739] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35739,1693159093983; zookeeper connection closed. 2023-08-27 17:58:37,440 DEBUG [Listener at localhost/35181-EventThread] zookeeper.ZKWatcher(600): master:35739-0x1004ee4ab140000, quorum=127.0.0.1:52976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 17:58:37,442 WARN [Listener at localhost/44443] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-27 17:58:37,447 INFO [Listener at localhost/44443] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 17:58:37,550 WARN [BP-2038357685-172.31.14.131-1693159090802 heartbeating to localhost/127.0.0.1:33667] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-27 17:58:37,551 WARN [BP-2038357685-172.31.14.131-1693159090802 heartbeating to localhost/127.0.0.1:33667] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2038357685-172.31.14.131-1693159090802 (Datanode Uuid 44b734cd-4bab-4f39-b26d-b26488c08ca4) service to localhost/127.0.0.1:33667 2023-08-27 17:58:37,551 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428/dfs/data/data3/current/BP-2038357685-172.31.14.131-1693159090802] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:58:37,552 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428/dfs/data/data4/current/BP-2038357685-172.31.14.131-1693159090802] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:58:37,555 WARN [Listener at localhost/44443] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-27 17:58:37,558 INFO [Listener at localhost/44443] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 17:58:37,662 WARN [BP-2038357685-172.31.14.131-1693159090802 heartbeating to localhost/127.0.0.1:33667] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-27 17:58:37,662 WARN [BP-2038357685-172.31.14.131-1693159090802 heartbeating to localhost/127.0.0.1:33667] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2038357685-172.31.14.131-1693159090802 (Datanode Uuid f5928fa8-54e9-4202-b248-7fa489c9d71c) service to localhost/127.0.0.1:33667 2023-08-27 17:58:37,662 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428/dfs/data/data9/current/BP-2038357685-172.31.14.131-1693159090802] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:58:37,663 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428/dfs/data/data10/current/BP-2038357685-172.31.14.131-1693159090802] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:58:37,664 WARN [Listener at localhost/44443] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-27 17:58:37,669 INFO [Listener at localhost/44443] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 17:58:37,772 WARN [BP-2038357685-172.31.14.131-1693159090802 heartbeating to localhost/127.0.0.1:33667] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-27 17:58:37,772 WARN [BP-2038357685-172.31.14.131-1693159090802 heartbeating to localhost/127.0.0.1:33667] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2038357685-172.31.14.131-1693159090802 (Datanode Uuid d3dbcc57-26c7-4429-85c9-225fe173ce72) service to localhost/127.0.0.1:33667 2023-08-27 17:58:37,773 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428/dfs/data/data7/current/BP-2038357685-172.31.14.131-1693159090802] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:58:37,773 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428/dfs/data/data8/current/BP-2038357685-172.31.14.131-1693159090802] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:58:37,774 WARN [Listener at localhost/44443] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-27 17:58:37,777 INFO [Listener at localhost/44443] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 17:58:37,881 WARN [BP-2038357685-172.31.14.131-1693159090802 heartbeating to localhost/127.0.0.1:33667] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-27 17:58:37,881 WARN [BP-2038357685-172.31.14.131-1693159090802 heartbeating to localhost/127.0.0.1:33667] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2038357685-172.31.14.131-1693159090802 (Datanode Uuid b4b9bedc-3057-4c13-a562-f1443eb831e1) service to localhost/127.0.0.1:33667 2023-08-27 17:58:37,882 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428/dfs/data/data5/current/BP-2038357685-172.31.14.131-1693159090802] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:58:37,882 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428/dfs/data/data6/current/BP-2038357685-172.31.14.131-1693159090802] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:58:37,884 WARN [Listener at localhost/44443] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-27 17:58:37,887 INFO [Listener at localhost/44443] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 17:58:37,888 WARN [BP-2038357685-172.31.14.131-1693159090802 heartbeating to localhost/127.0.0.1:33667] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-27 17:58:37,888 WARN [BP-2038357685-172.31.14.131-1693159090802 heartbeating to localhost/127.0.0.1:33667] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2038357685-172.31.14.131-1693159090802 (Datanode Uuid d093ab70-9f85-494b-bafc-8c553b8656b5) service to localhost/127.0.0.1:33667 2023-08-27 17:58:37,888 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428/dfs/data/data1/current/BP-2038357685-172.31.14.131-1693159090802] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:58:37,889 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/cluster_7d81cd08-0293-64cf-63cf-ec1862088428/dfs/data/data2/current/BP-2038357685-172.31.14.131-1693159090802] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:58:37,922 INFO [Listener at localhost/44443] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 17:58:38,039 INFO [Listener at localhost/44443] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-27 17:58:38,097 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-27 17:58:38,122 INFO [Listener at localhost/44443] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=77 (was 10) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2131506352) connection to localhost/127.0.0.1:33667 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (2131506352) connection to localhost/127.0.0.1:33667 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44443 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33667 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@70c11809 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:33667 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2131506352) connection to localhost/127.0.0.1:33667 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=474 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=236 (was 194) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=11808 (was 11692) - AvailableMemoryMB LEAK? - 2023-08-27 17:58:38,137 INFO [Listener at localhost/44443] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=77, OpenFileDescriptor=474, MaxFileDescriptor=60000, SystemLoadAverage=236, ProcessCount=168, AvailableMemoryMB=11808 2023-08-27 17:58:38,137 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-27 17:58:38,137 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/hadoop.log.dir so I do NOT create it in target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b 2023-08-27 17:58:38,137 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/104950b6-21a5-686c-8cf6-dff4fe9e237b/hadoop.tmp.dir so I do NOT create it in target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b 2023-08-27 17:58:38,137 INFO [Listener at localhost/44443] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/cluster_b6a8c29c-23a7-3d41-186e-41924b702daf, deleteOnExit=true 2023-08-27 17:58:38,137 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-27 17:58:38,137 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/test.cache.data in system properties and HBase conf 2023-08-27 17:58:38,138 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/hadoop.tmp.dir in system properties and HBase conf 2023-08-27 17:58:38,138 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/hadoop.log.dir in system properties and HBase conf 2023-08-27 17:58:38,138 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-27 17:58:38,138 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-27 17:58:38,138 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-27 17:58:38,138 DEBUG [Listener at localhost/44443] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-27 17:58:38,138 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-27 17:58:38,139 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-27 17:58:38,139 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-27 17:58:38,139 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-27 17:58:38,139 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-27 17:58:38,139 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-27 17:58:38,139 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-27 17:58:38,139 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-27 17:58:38,139 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-27 17:58:38,139 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/nfs.dump.dir in system properties and HBase conf 2023-08-27 17:58:38,140 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/java.io.tmpdir in system properties and HBase conf 2023-08-27 17:58:38,140 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-27 17:58:38,140 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-27 17:58:38,140 INFO [Listener at localhost/44443] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-27 17:58:38,147 WARN [Listener at localhost/44443] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-27 17:58:38,147 WARN [Listener at localhost/44443] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-27 17:58:38,200 WARN [Listener at localhost/44443] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 17:58:38,204 INFO [Listener at localhost/44443] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 17:58:38,208 INFO [Listener at localhost/44443] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/java.io.tmpdir/Jetty_localhost_33935_hdfs____.fpipnf/webapp 2023-08-27 17:58:38,319 INFO [Listener at localhost/44443] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33935 2023-08-27 17:58:38,325 WARN [Listener at localhost/44443] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-27 17:58:38,325 WARN [Listener at localhost/44443] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-27 17:58:38,380 WARN [Listener at localhost/40029] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 17:58:38,401 WARN [Listener at localhost/40029] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-27 17:58:38,404 WARN [Listener at localhost/40029] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 17:58:38,406 INFO [Listener at localhost/40029] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 17:58:38,411 INFO [Listener at localhost/40029] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/java.io.tmpdir/Jetty_localhost_36485_datanode____jpht5h/webapp 2023-08-27 17:58:38,507 INFO [Listener at localhost/40029] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36485 2023-08-27 17:58:38,514 WARN [Listener at localhost/41467] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 17:58:38,527 WARN [Listener at localhost/41467] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-27 17:58:38,529 WARN [Listener at localhost/41467] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 17:58:38,531 INFO [Listener at localhost/41467] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 17:58:38,534 INFO [Listener at localhost/41467] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/java.io.tmpdir/Jetty_localhost_40417_datanode____.hn7wb/webapp 2023-08-27 17:58:38,613 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd42d7686bbb0bf04: Processing first storage report for DS-ff837d5b-8b8d-4f76-8802-3ed0fddd7ab6 from datanode 6b7f5c64-eb7e-4469-b152-4ac6c6d81b0d 2023-08-27 17:58:38,613 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd42d7686bbb0bf04: from storage DS-ff837d5b-8b8d-4f76-8802-3ed0fddd7ab6 node DatanodeRegistration(127.0.0.1:43625, datanodeUuid=6b7f5c64-eb7e-4469-b152-4ac6c6d81b0d, infoPort=36413, infoSecurePort=0, ipcPort=41467, storageInfo=lv=-57;cid=testClusterID;nsid=208766589;c=1693159118151), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-27 17:58:38,613 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd42d7686bbb0bf04: Processing first storage report for DS-fd9893c7-2fad-4fea-9448-ed31d61d05fe from datanode 6b7f5c64-eb7e-4469-b152-4ac6c6d81b0d 2023-08-27 17:58:38,614 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd42d7686bbb0bf04: from storage DS-fd9893c7-2fad-4fea-9448-ed31d61d05fe node DatanodeRegistration(127.0.0.1:43625, datanodeUuid=6b7f5c64-eb7e-4469-b152-4ac6c6d81b0d, infoPort=36413, infoSecurePort=0, ipcPort=41467, storageInfo=lv=-57;cid=testClusterID;nsid=208766589;c=1693159118151), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:58:38,636 INFO [Listener at localhost/41467] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40417 2023-08-27 17:58:38,645 WARN [Listener at localhost/46281] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 17:58:38,742 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd9caf6aeb789f882: Processing first storage report for DS-6ebfbf9b-9a5f-4052-b527-87148a278b91 from datanode 6485c032-9b3b-4dae-8b8e-4b972bdb8a0f 2023-08-27 17:58:38,742 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd9caf6aeb789f882: from storage DS-6ebfbf9b-9a5f-4052-b527-87148a278b91 node DatanodeRegistration(127.0.0.1:43745, datanodeUuid=6485c032-9b3b-4dae-8b8e-4b972bdb8a0f, infoPort=33177, infoSecurePort=0, ipcPort=46281, storageInfo=lv=-57;cid=testClusterID;nsid=208766589;c=1693159118151), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:58:38,742 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd9caf6aeb789f882: Processing first storage report for DS-807c6601-6344-4e8b-aa68-4d39b1ce5fd6 from datanode 6485c032-9b3b-4dae-8b8e-4b972bdb8a0f 2023-08-27 17:58:38,742 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd9caf6aeb789f882: from storage DS-807c6601-6344-4e8b-aa68-4d39b1ce5fd6 node DatanodeRegistration(127.0.0.1:43745, datanodeUuid=6485c032-9b3b-4dae-8b8e-4b972bdb8a0f, infoPort=33177, infoSecurePort=0, ipcPort=46281, storageInfo=lv=-57;cid=testClusterID;nsid=208766589;c=1693159118151), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:58:38,752 DEBUG [Listener at localhost/46281] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b 2023-08-27 17:58:38,755 INFO [Listener at localhost/46281] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/cluster_b6a8c29c-23a7-3d41-186e-41924b702daf/zookeeper_0, clientPort=54675, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/cluster_b6a8c29c-23a7-3d41-186e-41924b702daf/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/cluster_b6a8c29c-23a7-3d41-186e-41924b702daf/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-27 17:58:38,756 INFO [Listener at localhost/46281] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54675 2023-08-27 17:58:38,757 INFO [Listener at localhost/46281] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:38,758 INFO [Listener at localhost/46281] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:38,773 INFO [Listener at localhost/46281] util.FSUtils(471): Created version file at hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e with version=8 2023-08-27 17:58:38,773 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/hbase-staging 2023-08-27 17:58:38,775 INFO [Listener at localhost/46281] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-27 17:58:38,775 INFO [Listener at localhost/46281] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 17:58:38,775 INFO [Listener at localhost/46281] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-27 17:58:38,775 INFO [Listener at localhost/46281] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-27 17:58:38,775 INFO [Listener at localhost/46281] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 17:58:38,775 INFO [Listener at localhost/46281] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-27 17:58:38,775 INFO [Listener at localhost/46281] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-27 17:58:38,776 INFO [Listener at localhost/46281] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42741 2023-08-27 17:58:38,777 INFO [Listener at localhost/46281] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:38,778 INFO [Listener at localhost/46281] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:38,779 INFO [Listener at localhost/46281] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42741 connecting to ZooKeeper ensemble=127.0.0.1:54675 2023-08-27 17:58:38,786 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:427410x0, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-27 17:58:38,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42741-0x1004ee50f480000 connected 2023-08-27 17:58:38,801 DEBUG [Listener at localhost/46281] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-27 17:58:38,801 DEBUG [Listener at localhost/46281] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 17:58:38,802 DEBUG [Listener at localhost/46281] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-27 17:58:38,802 DEBUG [Listener at localhost/46281] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42741 2023-08-27 17:58:38,802 DEBUG [Listener at localhost/46281] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42741 2023-08-27 17:58:38,802 DEBUG [Listener at localhost/46281] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42741 2023-08-27 17:58:38,803 DEBUG [Listener at localhost/46281] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42741 2023-08-27 17:58:38,803 DEBUG [Listener at localhost/46281] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42741 2023-08-27 17:58:38,803 INFO [Listener at localhost/46281] master.HMaster(444): hbase.rootdir=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e, hbase.cluster.distributed=false 2023-08-27 17:58:38,816 INFO [Listener at localhost/46281] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-27 17:58:38,816 INFO [Listener at localhost/46281] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 17:58:38,817 INFO [Listener at localhost/46281] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-27 17:58:38,817 INFO [Listener at localhost/46281] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-27 17:58:38,817 INFO [Listener at localhost/46281] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 17:58:38,817 INFO [Listener at localhost/46281] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-27 17:58:38,817 INFO [Listener at localhost/46281] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-27 17:58:38,818 INFO [Listener at localhost/46281] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45355 2023-08-27 17:58:38,819 INFO [Listener at localhost/46281] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-27 17:58:38,820 DEBUG [Listener at localhost/46281] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-27 17:58:38,821 INFO [Listener at localhost/46281] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:38,822 INFO [Listener at localhost/46281] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:38,823 INFO [Listener at localhost/46281] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45355 connecting to ZooKeeper ensemble=127.0.0.1:54675 2023-08-27 17:58:38,825 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:453550x0, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-27 17:58:38,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45355-0x1004ee50f480001 connected 2023-08-27 17:58:38,827 DEBUG [Listener at localhost/46281] zookeeper.ZKUtil(164): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-27 17:58:38,827 DEBUG [Listener at localhost/46281] zookeeper.ZKUtil(164): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 17:58:38,828 DEBUG [Listener at localhost/46281] zookeeper.ZKUtil(164): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-27 17:58:38,828 DEBUG [Listener at localhost/46281] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45355 2023-08-27 17:58:38,829 DEBUG [Listener at localhost/46281] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45355 2023-08-27 17:58:38,829 DEBUG [Listener at localhost/46281] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45355 2023-08-27 17:58:38,832 DEBUG [Listener at localhost/46281] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45355 2023-08-27 17:58:38,832 DEBUG [Listener at localhost/46281] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45355 2023-08-27 17:58:38,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42741,1693159118774 2023-08-27 17:58:38,836 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-27 17:58:38,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42741,1693159118774 2023-08-27 17:58:38,838 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-27 17:58:38,838 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:38,838 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-27 17:58:38,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-27 17:58:38,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-27 17:58:38,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42741,1693159118774 from backup master directory 2023-08-27 17:58:38,842 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42741,1693159118774 2023-08-27 17:58:38,842 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-27 17:58:38,842 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-27 17:58:38,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42741,1693159118774 2023-08-27 17:58:38,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/hbase.id with ID: 114eda07-c58b-428a-a0f4-2f46fd073e84 2023-08-27 17:58:38,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:38,886 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:38,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x72f4d8de to 127.0.0.1:54675 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-27 17:58:38,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5863b88a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-27 17:58:38,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-27 17:58:38,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-27 17:58:38,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-27 17:58:38,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/MasterData/data/master/store-tmp 2023-08-27 17:58:38,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:38,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-27 17:58:38,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:58:38,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:58:38,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-27 17:58:38,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:58:38,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:58:38,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-27 17:58:38,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/MasterData/WALs/jenkins-hbase4.apache.org,42741,1693159118774 2023-08-27 17:58:38,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42741%2C1693159118774, suffix=, logDir=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/MasterData/WALs/jenkins-hbase4.apache.org,42741,1693159118774, archiveDir=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/MasterData/oldWALs, maxLogs=10 2023-08-27 17:58:38,957 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43625,DS-ff837d5b-8b8d-4f76-8802-3ed0fddd7ab6,DISK] 2023-08-27 17:58:38,965 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43745,DS-6ebfbf9b-9a5f-4052-b527-87148a278b91,DISK] 2023-08-27 17:58:38,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/MasterData/WALs/jenkins-hbase4.apache.org,42741,1693159118774/jenkins-hbase4.apache.org%2C42741%2C1693159118774.1693159118935 2023-08-27 17:58:38,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43625,DS-ff837d5b-8b8d-4f76-8802-3ed0fddd7ab6,DISK], DatanodeInfoWithStorage[127.0.0.1:43745,DS-6ebfbf9b-9a5f-4052-b527-87148a278b91,DISK]] 2023-08-27 17:58:38,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-27 17:58:38,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:38,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:58:38,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:58:38,982 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:58:38,986 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-27 17:58:38,987 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-27 17:58:38,988 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:38,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:58:38,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:58:38,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:58:38,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-27 17:58:38,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=732286, jitterRate=-0.06885117292404175}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-27 17:58:38,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-27 17:58:38,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-27 17:58:39,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-27 17:58:39,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-27 17:58:39,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-27 17:58:39,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-27 17:58:39,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-27 17:58:39,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-27 17:58:39,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-27 17:58:39,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-27 17:58:39,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-27 17:58:39,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-27 17:58:39,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-27 17:58:39,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-27 17:58:39,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-27 17:58:39,027 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:39,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-27 17:58:39,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-27 17:58:39,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-27 17:58:39,034 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-27 17:58:39,034 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:39,034 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-27 17:58:39,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42741,1693159118774, sessionid=0x1004ee50f480000, setting cluster-up flag (Was=false) 2023-08-27 17:58:39,042 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:39,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-27 17:58:39,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42741,1693159118774 2023-08-27 17:58:39,053 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:39,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-27 17:58:39,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42741,1693159118774 2023-08-27 17:58:39,062 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/.hbase-snapshot/.tmp 2023-08-27 17:58:39,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-27 17:58:39,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 17:58:39,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 17:58:39,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 17:58:39,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 17:58:39,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-27 17:58:39,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:39,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-27 17:58:39,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:39,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1693159149088 2023-08-27 17:58:39,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-27 17:58:39,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-27 17:58:39,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-27 17:58:39,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-27 17:58:39,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-27 17:58:39,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-27 17:58:39,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:39,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-27 17:58:39,090 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-27 17:58:39,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-27 17:58:39,091 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-27 17:58:39,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-27 17:58:39,092 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-27 17:58:39,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-27 17:58:39,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-27 17:58:39,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1693159119094,5,FailOnTimeoutGroup] 2023-08-27 17:58:39,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1693159119094,5,FailOnTimeoutGroup] 2023-08-27 17:58:39,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:39,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-27 17:58:39,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:39,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:39,111 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-27 17:58:39,112 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-27 17:58:39,112 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e 2023-08-27 17:58:39,135 INFO [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(951): ClusterId : 114eda07-c58b-428a-a0f4-2f46fd073e84 2023-08-27 17:58:39,135 DEBUG [RS:0;jenkins-hbase4:45355] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-27 17:58:39,138 DEBUG [RS:0;jenkins-hbase4:45355] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-27 17:58:39,138 DEBUG [RS:0;jenkins-hbase4:45355] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-27 17:58:39,141 DEBUG [RS:0;jenkins-hbase4:45355] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-27 17:58:39,142 DEBUG [RS:0;jenkins-hbase4:45355] zookeeper.ReadOnlyZKClient(139): Connect 0x7a404b3d to 127.0.0.1:54675 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-27 17:58:39,146 DEBUG [RS:0;jenkins-hbase4:45355] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7487ba05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-27 17:58:39,147 DEBUG [RS:0;jenkins-hbase4:45355] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70b8204d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-27 17:58:39,157 DEBUG [RS:0;jenkins-hbase4:45355] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45355 2023-08-27 17:58:39,157 INFO [RS:0;jenkins-hbase4:45355] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-27 17:58:39,157 INFO [RS:0;jenkins-hbase4:45355] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-27 17:58:39,157 DEBUG [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(1022): About to register with Master. 2023-08-27 17:58:39,158 INFO [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42741,1693159118774 with isa=jenkins-hbase4.apache.org/172.31.14.131:45355, startcode=1693159118816 2023-08-27 17:58:39,159 DEBUG [RS:0;jenkins-hbase4:45355] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-27 17:58:39,162 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44663, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-08-27 17:58:39,163 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42741] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:39,164 DEBUG [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e 2023-08-27 17:58:39,164 DEBUG [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40029 2023-08-27 17:58:39,164 DEBUG [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-27 17:58:39,167 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-27 17:58:39,168 DEBUG [RS:0;jenkins-hbase4:45355] zookeeper.ZKUtil(162): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:39,168 WARN [RS:0;jenkins-hbase4:45355] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-27 17:58:39,168 INFO [RS:0;jenkins-hbase4:45355] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-27 17:58:39,168 DEBUG [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:39,168 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45355,1693159118816] 2023-08-27 17:58:39,173 DEBUG [RS:0;jenkins-hbase4:45355] zookeeper.ZKUtil(162): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:39,174 DEBUG [RS:0;jenkins-hbase4:45355] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-27 17:58:39,175 INFO [RS:0;jenkins-hbase4:45355] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-27 17:58:39,178 INFO [RS:0;jenkins-hbase4:45355] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-27 17:58:39,184 INFO [RS:0;jenkins-hbase4:45355] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-27 17:58:39,185 INFO [RS:0;jenkins-hbase4:45355] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:39,185 INFO [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-27 17:58:39,186 INFO [RS:0;jenkins-hbase4:45355] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:39,187 DEBUG [RS:0;jenkins-hbase4:45355] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:39,187 DEBUG [RS:0;jenkins-hbase4:45355] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:39,187 DEBUG [RS:0;jenkins-hbase4:45355] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:39,187 DEBUG [RS:0;jenkins-hbase4:45355] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:39,187 DEBUG [RS:0;jenkins-hbase4:45355] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:39,187 DEBUG [RS:0;jenkins-hbase4:45355] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-27 17:58:39,187 DEBUG [RS:0;jenkins-hbase4:45355] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:39,187 DEBUG [RS:0;jenkins-hbase4:45355] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:39,187 DEBUG [RS:0;jenkins-hbase4:45355] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:39,187 DEBUG [RS:0;jenkins-hbase4:45355] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:58:39,188 INFO [RS:0;jenkins-hbase4:45355] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:39,188 INFO [RS:0;jenkins-hbase4:45355] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:39,188 INFO [RS:0;jenkins-hbase4:45355] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:39,200 INFO [RS:0;jenkins-hbase4:45355] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-27 17:58:39,200 INFO [RS:0;jenkins-hbase4:45355] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45355,1693159118816-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:39,211 INFO [RS:0;jenkins-hbase4:45355] regionserver.Replication(203): jenkins-hbase4.apache.org,45355,1693159118816 started 2023-08-27 17:58:39,211 INFO [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45355,1693159118816, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45355, sessionid=0x1004ee50f480001 2023-08-27 17:58:39,211 DEBUG [RS:0;jenkins-hbase4:45355] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-27 17:58:39,211 DEBUG [RS:0;jenkins-hbase4:45355] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:39,212 DEBUG [RS:0;jenkins-hbase4:45355] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45355,1693159118816' 2023-08-27 17:58:39,212 DEBUG [RS:0;jenkins-hbase4:45355] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-27 17:58:39,212 DEBUG [RS:0;jenkins-hbase4:45355] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-27 17:58:39,212 DEBUG [RS:0;jenkins-hbase4:45355] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-27 17:58:39,213 DEBUG [RS:0;jenkins-hbase4:45355] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-27 17:58:39,213 DEBUG [RS:0;jenkins-hbase4:45355] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:39,213 DEBUG [RS:0;jenkins-hbase4:45355] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45355,1693159118816' 2023-08-27 17:58:39,213 DEBUG [RS:0;jenkins-hbase4:45355] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-27 17:58:39,213 DEBUG [RS:0;jenkins-hbase4:45355] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-27 17:58:39,213 DEBUG [RS:0;jenkins-hbase4:45355] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-27 17:58:39,213 INFO [RS:0;jenkins-hbase4:45355] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-27 17:58:39,213 INFO [RS:0;jenkins-hbase4:45355] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-27 17:58:39,316 INFO [RS:0;jenkins-hbase4:45355] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45355%2C1693159118816, suffix=, logDir=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816, archiveDir=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/oldWALs, maxLogs=32 2023-08-27 17:58:39,336 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43745,DS-6ebfbf9b-9a5f-4052-b527-87148a278b91,DISK] 2023-08-27 17:58:39,336 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43625,DS-ff837d5b-8b8d-4f76-8802-3ed0fddd7ab6,DISK] 2023-08-27 17:58:39,338 INFO [RS:0;jenkins-hbase4:45355] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159119318 2023-08-27 17:58:39,339 DEBUG [RS:0;jenkins-hbase4:45355] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43745,DS-6ebfbf9b-9a5f-4052-b527-87148a278b91,DISK], DatanodeInfoWithStorage[127.0.0.1:43625,DS-ff837d5b-8b8d-4f76-8802-3ed0fddd7ab6,DISK]] 2023-08-27 17:58:39,526 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:39,528 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-27 17:58:39,530 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/info 2023-08-27 17:58:39,530 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-27 17:58:39,531 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:39,531 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-27 17:58:39,533 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/rep_barrier 2023-08-27 17:58:39,533 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-27 17:58:39,534 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:39,534 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-27 17:58:39,536 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/table 2023-08-27 17:58:39,536 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-27 17:58:39,537 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:39,538 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740 2023-08-27 17:58:39,539 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740 2023-08-27 17:58:39,542 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-27 17:58:39,543 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-27 17:58:39,546 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-27 17:58:39,546 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=711928, jitterRate=-0.09473782777786255}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-27 17:58:39,546 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-27 17:58:39,547 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-27 17:58:39,547 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-27 17:58:39,547 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-27 17:58:39,547 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-27 17:58:39,547 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-27 17:58:39,547 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-27 17:58:39,547 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-27 17:58:39,548 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-27 17:58:39,549 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-27 17:58:39,549 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-27 17:58:39,550 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-27 17:58:39,552 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-27 17:58:39,702 DEBUG [jenkins-hbase4:42741] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-27 17:58:39,703 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45355,1693159118816, state=OPENING 2023-08-27 17:58:39,704 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-27 17:58:39,706 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:39,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45355,1693159118816}] 2023-08-27 17:58:39,706 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-27 17:58:39,861 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:39,861 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-27 17:58:39,863 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-27 17:58:39,868 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-27 17:58:39,868 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-27 17:58:39,870 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45355%2C1693159118816.meta, suffix=.meta, logDir=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816, archiveDir=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/oldWALs, maxLogs=32 2023-08-27 17:58:39,887 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43745,DS-6ebfbf9b-9a5f-4052-b527-87148a278b91,DISK] 2023-08-27 17:58:39,888 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43625,DS-ff837d5b-8b8d-4f76-8802-3ed0fddd7ab6,DISK] 2023-08-27 17:58:39,890 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816/jenkins-hbase4.apache.org%2C45355%2C1693159118816.meta.1693159119871.meta 2023-08-27 17:58:39,890 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43745,DS-6ebfbf9b-9a5f-4052-b527-87148a278b91,DISK], DatanodeInfoWithStorage[127.0.0.1:43625,DS-ff837d5b-8b8d-4f76-8802-3ed0fddd7ab6,DISK]] 2023-08-27 17:58:39,891 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-27 17:58:39,891 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-27 17:58:39,891 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-27 17:58:39,891 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-27 17:58:39,892 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-27 17:58:39,892 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:39,892 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-27 17:58:39,892 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-27 17:58:39,893 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-27 17:58:39,894 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/info 2023-08-27 17:58:39,894 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/info 2023-08-27 17:58:39,895 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-27 17:58:39,896 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:39,896 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-27 17:58:39,941 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/rep_barrier 2023-08-27 17:58:39,941 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/rep_barrier 2023-08-27 17:58:39,942 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-27 17:58:39,943 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:39,943 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-27 17:58:39,945 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/table 2023-08-27 17:58:39,945 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/table 2023-08-27 17:58:39,946 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-27 17:58:39,946 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:39,947 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740 2023-08-27 17:58:39,949 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740 2023-08-27 17:58:39,952 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-27 17:58:39,953 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-27 17:58:39,955 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=823048, jitterRate=0.04656030237674713}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-27 17:58:39,955 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-27 17:58:39,956 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1693159119860 2023-08-27 17:58:39,959 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-27 17:58:39,960 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-27 17:58:39,961 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45355,1693159118816, state=OPEN 2023-08-27 17:58:39,962 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-27 17:58:39,962 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-27 17:58:39,965 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-27 17:58:39,965 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45355,1693159118816 in 256 msec 2023-08-27 17:58:39,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-27 17:58:39,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 416 msec 2023-08-27 17:58:39,970 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 888 msec 2023-08-27 17:58:39,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1693159119970, completionTime=-1 2023-08-27 17:58:39,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-27 17:58:39,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-27 17:58:39,972 DEBUG [hconnection-0x541c6a2e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-27 17:58:39,974 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-27 17:58:39,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-27 17:58:39,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1693159179976 2023-08-27 17:58:39,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1693159239976 2023-08-27 17:58:39,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-08-27 17:58:39,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42741,1693159118774-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:39,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42741,1693159118774-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:39,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42741,1693159118774-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:39,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42741, period=300000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:39,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-27 17:58:39,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-27 17:58:39,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-27 17:58:39,984 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-27 17:58:39,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-27 17:58:39,986 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-27 17:58:39,987 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-27 17:58:39,989 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/.tmp/data/hbase/namespace/c7699c4ec9962d19958b3399508787c8 2023-08-27 17:58:39,989 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/.tmp/data/hbase/namespace/c7699c4ec9962d19958b3399508787c8 empty. 2023-08-27 17:58:39,990 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/.tmp/data/hbase/namespace/c7699c4ec9962d19958b3399508787c8 2023-08-27 17:58:39,990 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-27 17:58:40,011 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-27 17:58:40,012 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c7699c4ec9962d19958b3399508787c8, NAME => 'hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/.tmp 2023-08-27 17:58:40,054 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:40,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c7699c4ec9962d19958b3399508787c8, disabling compactions & flushes 2023-08-27 17:58:40,055 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. 2023-08-27 17:58:40,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. 2023-08-27 17:58:40,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. after waiting 0 ms 2023-08-27 17:58:40,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. 2023-08-27 17:58:40,055 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. 2023-08-27 17:58:40,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c7699c4ec9962d19958b3399508787c8: 2023-08-27 17:58:40,059 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-27 17:58:40,061 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1693159120061"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1693159120061"}]},"ts":"1693159120061"} 2023-08-27 17:58:40,066 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-27 17:58:40,068 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-27 17:58:40,068 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1693159120068"}]},"ts":"1693159120068"} 2023-08-27 17:58:40,071 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-27 17:58:40,082 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c7699c4ec9962d19958b3399508787c8, ASSIGN}] 2023-08-27 17:58:40,086 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c7699c4ec9962d19958b3399508787c8, ASSIGN 2023-08-27 17:58:40,088 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c7699c4ec9962d19958b3399508787c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45355,1693159118816; forceNewPlan=false, retain=false 2023-08-27 17:58:40,239 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c7699c4ec9962d19958b3399508787c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:40,239 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1693159120239"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1693159120239"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1693159120239"}]},"ts":"1693159120239"} 2023-08-27 17:58:40,242 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c7699c4ec9962d19958b3399508787c8, server=jenkins-hbase4.apache.org,45355,1693159118816}] 2023-08-27 17:58:40,399 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. 2023-08-27 17:58:40,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c7699c4ec9962d19958b3399508787c8, NAME => 'hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8.', STARTKEY => '', ENDKEY => ''} 2023-08-27 17:58:40,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c7699c4ec9962d19958b3399508787c8 2023-08-27 17:58:40,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:40,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c7699c4ec9962d19958b3399508787c8 2023-08-27 17:58:40,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c7699c4ec9962d19958b3399508787c8 2023-08-27 17:58:40,401 INFO [StoreOpener-c7699c4ec9962d19958b3399508787c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c7699c4ec9962d19958b3399508787c8 2023-08-27 17:58:40,403 DEBUG [StoreOpener-c7699c4ec9962d19958b3399508787c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/namespace/c7699c4ec9962d19958b3399508787c8/info 2023-08-27 17:58:40,403 DEBUG [StoreOpener-c7699c4ec9962d19958b3399508787c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/namespace/c7699c4ec9962d19958b3399508787c8/info 2023-08-27 17:58:40,403 INFO [StoreOpener-c7699c4ec9962d19958b3399508787c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7699c4ec9962d19958b3399508787c8 columnFamilyName info 2023-08-27 17:58:40,404 INFO [StoreOpener-c7699c4ec9962d19958b3399508787c8-1] regionserver.HStore(310): Store=c7699c4ec9962d19958b3399508787c8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:40,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/namespace/c7699c4ec9962d19958b3399508787c8 2023-08-27 17:58:40,406 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/namespace/c7699c4ec9962d19958b3399508787c8 2023-08-27 17:58:40,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c7699c4ec9962d19958b3399508787c8 2023-08-27 17:58:40,411 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/namespace/c7699c4ec9962d19958b3399508787c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-27 17:58:40,411 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c7699c4ec9962d19958b3399508787c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=801567, jitterRate=0.019245758652687073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-27 17:58:40,411 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c7699c4ec9962d19958b3399508787c8: 2023-08-27 17:58:40,412 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8., pid=6, masterSystemTime=1693159120394 2023-08-27 17:58:40,415 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. 2023-08-27 17:58:40,415 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. 2023-08-27 17:58:40,416 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c7699c4ec9962d19958b3399508787c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:40,416 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1693159120416"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1693159120416"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1693159120416"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1693159120416"}]},"ts":"1693159120416"} 2023-08-27 17:58:40,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-27 17:58:40,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c7699c4ec9962d19958b3399508787c8, server=jenkins-hbase4.apache.org,45355,1693159118816 in 176 msec 2023-08-27 17:58:40,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-27 17:58:40,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c7699c4ec9962d19958b3399508787c8, ASSIGN in 338 msec 2023-08-27 17:58:40,424 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-27 17:58:40,425 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1693159120424"}]},"ts":"1693159120424"} 2023-08-27 17:58:40,426 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-27 17:58:40,429 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-27 17:58:40,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 446 msec 2023-08-27 17:58:40,486 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-27 17:58:40,489 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-27 17:58:40,489 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:40,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-27 17:58:40,517 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-27 17:58:40,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 23 msec 2023-08-27 17:58:40,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-27 17:58:40,551 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-27 17:58:40,561 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 23 msec 2023-08-27 17:58:40,576 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-27 17:58:40,578 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-27 17:58:40,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.736sec 2023-08-27 17:58:40,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-27 17:58:40,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-27 17:58:40,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-27 17:58:40,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42741,1693159118774-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-27 17:58:40,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42741,1693159118774-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-27 17:58:40,590 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-27 17:58:40,642 DEBUG [Listener at localhost/46281] zookeeper.ReadOnlyZKClient(139): Connect 0x1fc52126 to 127.0.0.1:54675 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-27 17:58:40,648 DEBUG [Listener at localhost/46281] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@216b234d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-27 17:58:40,650 DEBUG [hconnection-0x1ded117-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-27 17:58:40,652 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-27 17:58:40,654 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42741,1693159118774 2023-08-27 17:58:40,655 INFO [Listener at localhost/46281] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:58:40,661 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-27 17:58:40,661 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:58:40,662 INFO [Listener at localhost/46281] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-27 17:58:40,664 DEBUG [Listener at localhost/46281] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-27 17:58:40,672 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-27 17:58:40,674 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-27 17:58:40,674 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-27 17:58:40,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-27 17:58:40,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:58:40,679 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-08-27 17:58:40,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testCompactionRecordDoesntBlockRolling" procId is: 9 2023-08-27 17:58:40,680 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-27 17:58:40,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-27 17:58:40,687 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67 2023-08-27 17:58:40,688 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67 empty. 2023-08-27 17:58:40,689 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67 2023-08-27 17:58:40,689 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testCompactionRecordDoesntBlockRolling regions 2023-08-27 17:58:40,706 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/.tabledesc/.tableinfo.0000000001 2023-08-27 17:58:40,708 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => d946d5e4b3f9322e8a74784548fa6c67, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/.tmp 2023-08-27 17:58:40,721 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:40,721 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1604): Closing d946d5e4b3f9322e8a74784548fa6c67, disabling compactions & flushes 2023-08-27 17:58:40,721 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:58:40,721 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:58:40,721 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. after waiting 0 ms 2023-08-27 17:58:40,721 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:58:40,721 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:58:40,721 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1558): Region close journal for d946d5e4b3f9322e8a74784548fa6c67: 2023-08-27 17:58:40,724 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ADD_TO_META 2023-08-27 17:58:40,726 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1693159120726"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1693159120726"}]},"ts":"1693159120726"} 2023-08-27 17:58:40,728 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-27 17:58:40,729 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-27 17:58:40,729 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1693159120729"}]},"ts":"1693159120729"} 2023-08-27 17:58:40,731 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLING in hbase:meta 2023-08-27 17:58:40,735 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=d946d5e4b3f9322e8a74784548fa6c67, ASSIGN}] 2023-08-27 17:58:40,737 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=d946d5e4b3f9322e8a74784548fa6c67, ASSIGN 2023-08-27 17:58:40,738 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=d946d5e4b3f9322e8a74784548fa6c67, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45355,1693159118816; forceNewPlan=false, retain=false 2023-08-27 17:58:40,889 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d946d5e4b3f9322e8a74784548fa6c67, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:40,889 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1693159120888"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1693159120888"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1693159120888"}]},"ts":"1693159120888"} 2023-08-27 17:58:40,891 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure d946d5e4b3f9322e8a74784548fa6c67, server=jenkins-hbase4.apache.org,45355,1693159118816}] 2023-08-27 17:58:41,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:58:41,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d946d5e4b3f9322e8a74784548fa6c67, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67.', STARTKEY => '', ENDKEY => ''} 2023-08-27 17:58:41,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testCompactionRecordDoesntBlockRolling d946d5e4b3f9322e8a74784548fa6c67 2023-08-27 17:58:41,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:58:41,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d946d5e4b3f9322e8a74784548fa6c67 2023-08-27 17:58:41,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d946d5e4b3f9322e8a74784548fa6c67 2023-08-27 17:58:41,053 INFO [StoreOpener-d946d5e4b3f9322e8a74784548fa6c67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d946d5e4b3f9322e8a74784548fa6c67 2023-08-27 17:58:41,055 DEBUG [StoreOpener-d946d5e4b3f9322e8a74784548fa6c67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info 2023-08-27 17:58:41,055 DEBUG [StoreOpener-d946d5e4b3f9322e8a74784548fa6c67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info 2023-08-27 17:58:41,056 INFO [StoreOpener-d946d5e4b3f9322e8a74784548fa6c67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d946d5e4b3f9322e8a74784548fa6c67 columnFamilyName info 2023-08-27 17:58:41,057 INFO [StoreOpener-d946d5e4b3f9322e8a74784548fa6c67-1] regionserver.HStore(310): Store=d946d5e4b3f9322e8a74784548fa6c67/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:58:41,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67 2023-08-27 17:58:41,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67 2023-08-27 17:58:41,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d946d5e4b3f9322e8a74784548fa6c67 2023-08-27 17:58:41,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-27 17:58:41,070 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d946d5e4b3f9322e8a74784548fa6c67; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=812085, jitterRate=0.03262054920196533}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-27 17:58:41,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d946d5e4b3f9322e8a74784548fa6c67: 2023-08-27 17:58:41,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67., pid=11, masterSystemTime=1693159121044 2023-08-27 17:58:41,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:58:41,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:58:41,074 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d946d5e4b3f9322e8a74784548fa6c67, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:41,074 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1693159121074"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1693159121074"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1693159121074"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1693159121074"}]},"ts":"1693159121074"} 2023-08-27 17:58:41,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-27 17:58:41,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure d946d5e4b3f9322e8a74784548fa6c67, server=jenkins-hbase4.apache.org,45355,1693159118816 in 185 msec 2023-08-27 17:58:41,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-27 17:58:41,082 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=d946d5e4b3f9322e8a74784548fa6c67, ASSIGN in 344 msec 2023-08-27 17:58:41,083 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-27 17:58:41,083 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1693159121083"}]},"ts":"1693159121083"} 2023-08-27 17:58:41,085 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLED in hbase:meta 2023-08-27 17:58:41,088 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_POST_OPERATION 2023-08-27 17:58:41,090 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling in 413 msec 2023-08-27 17:58:44,150 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-27 17:58:44,150 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-08-27 17:58:45,394 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-27 17:58:45,435 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-27 17:58:45,436 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-27 17:58:45,436 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-27 17:58:50,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-27 17:58:50,685 INFO [Listener at localhost/46281] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testCompactionRecordDoesntBlockRolling, procId: 9 completed 2023-08-27 17:58:50,688 DEBUG [Listener at localhost/46281] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:58:50,688 DEBUG [Listener at localhost/46281] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:58:50,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-27 17:58:50,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] procedure.ProcedureCoordinator(165): Submitting procedure hbase:namespace 2023-08-27 17:58:50,707 INFO [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase:namespace' 2023-08-27 17:58:50,707 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-27 17:58:50,707 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase:namespace' starting 'acquire' 2023-08-27 17:58:50,707 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase:namespace', kicking off acquire phase on members. 2023-08-27 17:58:50,708 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-08-27 17:58:50,708 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-27 17:58:50,709 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-27 17:58:50,709 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-27 17:58:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-27 17:58:50,710 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,710 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-27 17:58:50,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase:namespace 2023-08-27 17:58:50,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-08-27 17:58:50,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-27 17:58:50,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-27 17:58:50,711 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase:namespace 2023-08-27 17:58:50,713 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase:namespace 2023-08-27 17:58:50,713 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase:namespace' with timeout 60000ms 2023-08-27 17:58:50,713 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-27 17:58:50,713 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase:namespace' starting 'acquire' stage 2023-08-27 17:58:50,714 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-27 17:58:50,714 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-27 17:58:50,714 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. 2023-08-27 17:58:50,714 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. started... 2023-08-27 17:58:50,714 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c7699c4ec9962d19958b3399508787c8 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-27 17:58:50,726 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/namespace/c7699c4ec9962d19958b3399508787c8/.tmp/info/fe348e1ca315421db2a3e593feaf959c 2023-08-27 17:58:50,734 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/namespace/c7699c4ec9962d19958b3399508787c8/.tmp/info/fe348e1ca315421db2a3e593feaf959c as hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/namespace/c7699c4ec9962d19958b3399508787c8/info/fe348e1ca315421db2a3e593feaf959c 2023-08-27 17:58:50,740 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/namespace/c7699c4ec9962d19958b3399508787c8/info/fe348e1ca315421db2a3e593feaf959c, entries=2, sequenceid=6, filesize=4.8 K 2023-08-27 17:58:50,742 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c7699c4ec9962d19958b3399508787c8 in 28ms, sequenceid=6, compaction requested=false 2023-08-27 17:58:50,742 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c7699c4ec9962d19958b3399508787c8: 2023-08-27 17:58:50,742 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. 2023-08-27 17:58:50,743 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-27 17:58:50,743 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-27 17:58:50,743 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,743 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase:namespace' locally acquired 2023-08-27 17:58:50,743 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45355,1693159118816' joining acquired barrier for procedure (hbase:namespace) in zk 2023-08-27 17:58:50,745 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,745 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-27 17:58:50,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-27 17:58:50,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-27 17:58:50,745 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace 2023-08-27 17:58:50,745 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase:namespace' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-27 17:58:50,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-27 17:58:50,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-27 17:58:50,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-27 17:58:50,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-27 17:58:50,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45355,1693159118816' joining acquired barrier for procedure 'hbase:namespace' on coordinator 2023-08-27 17:58:50,747 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase:namespace' starting 'in-barrier' execution. 2023-08-27 17:58:50,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e63a506[Count = 0] remaining members to acquire global barrier 2023-08-27 17:58:50,747 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-27 17:58:50,749 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-27 17:58:50,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-27 17:58:50,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-27 17:58:50,749 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase:namespace' received 'reached' from coordinator. 2023-08-27 17:58:50,749 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase:namespace' locally completed 2023-08-27 17:58:50,749 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase:namespace' completed for member 'jenkins-hbase4.apache.org,45355,1693159118816' in zk 2023-08-27 17:58:50,749 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,749 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-27 17:58:50,752 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,752 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase:namespace' has notified controller of completion 2023-08-27 17:58:50,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,752 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-27 17:58:50,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-27 17:58:50,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-27 17:58:50,752 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase:namespace' completed. 2023-08-27 17:58:50,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-27 17:58:50,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-27 17:58:50,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-27 17:58:50,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-27 17:58:50,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-27 17:58:50,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase:namespace' member 'jenkins-hbase4.apache.org,45355,1693159118816': 2023-08-27 17:58:50,756 INFO [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase:namespace' execution completed 2023-08-27 17:58:50,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45355,1693159118816' released barrier for procedure'hbase:namespace', counting down latch. Waiting for 0 more 2023-08-27 17:58:50,756 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-27 17:58:50,756 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-27 17:58:50,757 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase:namespace 2023-08-27 17:58:50,757 INFO [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase:namespaceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-27 17:58:50,758 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-27 17:58:50,759 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-27 17:58:50,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase:namespace 2023-08-27 17:58:50,759 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-27 17:58:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-08-27 17:58:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase:namespace 2023-08-27 17:58:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-27 17:58:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-27 17:58:50,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-27 17:58:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-27 17:58:50,759 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-27 17:58:50,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-08-27 17:58:50,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-27 17:58:50,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-27 17:58:50,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-27 17:58:50,761 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-27 17:58:50,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-27 17:58:50,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,768 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,768 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-27 17:58:50,768 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-27 17:58:50,768 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-27 17:58:50,768 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-27 17:58:50,768 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:58:50,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase:namespace' 2023-08-27 17:58:50,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-27 17:58:50,768 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-27 17:58:50,768 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-27 17:58:50,768 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-27 17:58:50,769 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-27 17:58:50,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-27 17:58:50,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-27 17:58:50,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-27 17:58:50,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-27 17:58:50,770 DEBUG [Listener at localhost/46281] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase:namespace'' to complete. (max 20000 ms per retry) 2023-08-27 17:58:50,770 DEBUG [Listener at localhost/46281] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-27 17:59:00,770 DEBUG [Listener at localhost/46281] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-27 17:59:00,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-27 17:59:00,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-27 17:59:00,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,793 INFO [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-27 17:59:00,794 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-27 17:59:00,794 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-27 17:59:00,794 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-27 17:59:00,795 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,795 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,797 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-27 17:59:00,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-27 17:59:00,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-27 17:59:00,798 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,798 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,798 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-27 17:59:00,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-27 17:59:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,799 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,806 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-27 17:59:00,806 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-27 17:59:00,806 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-27 17:59:00,809 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-27 17:59:00,809 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-27 17:59:00,809 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:59:00,809 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. started... 2023-08-27 17:59:00,809 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d946d5e4b3f9322e8a74784548fa6c67 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-27 17:59:00,837 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/.tmp/info/e3ca1a6a6c664cbcb4d487e2ab86ac84 2023-08-27 17:59:00,857 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/.tmp/info/e3ca1a6a6c664cbcb4d487e2ab86ac84 as hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/e3ca1a6a6c664cbcb4d487e2ab86ac84 2023-08-27 17:59:00,864 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/e3ca1a6a6c664cbcb4d487e2ab86ac84, entries=1, sequenceid=5, filesize=5.8 K 2023-08-27 17:59:00,866 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for d946d5e4b3f9322e8a74784548fa6c67 in 57ms, sequenceid=5, compaction requested=false 2023-08-27 17:59:00,867 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d946d5e4b3f9322e8a74784548fa6c67: 2023-08-27 17:59:00,867 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:59:00,867 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-27 17:59:00,869 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-27 17:59:00,869 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,869 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-27 17:59:00,869 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45355,1693159118816' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-27 17:59:00,871 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,871 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-27 17:59:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-27 17:59:00,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-27 17:59:00,872 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,872 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-27 17:59:00,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-27 17:59:00,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-27 17:59:00,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45355,1693159118816' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-27 17:59:00,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a5c3e12[Count = 0] remaining members to acquire global barrier 2023-08-27 17:59:00,874 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-27 17:59:00,874 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,876 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,876 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-27 17:59:00,876 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-27 17:59:00,876 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,45355,1693159118816' in zk 2023-08-27 17:59:00,876 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,876 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-27 17:59:00,878 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-27 17:59:00,878 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,878 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-27 17:59:00,878 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-27 17:59:00,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-27 17:59:00,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-27 17:59:00,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-27 17:59:00,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-27 17:59:00,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-27 17:59:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,45355,1693159118816': 2023-08-27 17:59:00,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45355,1693159118816' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-27 17:59:00,882 INFO [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-27 17:59:00,882 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-27 17:59:00,882 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-27 17:59:00,883 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,883 INFO [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-27 17:59:00,891 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-27 17:59:00,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-27 17:59:00,891 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,891 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-27 17:59:00,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-27 17:59:00,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-27 17:59:00,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-27 17:59:00,892 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-27 17:59:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,894 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-27 17:59:00,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,897 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-27 17:59:00,897 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-27 17:59:00,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-27 17:59:00,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-27 17:59:00,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-27 17:59:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-27 17:59:00,898 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-27 17:59:00,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-27 17:59:00,898 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-27 17:59:00,898 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,899 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,899 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:00,899 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,899 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,899 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:00,899 DEBUG [Listener at localhost/46281] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-27 17:59:00,899 DEBUG [Listener at localhost/46281] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-27 17:59:00,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-27 17:59:10,900 DEBUG [Listener at localhost/46281] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-27 17:59:10,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-27 17:59:10,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-27 17:59:10,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-27 17:59:10,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,914 INFO [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-27 17:59:10,914 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-27 17:59:10,915 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-27 17:59:10,915 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-27 17:59:10,916 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,916 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,917 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-27 17:59:10,917 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-27 17:59:10,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-27 17:59:10,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,918 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,918 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-27 17:59:10,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-27 17:59:10,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,919 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,919 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-27 17:59:10,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,919 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-27 17:59:10,919 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-27 17:59:10,920 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-27 17:59:10,920 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-27 17:59:10,920 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-27 17:59:10,920 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:59:10,920 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. started... 2023-08-27 17:59:10,920 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d946d5e4b3f9322e8a74784548fa6c67 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-27 17:59:10,936 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/.tmp/info/bcbeee0adcea427eb1b314b526aca655 2023-08-27 17:59:10,943 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/.tmp/info/bcbeee0adcea427eb1b314b526aca655 as hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/bcbeee0adcea427eb1b314b526aca655 2023-08-27 17:59:10,949 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/bcbeee0adcea427eb1b314b526aca655, entries=1, sequenceid=9, filesize=5.8 K 2023-08-27 17:59:10,950 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for d946d5e4b3f9322e8a74784548fa6c67 in 30ms, sequenceid=9, compaction requested=false 2023-08-27 17:59:10,950 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d946d5e4b3f9322e8a74784548fa6c67: 2023-08-27 17:59:10,950 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:59:10,950 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-27 17:59:10,951 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-27 17:59:10,951 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,951 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-27 17:59:10,951 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45355,1693159118816' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-27 17:59:10,954 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,954 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-27 17:59:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-27 17:59:10,954 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,954 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-27 17:59:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-27 17:59:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-27 17:59:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-27 17:59:10,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45355,1693159118816' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-27 17:59:10,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f5eaf3d[Count = 0] remaining members to acquire global barrier 2023-08-27 17:59:10,956 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-27 17:59:10,956 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,957 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,958 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-27 17:59:10,958 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-27 17:59:10,958 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,45355,1693159118816' in zk 2023-08-27 17:59:10,958 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,958 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-27 17:59:10,959 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-27 17:59:10,959 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,959 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-27 17:59:10,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-27 17:59:10,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-27 17:59:10,960 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-27 17:59:10,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-27 17:59:10,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-27 17:59:10,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-27 17:59:10,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,45355,1693159118816': 2023-08-27 17:59:10,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45355,1693159118816' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-27 17:59:10,963 INFO [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-27 17:59:10,963 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-27 17:59:10,963 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-27 17:59:10,963 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,963 INFO [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-27 17:59:10,965 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,965 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-27 17:59:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-27 17:59:10,965 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-27 17:59:10,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-27 17:59:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-27 17:59:10,965 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-27 17:59:10,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-27 17:59:10,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,967 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-27 17:59:10,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,970 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,970 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,970 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-27 17:59:10,970 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-27 17:59:10,970 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:10,970 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-27 17:59:10,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-27 17:59:10,970 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-27 17:59:10,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-27 17:59:10,970 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-27 17:59:10,971 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-27 17:59:10,971 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:10,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-27 17:59:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-27 17:59:10,972 DEBUG [Listener at localhost/46281] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-27 17:59:10,972 DEBUG [Listener at localhost/46281] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-27 17:59:20,972 DEBUG [Listener at localhost/46281] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-27 17:59:20,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-27 17:59:20,996 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43745,DS-6ebfbf9b-9a5f-4052-b527-87148a278b91,DISK] 2023-08-27 17:59:20,996 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43625,DS-ff837d5b-8b8d-4f76-8802-3ed0fddd7ab6,DISK] 2023-08-27 17:59:21,001 INFO [Listener at localhost/46281] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159119318 with entries=13, filesize=6.36 KB; new WAL /user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159160977 2023-08-27 17:59:21,002 DEBUG [Listener at localhost/46281] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43625,DS-ff837d5b-8b8d-4f76-8802-3ed0fddd7ab6,DISK], DatanodeInfoWithStorage[127.0.0.1:43745,DS-6ebfbf9b-9a5f-4052-b527-87148a278b91,DISK]] 2023-08-27 17:59:21,002 DEBUG [Listener at localhost/46281] wal.AbstractFSWAL(716): hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159119318 is not closed yet, will try archiving it next time 2023-08-27 17:59:21,005 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159119318 not finished, retry = 0 2023-08-27 17:59:21,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-27 17:59:21,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-27 17:59:21,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,012 INFO [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-27 17:59:21,012 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-27 17:59:21,012 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-27 17:59:21,012 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-27 17:59:21,012 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,013 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,014 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,014 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-27 17:59:21,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-27 17:59:21,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-27 17:59:21,014 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,014 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-27 17:59:21,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-27 17:59:21,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,015 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,016 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-27 17:59:21,016 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,016 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-27 17:59:21,016 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-27 17:59:21,023 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-27 17:59:21,037 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-27 17:59:21,037 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-27 17:59:21,038 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:59:21,038 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. started... 2023-08-27 17:59:21,038 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d946d5e4b3f9322e8a74784548fa6c67 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-27 17:59:21,056 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=13 (bloomFilter=true), to=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/.tmp/info/66f430bc2dc049488bb2975f797c5828 2023-08-27 17:59:21,065 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/.tmp/info/66f430bc2dc049488bb2975f797c5828 as hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/66f430bc2dc049488bb2975f797c5828 2023-08-27 17:59:21,077 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/66f430bc2dc049488bb2975f797c5828, entries=1, sequenceid=13, filesize=5.8 K 2023-08-27 17:59:21,079 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for d946d5e4b3f9322e8a74784548fa6c67 in 40ms, sequenceid=13, compaction requested=true 2023-08-27 17:59:21,079 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d946d5e4b3f9322e8a74784548fa6c67: 2023-08-27 17:59:21,079 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:59:21,079 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-27 17:59:21,079 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-27 17:59:21,079 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,079 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-27 17:59:21,079 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45355,1693159118816' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-27 17:59:21,081 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,081 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-27 17:59:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-27 17:59:21,081 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,081 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-27 17:59:21,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-27 17:59:21,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-27 17:59:21,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-27 17:59:21,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45355,1693159118816' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-27 17:59:21,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d03f2f1[Count = 0] remaining members to acquire global barrier 2023-08-27 17:59:21,084 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-27 17:59:21,084 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,086 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,086 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-27 17:59:21,086 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-27 17:59:21,086 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,45355,1693159118816' in zk 2023-08-27 17:59:21,086 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,086 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-27 17:59:21,087 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-27 17:59:21,087 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,087 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-27 17:59:21,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-27 17:59:21,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-27 17:59:21,087 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-27 17:59:21,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-27 17:59:21,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-27 17:59:21,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-27 17:59:21,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,45355,1693159118816': 2023-08-27 17:59:21,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45355,1693159118816' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-27 17:59:21,091 INFO [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-27 17:59:21,091 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-27 17:59:21,091 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-27 17:59:21,092 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,092 INFO [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-27 17:59:21,093 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,093 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,093 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-27 17:59:21,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-27 17:59:21,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-27 17:59:21,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-27 17:59:21,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-27 17:59:21,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-27 17:59:21,094 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-27 17:59:21,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,096 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-27 17:59:21,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,099 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,099 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,099 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-27 17:59:21,099 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-27 17:59:21,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-27 17:59:21,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-27 17:59:21,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-27 17:59:21,099 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:21,099 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-27 17:59:21,099 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-27 17:59:21,100 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-27 17:59:21,100 DEBUG [Listener at localhost/46281] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-27 17:59:21,100 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,100 DEBUG [Listener at localhost/46281] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-27 17:59:21,100 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:21,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-27 17:59:21,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-27 17:59:21,106 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159119318 to hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/oldWALs/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159119318 2023-08-27 17:59:31,101 DEBUG [Listener at localhost/46281] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-27 17:59:31,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-27 17:59:31,103 DEBUG [Listener at localhost/46281] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-27 17:59:31,106 DEBUG [Listener at localhost/46281] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 17694 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-27 17:59:31,108 DEBUG [Listener at localhost/46281] regionserver.HStore(1912): d946d5e4b3f9322e8a74784548fa6c67/info is initiating minor compaction (all files) 2023-08-27 17:59:31,108 INFO [Listener at localhost/46281] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-27 17:59:31,108 INFO [Listener at localhost/46281] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:31,108 INFO [Listener at localhost/46281] regionserver.HRegion(2259): Starting compaction of d946d5e4b3f9322e8a74784548fa6c67/info in TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:59:31,109 INFO [Listener at localhost/46281] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/e3ca1a6a6c664cbcb4d487e2ab86ac84, hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/bcbeee0adcea427eb1b314b526aca655, hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/66f430bc2dc049488bb2975f797c5828] into tmpdir=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/.tmp, totalSize=17.3 K 2023-08-27 17:59:31,110 DEBUG [Listener at localhost/46281] compactions.Compactor(207): Compacting e3ca1a6a6c664cbcb4d487e2ab86ac84, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1693159140783 2023-08-27 17:59:31,110 DEBUG [Listener at localhost/46281] compactions.Compactor(207): Compacting bcbeee0adcea427eb1b314b526aca655, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1693159150903 2023-08-27 17:59:31,111 DEBUG [Listener at localhost/46281] compactions.Compactor(207): Compacting 66f430bc2dc049488bb2975f797c5828, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1693159160975 2023-08-27 17:59:31,133 INFO [Listener at localhost/46281] throttle.PressureAwareThroughputController(145): d946d5e4b3f9322e8a74784548fa6c67#info#compaction#9 average throughput is 3.01 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-27 17:59:31,149 DEBUG [Listener at localhost/46281] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/.tmp/info/f568ecb0ed624533b21d863180cbec97 as hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/f568ecb0ed624533b21d863180cbec97 2023-08-27 17:59:31,163 INFO [Listener at localhost/46281] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d946d5e4b3f9322e8a74784548fa6c67/info of d946d5e4b3f9322e8a74784548fa6c67 into f568ecb0ed624533b21d863180cbec97(size=7.9 K), total size for store is 7.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-27 17:59:31,163 DEBUG [Listener at localhost/46281] regionserver.HRegion(2289): Compaction status journal for d946d5e4b3f9322e8a74784548fa6c67: 2023-08-27 17:59:31,179 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43625,DS-ff837d5b-8b8d-4f76-8802-3ed0fddd7ab6,DISK] 2023-08-27 17:59:31,179 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43745,DS-6ebfbf9b-9a5f-4052-b527-87148a278b91,DISK] 2023-08-27 17:59:31,182 INFO [Listener at localhost/46281] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159160977 with entries=4, filesize=2.43 KB; new WAL /user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159171165 2023-08-27 17:59:31,183 DEBUG [Listener at localhost/46281] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43625,DS-ff837d5b-8b8d-4f76-8802-3ed0fddd7ab6,DISK], DatanodeInfoWithStorage[127.0.0.1:43745,DS-6ebfbf9b-9a5f-4052-b527-87148a278b91,DISK]] 2023-08-27 17:59:31,183 DEBUG [Listener at localhost/46281] wal.AbstractFSWAL(716): hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159160977 is not closed yet, will try archiving it next time 2023-08-27 17:59:31,187 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159160977 not finished, retry = 0 2023-08-27 17:59:31,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-27 17:59:31,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-27 17:59:31,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,193 INFO [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-27 17:59:31,193 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-27 17:59:31,193 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-27 17:59:31,193 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-27 17:59:31,193 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,193 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,198 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-27 17:59:31,198 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-27 17:59:31,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-27 17:59:31,198 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,198 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-27 17:59:31,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-27 17:59:31,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,199 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,199 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-27 17:59:31,199 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,199 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-27 17:59:31,200 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-27 17:59:31,200 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-27 17:59:31,200 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-27 17:59:31,200 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-27 17:59:31,200 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:59:31,200 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. started... 2023-08-27 17:59:31,200 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d946d5e4b3f9322e8a74784548fa6c67 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-27 17:59:31,217 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=18 (bloomFilter=true), to=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/.tmp/info/3af8d0c2da99472e9e4a5353c3466316 2023-08-27 17:59:31,224 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/.tmp/info/3af8d0c2da99472e9e4a5353c3466316 as hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/3af8d0c2da99472e9e4a5353c3466316 2023-08-27 17:59:31,230 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/3af8d0c2da99472e9e4a5353c3466316, entries=1, sequenceid=18, filesize=5.8 K 2023-08-27 17:59:31,232 INFO [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for d946d5e4b3f9322e8a74784548fa6c67 in 31ms, sequenceid=18, compaction requested=false 2023-08-27 17:59:31,232 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d946d5e4b3f9322e8a74784548fa6c67: 2023-08-27 17:59:31,232 DEBUG [rs(jenkins-hbase4.apache.org,45355,1693159118816)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:59:31,232 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-27 17:59:31,232 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-27 17:59:31,232 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,232 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-27 17:59:31,232 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45355,1693159118816' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-27 17:59:31,235 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,235 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-27 17:59:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-27 17:59:31,235 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,235 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-27 17:59:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-27 17:59:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-27 17:59:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-27 17:59:31,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45355,1693159118816' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-27 17:59:31,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eab31c2[Count = 0] remaining members to acquire global barrier 2023-08-27 17:59:31,237 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-27 17:59:31,237 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,240 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,240 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-27 17:59:31,240 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-27 17:59:31,240 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,45355,1693159118816' in zk 2023-08-27 17:59:31,240 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,240 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-27 17:59:31,242 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,242 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-27 17:59:31,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-27 17:59:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-27 17:59:31,242 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-27 17:59:31,243 DEBUG [member: 'jenkins-hbase4.apache.org,45355,1693159118816' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-27 17:59:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-27 17:59:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-27 17:59:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-27 17:59:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,45355,1693159118816': 2023-08-27 17:59:31,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45355,1693159118816' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-27 17:59:31,246 INFO [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-27 17:59:31,246 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-27 17:59:31,246 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-27 17:59:31,246 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,246 INFO [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-27 17:59:31,248 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,248 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-27 17:59:31,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-27 17:59:31,248 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-27 17:59:31,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-27 17:59:31,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-27 17:59:31,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-27 17:59:31,249 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-27 17:59:31,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,250 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-27 17:59:31,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,253 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,253 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-27 17:59:31,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-27 17:59:31,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-27 17:59:31,253 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,253 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,253 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:31,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-27 17:59:31,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-27 17:59:31,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-27 17:59:31,253 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-27 17:59:31,253 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,253 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,254 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-27 17:59:31,253 DEBUG [(jenkins-hbase4.apache.org,42741,1693159118774)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-27 17:59:31,254 DEBUG [Listener at localhost/46281] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-27 17:59:31,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-27 17:59:31,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-27 17:59:31,254 DEBUG [Listener at localhost/46281] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-27 17:59:31,289 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159160977 to hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/oldWALs/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159160977 2023-08-27 17:59:41,255 DEBUG [Listener at localhost/46281] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-27 17:59:41,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42741] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-27 17:59:41,274 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43625,DS-ff837d5b-8b8d-4f76-8802-3ed0fddd7ab6,DISK] 2023-08-27 17:59:41,274 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43745,DS-6ebfbf9b-9a5f-4052-b527-87148a278b91,DISK] 2023-08-27 17:59:41,276 INFO [Listener at localhost/46281] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159171165 with entries=3, filesize=1.94 KB; new WAL /user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159181259 2023-08-27 17:59:41,276 DEBUG [Listener at localhost/46281] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43625,DS-ff837d5b-8b8d-4f76-8802-3ed0fddd7ab6,DISK], DatanodeInfoWithStorage[127.0.0.1:43745,DS-6ebfbf9b-9a5f-4052-b527-87148a278b91,DISK]] 2023-08-27 17:59:41,277 DEBUG [Listener at localhost/46281] wal.AbstractFSWAL(716): hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/WALs/jenkins-hbase4.apache.org,45355,1693159118816/jenkins-hbase4.apache.org%2C45355%2C1693159118816.1693159171165 is not closed yet, will try archiving it next time 2023-08-27 17:59:41,277 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-27 17:59:41,277 INFO [Listener at localhost/46281] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-27 17:59:41,277 DEBUG [Listener at localhost/46281] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fc52126 to 127.0.0.1:54675 2023-08-27 17:59:41,277 DEBUG [Listener at localhost/46281] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 17:59:41,279 DEBUG [Listener at localhost/46281] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-27 17:59:41,279 DEBUG [Listener at localhost/46281] util.JVMClusterUtil(257): Found active master hash=311850799, stopped=false 2023-08-27 17:59:41,279 INFO [Listener at localhost/46281] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42741,1693159118774 2023-08-27 17:59:41,281 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-27 17:59:41,281 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-27 17:59:41,282 INFO [Listener at localhost/46281] procedure2.ProcedureExecutor(629): Stopping 2023-08-27 17:59:41,282 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:59:41,282 DEBUG [Listener at localhost/46281] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72f4d8de to 127.0.0.1:54675 2023-08-27 17:59:41,282 DEBUG [Listener at localhost/46281] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 17:59:41,282 INFO [Listener at localhost/46281] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45355,1693159118816' ***** 2023-08-27 17:59:41,282 INFO [Listener at localhost/46281] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-27 17:59:41,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 17:59:41,283 INFO [RS:0;jenkins-hbase4:45355] regionserver.HeapMemoryManager(220): Stopping 2023-08-27 17:59:41,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 17:59:41,283 INFO [RS:0;jenkins-hbase4:45355] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-27 17:59:41,283 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-27 17:59:41,283 INFO [RS:0;jenkins-hbase4:45355] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-27 17:59:41,284 INFO [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(3305): Received CLOSE for d946d5e4b3f9322e8a74784548fa6c67 2023-08-27 17:59:41,284 INFO [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(3305): Received CLOSE for c7699c4ec9962d19958b3399508787c8 2023-08-27 17:59:41,284 INFO [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:41,284 DEBUG [RS:0;jenkins-hbase4:45355] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a404b3d to 127.0.0.1:54675 2023-08-27 17:59:41,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d946d5e4b3f9322e8a74784548fa6c67, disabling compactions & flushes 2023-08-27 17:59:41,284 DEBUG [RS:0;jenkins-hbase4:45355] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 17:59:41,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:59:41,284 INFO [RS:0;jenkins-hbase4:45355] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-27 17:59:41,284 INFO [RS:0;jenkins-hbase4:45355] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-27 17:59:41,284 INFO [RS:0;jenkins-hbase4:45355] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-27 17:59:41,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:59:41,284 INFO [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-27 17:59:41,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. after waiting 0 ms 2023-08-27 17:59:41,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:59:41,285 INFO [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-08-27 17:59:41,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d946d5e4b3f9322e8a74784548fa6c67 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-27 17:59:41,285 DEBUG [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(1478): Online Regions={d946d5e4b3f9322e8a74784548fa6c67=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67., 1588230740=hbase:meta,,1.1588230740, c7699c4ec9962d19958b3399508787c8=hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8.} 2023-08-27 17:59:41,285 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-27 17:59:41,285 DEBUG [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(1504): Waiting on 1588230740, c7699c4ec9962d19958b3399508787c8, d946d5e4b3f9322e8a74784548fa6c67 2023-08-27 17:59:41,285 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-27 17:59:41,285 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-27 17:59:41,285 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-27 17:59:41,285 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-27 17:59:41,285 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=3.10 KB heapSize=5.61 KB 2023-08-27 17:59:41,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=22 (bloomFilter=true), to=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/.tmp/info/ead0ba27d31144ab8290909d83ab8975 2023-08-27 17:59:41,305 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.84 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/.tmp/info/75d60c632a7d4b61bf051b3a0dd8bc75 2023-08-27 17:59:41,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/.tmp/info/ead0ba27d31144ab8290909d83ab8975 as hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/ead0ba27d31144ab8290909d83ab8975 2023-08-27 17:59:41,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/ead0ba27d31144ab8290909d83ab8975, entries=1, sequenceid=22, filesize=5.8 K 2023-08-27 17:59:41,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for d946d5e4b3f9322e8a74784548fa6c67 in 38ms, sequenceid=22, compaction requested=true 2023-08-27 17:59:41,327 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/e3ca1a6a6c664cbcb4d487e2ab86ac84, hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/bcbeee0adcea427eb1b314b526aca655, hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/66f430bc2dc049488bb2975f797c5828] to archive 2023-08-27 17:59:41,329 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-27 17:59:41,332 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/e3ca1a6a6c664cbcb4d487e2ab86ac84 to hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/e3ca1a6a6c664cbcb4d487e2ab86ac84 2023-08-27 17:59:41,334 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/bcbeee0adcea427eb1b314b526aca655 to hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/bcbeee0adcea427eb1b314b526aca655 2023-08-27 17:59:41,337 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=264 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/.tmp/table/8e2c6b0a61474f19b6c4481b083596dc 2023-08-27 17:59:41,338 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/66f430bc2dc049488bb2975f797c5828 to hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/info/66f430bc2dc049488bb2975f797c5828 2023-08-27 17:59:41,344 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/.tmp/info/75d60c632a7d4b61bf051b3a0dd8bc75 as hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/info/75d60c632a7d4b61bf051b3a0dd8bc75 2023-08-27 17:59:41,350 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/info/75d60c632a7d4b61bf051b3a0dd8bc75, entries=20, sequenceid=14, filesize=7.6 K 2023-08-27 17:59:41,351 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/.tmp/table/8e2c6b0a61474f19b6c4481b083596dc as hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/table/8e2c6b0a61474f19b6c4481b083596dc 2023-08-27 17:59:41,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/table/8e2c6b0a61474f19b6c4481b083596dc, entries=4, sequenceid=14, filesize=4.9 K 2023-08-27 17:59:41,357 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.10 KB/3174, heapSize ~5.33 KB/5456, currentSize=0 B/0 for 1588230740 in 72ms, sequenceid=14, compaction requested=false 2023-08-27 17:59:41,364 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-08-27 17:59:41,365 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-27 17:59:41,365 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-27 17:59:41,365 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-27 17:59:41,365 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-27 17:59:41,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d946d5e4b3f9322e8a74784548fa6c67/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=1 2023-08-27 17:59:41,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:59:41,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d946d5e4b3f9322e8a74784548fa6c67: 2023-08-27 17:59:41,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1693159120674.d946d5e4b3f9322e8a74784548fa6c67. 2023-08-27 17:59:41,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c7699c4ec9962d19958b3399508787c8, disabling compactions & flushes 2023-08-27 17:59:41,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. 2023-08-27 17:59:41,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. 2023-08-27 17:59:41,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. after waiting 0 ms 2023-08-27 17:59:41,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. 2023-08-27 17:59:41,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/data/hbase/namespace/c7699c4ec9962d19958b3399508787c8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-27 17:59:41,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. 2023-08-27 17:59:41,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c7699c4ec9962d19958b3399508787c8: 2023-08-27 17:59:41,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1693159119983.c7699c4ec9962d19958b3399508787c8. 2023-08-27 17:59:41,485 INFO [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45355,1693159118816; all regions closed. 2023-08-27 17:59:41,491 DEBUG [RS:0;jenkins-hbase4:45355] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/oldWALs 2023-08-27 17:59:41,491 INFO [RS:0;jenkins-hbase4:45355] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45355%2C1693159118816.meta:.meta(num 1693159119871) 2023-08-27 17:59:41,496 DEBUG [RS:0;jenkins-hbase4:45355] wal.AbstractFSWAL(1028): Moved 2 WAL file(s) to /user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/oldWALs 2023-08-27 17:59:41,496 INFO [RS:0;jenkins-hbase4:45355] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45355%2C1693159118816:(num 1693159181259) 2023-08-27 17:59:41,496 DEBUG [RS:0;jenkins-hbase4:45355] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 17:59:41,497 INFO [RS:0;jenkins-hbase4:45355] regionserver.LeaseManager(133): Closed leases 2023-08-27 17:59:41,497 INFO [RS:0;jenkins-hbase4:45355] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-08-27 17:59:41,497 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-27 17:59:41,498 INFO [RS:0;jenkins-hbase4:45355] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45355 2023-08-27 17:59:41,500 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45355,1693159118816 2023-08-27 17:59:41,500 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-27 17:59:41,500 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-27 17:59:41,502 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45355,1693159118816] 2023-08-27 17:59:41,502 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45355,1693159118816; numProcessing=1 2023-08-27 17:59:41,503 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45355,1693159118816 already deleted, retry=false 2023-08-27 17:59:41,503 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45355,1693159118816 expired; onlineServers=0 2023-08-27 17:59:41,503 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42741,1693159118774' ***** 2023-08-27 17:59:41,503 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-27 17:59:41,503 DEBUG [M:0;jenkins-hbase4:42741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16a9e1a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-27 17:59:41,503 INFO [M:0;jenkins-hbase4:42741] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42741,1693159118774 2023-08-27 17:59:41,503 INFO [M:0;jenkins-hbase4:42741] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42741,1693159118774; all regions closed. 2023-08-27 17:59:41,503 DEBUG [M:0;jenkins-hbase4:42741] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 17:59:41,503 DEBUG [M:0;jenkins-hbase4:42741] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-27 17:59:41,504 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-27 17:59:41,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1693159119094] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1693159119094,5,FailOnTimeoutGroup] 2023-08-27 17:59:41,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1693159119094] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1693159119094,5,FailOnTimeoutGroup] 2023-08-27 17:59:41,504 DEBUG [M:0;jenkins-hbase4:42741] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-27 17:59:41,504 INFO [M:0;jenkins-hbase4:42741] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-27 17:59:41,504 INFO [M:0;jenkins-hbase4:42741] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-27 17:59:41,504 INFO [M:0;jenkins-hbase4:42741] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-27 17:59:41,505 DEBUG [M:0;jenkins-hbase4:42741] master.HMaster(1512): Stopping service threads 2023-08-27 17:59:41,505 INFO [M:0;jenkins-hbase4:42741] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-27 17:59:41,505 ERROR [M:0;jenkins-hbase4:42741] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-08-27 17:59:41,505 INFO [M:0;jenkins-hbase4:42741] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-27 17:59:41,505 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-27 17:59:41,506 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-27 17:59:41,506 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:59:41,506 DEBUG [M:0;jenkins-hbase4:42741] zookeeper.ZKUtil(398): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-27 17:59:41,506 WARN [M:0;jenkins-hbase4:42741] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-27 17:59:41,506 INFO [M:0;jenkins-hbase4:42741] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-27 17:59:41,506 INFO [M:0;jenkins-hbase4:42741] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-27 17:59:41,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-27 17:59:41,507 DEBUG [M:0;jenkins-hbase4:42741] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-27 17:59:41,507 INFO [M:0;jenkins-hbase4:42741] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:59:41,507 DEBUG [M:0;jenkins-hbase4:42741] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:59:41,507 DEBUG [M:0;jenkins-hbase4:42741] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-27 17:59:41,507 DEBUG [M:0;jenkins-hbase4:42741] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:59:41,507 INFO [M:0;jenkins-hbase4:42741] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.88 KB heapSize=47.33 KB 2023-08-27 17:59:41,520 INFO [M:0;jenkins-hbase4:42741] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.88 KB at sequenceid=100 (bloomFilter=true), to=hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b40ec9835cba41448213f98477256077 2023-08-27 17:59:41,525 INFO [M:0;jenkins-hbase4:42741] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b40ec9835cba41448213f98477256077 2023-08-27 17:59:41,526 DEBUG [M:0;jenkins-hbase4:42741] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b40ec9835cba41448213f98477256077 as hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b40ec9835cba41448213f98477256077 2023-08-27 17:59:41,532 INFO [M:0;jenkins-hbase4:42741] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b40ec9835cba41448213f98477256077 2023-08-27 17:59:41,532 INFO [M:0;jenkins-hbase4:42741] regionserver.HStore(1080): Added hdfs://localhost:40029/user/jenkins/test-data/caced0c2-0b65-3ac4-b725-f1cf03b5842e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b40ec9835cba41448213f98477256077, entries=11, sequenceid=100, filesize=6.1 K 2023-08-27 17:59:41,533 INFO [M:0;jenkins-hbase4:42741] regionserver.HRegion(2948): Finished flush of dataSize ~38.88 KB/39812, heapSize ~47.31 KB/48448, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=100, compaction requested=false 2023-08-27 17:59:41,534 INFO [M:0;jenkins-hbase4:42741] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:59:41,534 DEBUG [M:0;jenkins-hbase4:42741] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-27 17:59:41,537 INFO [M:0;jenkins-hbase4:42741] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-27 17:59:41,537 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-27 17:59:41,537 INFO [M:0;jenkins-hbase4:42741] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42741 2023-08-27 17:59:41,539 DEBUG [M:0;jenkins-hbase4:42741] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42741,1693159118774 already deleted, retry=false 2023-08-27 17:59:41,602 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 17:59:41,602 INFO [RS:0;jenkins-hbase4:45355] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45355,1693159118816; zookeeper connection closed. 2023-08-27 17:59:41,602 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): regionserver:45355-0x1004ee50f480001, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 17:59:41,602 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2d9365dc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2d9365dc 2023-08-27 17:59:41,603 INFO [Listener at localhost/46281] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-27 17:59:41,702 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 17:59:41,702 INFO [M:0;jenkins-hbase4:42741] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42741,1693159118774; zookeeper connection closed. 2023-08-27 17:59:41,702 DEBUG [Listener at localhost/46281-EventThread] zookeeper.ZKWatcher(600): master:42741-0x1004ee50f480000, quorum=127.0.0.1:54675, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 17:59:41,703 WARN [Listener at localhost/46281] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-27 17:59:41,706 INFO [Listener at localhost/46281] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 17:59:41,743 WARN [BP-2102060220-172.31.14.131-1693159118151 heartbeating to localhost/127.0.0.1:40029] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2102060220-172.31.14.131-1693159118151 (Datanode Uuid 6485c032-9b3b-4dae-8b8e-4b972bdb8a0f) service to localhost/127.0.0.1:40029 2023-08-27 17:59:41,744 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/cluster_b6a8c29c-23a7-3d41-186e-41924b702daf/dfs/data/data3/current/BP-2102060220-172.31.14.131-1693159118151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:59:41,744 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/cluster_b6a8c29c-23a7-3d41-186e-41924b702daf/dfs/data/data4/current/BP-2102060220-172.31.14.131-1693159118151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:59:41,811 WARN [Listener at localhost/46281] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-27 17:59:41,814 INFO [Listener at localhost/46281] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 17:59:41,918 WARN [BP-2102060220-172.31.14.131-1693159118151 heartbeating to localhost/127.0.0.1:40029] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-27 17:59:41,918 WARN [BP-2102060220-172.31.14.131-1693159118151 heartbeating to localhost/127.0.0.1:40029] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2102060220-172.31.14.131-1693159118151 (Datanode Uuid 6b7f5c64-eb7e-4469-b152-4ac6c6d81b0d) service to localhost/127.0.0.1:40029 2023-08-27 17:59:41,919 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/cluster_b6a8c29c-23a7-3d41-186e-41924b702daf/dfs/data/data1/current/BP-2102060220-172.31.14.131-1693159118151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:59:41,919 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/cluster_b6a8c29c-23a7-3d41-186e-41924b702daf/dfs/data/data2/current/BP-2102060220-172.31.14.131-1693159118151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 17:59:41,930 INFO [Listener at localhost/46281] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 17:59:42,043 INFO [Listener at localhost/46281] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-27 17:59:42,062 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-27 17:59:42,071 INFO [Listener at localhost/46281] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=64 (was 77), OpenFileDescriptor=438 (was 474), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=157 (was 236), ProcessCount=166 (was 168), AvailableMemoryMB=12300 (was 11808) - AvailableMemoryMB LEAK? - 2023-08-27 17:59:42,079 INFO [Listener at localhost/46281] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=65, OpenFileDescriptor=438, MaxFileDescriptor=60000, SystemLoadAverage=157, ProcessCount=166, AvailableMemoryMB=12300 2023-08-27 17:59:42,079 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-27 17:59:42,080 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/hadoop.log.dir so I do NOT create it in target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2 2023-08-27 17:59:42,080 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/26db1d25-6bc2-82c9-8891-a1308d9a670b/hadoop.tmp.dir so I do NOT create it in target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2 2023-08-27 17:59:42,080 INFO [Listener at localhost/46281] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/cluster_71edce76-d079-d53e-64fa-f0e653260f2f, deleteOnExit=true 2023-08-27 17:59:42,080 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-27 17:59:42,080 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/test.cache.data in system properties and HBase conf 2023-08-27 17:59:42,081 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/hadoop.tmp.dir in system properties and HBase conf 2023-08-27 17:59:42,081 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/hadoop.log.dir in system properties and HBase conf 2023-08-27 17:59:42,081 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-27 17:59:42,081 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-27 17:59:42,081 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-27 17:59:42,082 DEBUG [Listener at localhost/46281] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-27 17:59:42,082 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-27 17:59:42,082 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-27 17:59:42,082 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-27 17:59:42,083 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-27 17:59:42,083 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-27 17:59:42,083 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-27 17:59:42,083 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-27 17:59:42,083 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-27 17:59:42,083 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-27 17:59:42,084 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/nfs.dump.dir in system properties and HBase conf 2023-08-27 17:59:42,084 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/java.io.tmpdir in system properties and HBase conf 2023-08-27 17:59:42,084 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-27 17:59:42,084 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-27 17:59:42,084 INFO [Listener at localhost/46281] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-27 17:59:42,089 WARN [Listener at localhost/46281] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-27 17:59:42,089 WARN [Listener at localhost/46281] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-27 17:59:42,128 WARN [Listener at localhost/46281] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 17:59:42,131 INFO [Listener at localhost/46281] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 17:59:42,137 INFO [Listener at localhost/46281] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/java.io.tmpdir/Jetty_localhost_46439_hdfs____ev75aa/webapp 2023-08-27 17:59:42,231 INFO [Listener at localhost/46281] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46439 2023-08-27 17:59:42,235 WARN [Listener at localhost/46281] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-27 17:59:42,235 WARN [Listener at localhost/46281] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-27 17:59:42,272 WARN [Listener at localhost/37383] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 17:59:42,285 WARN [Listener at localhost/37383] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-27 17:59:42,287 WARN [Listener at localhost/37383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 17:59:42,288 INFO [Listener at localhost/37383] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 17:59:42,292 INFO [Listener at localhost/37383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/java.io.tmpdir/Jetty_localhost_44409_datanode____zf9cf8/webapp 2023-08-27 17:59:42,384 INFO [Listener at localhost/37383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44409 2023-08-27 17:59:42,389 WARN [Listener at localhost/33039] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 17:59:42,400 WARN [Listener at localhost/33039] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-27 17:59:42,402 WARN [Listener at localhost/33039] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 17:59:42,403 INFO [Listener at localhost/33039] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 17:59:42,406 INFO [Listener at localhost/33039] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/java.io.tmpdir/Jetty_localhost_46265_datanode____8y3jti/webapp 2023-08-27 17:59:42,482 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6190d711488785e1: Processing first storage report for DS-f874d94b-e39a-48bb-affd-31f5b5389f70 from datanode 04fb033d-22df-4c97-8512-3cfe873b0e22 2023-08-27 17:59:42,482 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6190d711488785e1: from storage DS-f874d94b-e39a-48bb-affd-31f5b5389f70 node DatanodeRegistration(127.0.0.1:44295, datanodeUuid=04fb033d-22df-4c97-8512-3cfe873b0e22, infoPort=44799, infoSecurePort=0, ipcPort=33039, storageInfo=lv=-57;cid=testClusterID;nsid=843915558;c=1693159182092), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:59:42,482 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6190d711488785e1: Processing first storage report for DS-4c97bea2-b86e-438e-af11-590fdcda24a6 from datanode 04fb033d-22df-4c97-8512-3cfe873b0e22 2023-08-27 17:59:42,482 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6190d711488785e1: from storage DS-4c97bea2-b86e-438e-af11-590fdcda24a6 node DatanodeRegistration(127.0.0.1:44295, datanodeUuid=04fb033d-22df-4c97-8512-3cfe873b0e22, infoPort=44799, infoSecurePort=0, ipcPort=33039, storageInfo=lv=-57;cid=testClusterID;nsid=843915558;c=1693159182092), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:59:42,502 INFO [Listener at localhost/33039] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46265 2023-08-27 17:59:42,509 WARN [Listener at localhost/33159] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 17:59:42,597 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb19f55f27aa44d35: Processing first storage report for DS-b4e834c6-911c-4073-b606-b1bf97c30227 from datanode 0058aa27-60ac-4e72-90b3-cdffdf0cd975 2023-08-27 17:59:42,597 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb19f55f27aa44d35: from storage DS-b4e834c6-911c-4073-b606-b1bf97c30227 node DatanodeRegistration(127.0.0.1:42739, datanodeUuid=0058aa27-60ac-4e72-90b3-cdffdf0cd975, infoPort=45599, infoSecurePort=0, ipcPort=33159, storageInfo=lv=-57;cid=testClusterID;nsid=843915558;c=1693159182092), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:59:42,597 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb19f55f27aa44d35: Processing first storage report for DS-ef149fb9-4986-49b4-abaa-837a55ce7e43 from datanode 0058aa27-60ac-4e72-90b3-cdffdf0cd975 2023-08-27 17:59:42,597 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb19f55f27aa44d35: from storage DS-ef149fb9-4986-49b4-abaa-837a55ce7e43 node DatanodeRegistration(127.0.0.1:42739, datanodeUuid=0058aa27-60ac-4e72-90b3-cdffdf0cd975, infoPort=45599, infoSecurePort=0, ipcPort=33159, storageInfo=lv=-57;cid=testClusterID;nsid=843915558;c=1693159182092), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 17:59:42,615 DEBUG [Listener at localhost/33159] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2 2023-08-27 17:59:42,617 INFO [Listener at localhost/33159] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/cluster_71edce76-d079-d53e-64fa-f0e653260f2f/zookeeper_0, clientPort=50926, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/cluster_71edce76-d079-d53e-64fa-f0e653260f2f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/cluster_71edce76-d079-d53e-64fa-f0e653260f2f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-27 17:59:42,619 INFO [Listener at localhost/33159] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50926 2023-08-27 17:59:42,619 INFO [Listener at localhost/33159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:59:42,620 INFO [Listener at localhost/33159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:59:42,633 INFO [Listener at localhost/33159] util.FSUtils(471): Created version file at hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd with version=8 2023-08-27 17:59:42,633 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/hbase-staging 2023-08-27 17:59:42,635 INFO [Listener at localhost/33159] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-27 17:59:42,635 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 17:59:42,635 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-27 17:59:42,635 INFO [Listener at localhost/33159] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-27 17:59:42,635 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 17:59:42,635 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-27 17:59:42,635 INFO [Listener at localhost/33159] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-27 17:59:42,636 INFO [Listener at localhost/33159] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44803 2023-08-27 17:59:42,637 INFO [Listener at localhost/33159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:59:42,637 INFO [Listener at localhost/33159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:59:42,638 INFO [Listener at localhost/33159] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44803 connecting to ZooKeeper ensemble=127.0.0.1:50926 2023-08-27 17:59:42,645 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:448030x0, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-27 17:59:42,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44803-0x1004ee608bf0000 connected 2023-08-27 17:59:42,659 DEBUG [Listener at localhost/33159] zookeeper.ZKUtil(164): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-27 17:59:42,659 DEBUG [Listener at localhost/33159] zookeeper.ZKUtil(164): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 17:59:42,659 DEBUG [Listener at localhost/33159] zookeeper.ZKUtil(164): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-27 17:59:42,665 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44803 2023-08-27 17:59:42,665 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44803 2023-08-27 17:59:42,666 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44803 2023-08-27 17:59:42,666 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44803 2023-08-27 17:59:42,666 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44803 2023-08-27 17:59:42,666 INFO [Listener at localhost/33159] master.HMaster(444): hbase.rootdir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd, hbase.cluster.distributed=false 2023-08-27 17:59:42,679 INFO [Listener at localhost/33159] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-27 17:59:42,680 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 17:59:42,680 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-27 17:59:42,680 INFO [Listener at localhost/33159] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-27 17:59:42,680 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 17:59:42,680 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-27 17:59:42,680 INFO [Listener at localhost/33159] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-27 17:59:42,681 INFO [Listener at localhost/33159] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39339 2023-08-27 17:59:42,681 INFO [Listener at localhost/33159] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-27 17:59:42,682 DEBUG [Listener at localhost/33159] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-27 17:59:42,683 INFO [Listener at localhost/33159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:59:42,684 INFO [Listener at localhost/33159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:59:42,684 INFO [Listener at localhost/33159] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39339 connecting to ZooKeeper ensemble=127.0.0.1:50926 2023-08-27 17:59:42,688 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:393390x0, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-27 17:59:42,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39339-0x1004ee608bf0001 connected 2023-08-27 17:59:42,689 DEBUG [Listener at localhost/33159] zookeeper.ZKUtil(164): regionserver:39339-0x1004ee608bf0001, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-27 17:59:42,689 DEBUG [Listener at localhost/33159] zookeeper.ZKUtil(164): regionserver:39339-0x1004ee608bf0001, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 17:59:42,690 DEBUG [Listener at localhost/33159] zookeeper.ZKUtil(164): regionserver:39339-0x1004ee608bf0001, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-27 17:59:42,690 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39339 2023-08-27 17:59:42,690 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39339 2023-08-27 17:59:42,691 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39339 2023-08-27 17:59:42,691 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39339 2023-08-27 17:59:42,691 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39339 2023-08-27 17:59:42,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44803,1693159182634 2023-08-27 17:59:42,693 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-27 17:59:42,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44803,1693159182634 2023-08-27 17:59:42,695 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:39339-0x1004ee608bf0001, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-27 17:59:42,695 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-27 17:59:42,695 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:59:42,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-27 17:59:42,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-27 17:59:42,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44803,1693159182634 from backup master directory 2023-08-27 17:59:42,698 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44803,1693159182634 2023-08-27 17:59:42,698 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-27 17:59:42,698 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-27 17:59:42,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44803,1693159182634 2023-08-27 17:59:42,713 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/hbase.id with ID: ba0723fe-c8ab-406d-8c19-99d0742abeb0 2023-08-27 17:59:42,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:59:42,728 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:59:42,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5a4bf7eb to 127.0.0.1:50926 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-27 17:59:42,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e65fea5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-27 17:59:42,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-27 17:59:42,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-27 17:59:42,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-27 17:59:42,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/MasterData/data/master/store-tmp 2023-08-27 17:59:42,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:59:42,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-27 17:59:42,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:59:42,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:59:42,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-27 17:59:42,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:59:42,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 17:59:42,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-27 17:59:42,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/MasterData/WALs/jenkins-hbase4.apache.org,44803,1693159182634 2023-08-27 17:59:42,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44803%2C1693159182634, suffix=, logDir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/MasterData/WALs/jenkins-hbase4.apache.org,44803,1693159182634, archiveDir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/MasterData/oldWALs, maxLogs=10 2023-08-27 17:59:42,773 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42739,DS-b4e834c6-911c-4073-b606-b1bf97c30227,DISK] 2023-08-27 17:59:42,774 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44295,DS-f874d94b-e39a-48bb-affd-31f5b5389f70,DISK] 2023-08-27 17:59:42,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/MasterData/WALs/jenkins-hbase4.apache.org,44803,1693159182634/jenkins-hbase4.apache.org%2C44803%2C1693159182634.1693159182759 2023-08-27 17:59:42,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42739,DS-b4e834c6-911c-4073-b606-b1bf97c30227,DISK], DatanodeInfoWithStorage[127.0.0.1:44295,DS-f874d94b-e39a-48bb-affd-31f5b5389f70,DISK]] 2023-08-27 17:59:42,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-27 17:59:42,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:59:42,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:59:42,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:59:42,780 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:59:42,781 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-27 17:59:42,782 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-27 17:59:42,782 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:59:42,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:59:42,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:59:42,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-27 17:59:42,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-27 17:59:42,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=744467, jitterRate=-0.05336211621761322}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-27 17:59:42,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-27 17:59:42,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-27 17:59:42,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-27 17:59:42,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-27 17:59:42,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-27 17:59:42,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-27 17:59:42,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-27 17:59:42,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-27 17:59:42,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-27 17:59:42,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-27 17:59:42,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-27 17:59:42,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-27 17:59:42,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-27 17:59:42,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-27 17:59:42,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-27 17:59:42,807 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:59:42,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-27 17:59:42,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-27 17:59:42,809 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-27 17:59:42,810 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-27 17:59:42,810 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:39339-0x1004ee608bf0001, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-27 17:59:42,810 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:59:42,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44803,1693159182634, sessionid=0x1004ee608bf0000, setting cluster-up flag (Was=false) 2023-08-27 17:59:42,814 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:59:42,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-27 17:59:42,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44803,1693159182634 2023-08-27 17:59:42,822 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:59:42,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-27 17:59:42,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44803,1693159182634 2023-08-27 17:59:42,828 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/.hbase-snapshot/.tmp 2023-08-27 17:59:42,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-27 17:59:42,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 17:59:42,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 17:59:42,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 17:59:42,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 17:59:42,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-27 17:59:42,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:59:42,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-27 17:59:42,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:59:42,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1693159212832 2023-08-27 17:59:42,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-27 17:59:42,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-27 17:59:42,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-27 17:59:42,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-27 17:59:42,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-27 17:59:42,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-27 17:59:42,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:42,835 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-27 17:59:42,835 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-27 17:59:42,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-27 17:59:42,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-27 17:59:42,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-27 17:59:42,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-27 17:59:42,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-27 17:59:42,836 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-27 17:59:42,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1693159182836,5,FailOnTimeoutGroup] 2023-08-27 17:59:42,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1693159182836,5,FailOnTimeoutGroup] 2023-08-27 17:59:42,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:42,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-27 17:59:42,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:42,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:42,846 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-27 17:59:42,847 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-27 17:59:42,847 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd 2023-08-27 17:59:42,855 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:59:42,856 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-27 17:59:42,857 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/info 2023-08-27 17:59:42,858 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-27 17:59:42,858 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:59:42,858 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-27 17:59:42,859 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/rep_barrier 2023-08-27 17:59:42,860 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-27 17:59:42,860 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:59:42,860 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-27 17:59:42,861 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/table 2023-08-27 17:59:42,862 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-27 17:59:42,862 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:59:42,863 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740 2023-08-27 17:59:42,864 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740 2023-08-27 17:59:42,866 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-27 17:59:42,867 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-27 17:59:42,869 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-27 17:59:42,870 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=737482, jitterRate=-0.06224314868450165}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-27 17:59:42,870 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-27 17:59:42,870 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-27 17:59:42,870 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-27 17:59:42,870 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-27 17:59:42,870 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-27 17:59:42,870 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-27 17:59:42,870 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-27 17:59:42,870 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-27 17:59:42,871 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-27 17:59:42,871 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-27 17:59:42,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-27 17:59:42,873 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-27 17:59:42,874 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-27 17:59:42,893 INFO [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(951): ClusterId : ba0723fe-c8ab-406d-8c19-99d0742abeb0 2023-08-27 17:59:42,893 DEBUG [RS:0;jenkins-hbase4:39339] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-27 17:59:42,895 DEBUG [RS:0;jenkins-hbase4:39339] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-27 17:59:42,895 DEBUG [RS:0;jenkins-hbase4:39339] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-27 17:59:42,896 DEBUG [RS:0;jenkins-hbase4:39339] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-27 17:59:42,897 DEBUG [RS:0;jenkins-hbase4:39339] zookeeper.ReadOnlyZKClient(139): Connect 0x3c9dd76b to 127.0.0.1:50926 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-27 17:59:42,901 DEBUG [RS:0;jenkins-hbase4:39339] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@325a2e88, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-27 17:59:42,901 DEBUG [RS:0;jenkins-hbase4:39339] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3665bc1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-27 17:59:42,910 DEBUG [RS:0;jenkins-hbase4:39339] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39339 2023-08-27 17:59:42,910 INFO [RS:0;jenkins-hbase4:39339] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-27 17:59:42,910 INFO [RS:0;jenkins-hbase4:39339] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-27 17:59:42,910 DEBUG [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(1022): About to register with Master. 2023-08-27 17:59:42,910 INFO [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44803,1693159182634 with isa=jenkins-hbase4.apache.org/172.31.14.131:39339, startcode=1693159182679 2023-08-27 17:59:42,911 DEBUG [RS:0;jenkins-hbase4:39339] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-27 17:59:42,913 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43075, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-08-27 17:59:42,914 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44803] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 17:59:42,914 DEBUG [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd 2023-08-27 17:59:42,914 DEBUG [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37383 2023-08-27 17:59:42,914 DEBUG [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-27 17:59:42,916 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-27 17:59:42,916 DEBUG [RS:0;jenkins-hbase4:39339] zookeeper.ZKUtil(162): regionserver:39339-0x1004ee608bf0001, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 17:59:42,916 WARN [RS:0;jenkins-hbase4:39339] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-27 17:59:42,916 INFO [RS:0;jenkins-hbase4:39339] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-27 17:59:42,916 DEBUG [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/WALs/jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 17:59:42,917 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39339,1693159182679] 2023-08-27 17:59:42,920 DEBUG [RS:0;jenkins-hbase4:39339] zookeeper.ZKUtil(162): regionserver:39339-0x1004ee608bf0001, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 17:59:42,920 DEBUG [RS:0;jenkins-hbase4:39339] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-27 17:59:42,921 INFO [RS:0;jenkins-hbase4:39339] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-27 17:59:42,922 INFO [RS:0;jenkins-hbase4:39339] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-27 17:59:42,922 INFO [RS:0;jenkins-hbase4:39339] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-27 17:59:42,923 INFO [RS:0;jenkins-hbase4:39339] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:42,924 INFO [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-27 17:59:42,925 INFO [RS:0;jenkins-hbase4:39339] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:42,925 DEBUG [RS:0;jenkins-hbase4:39339] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:59:42,925 DEBUG [RS:0;jenkins-hbase4:39339] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:59:42,925 DEBUG [RS:0;jenkins-hbase4:39339] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:59:42,925 DEBUG [RS:0;jenkins-hbase4:39339] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:59:42,925 DEBUG [RS:0;jenkins-hbase4:39339] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:59:42,925 DEBUG [RS:0;jenkins-hbase4:39339] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-27 17:59:42,925 DEBUG [RS:0;jenkins-hbase4:39339] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:59:42,925 DEBUG [RS:0;jenkins-hbase4:39339] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:59:42,925 DEBUG [RS:0;jenkins-hbase4:39339] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:59:42,925 DEBUG [RS:0;jenkins-hbase4:39339] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 17:59:42,926 INFO [RS:0;jenkins-hbase4:39339] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:42,926 INFO [RS:0;jenkins-hbase4:39339] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:42,926 INFO [RS:0;jenkins-hbase4:39339] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:42,937 INFO [RS:0;jenkins-hbase4:39339] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-27 17:59:42,937 INFO [RS:0;jenkins-hbase4:39339] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39339,1693159182679-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:42,947 INFO [RS:0;jenkins-hbase4:39339] regionserver.Replication(203): jenkins-hbase4.apache.org,39339,1693159182679 started 2023-08-27 17:59:42,947 INFO [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39339,1693159182679, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39339, sessionid=0x1004ee608bf0001 2023-08-27 17:59:42,947 DEBUG [RS:0;jenkins-hbase4:39339] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-27 17:59:42,947 DEBUG [RS:0;jenkins-hbase4:39339] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 17:59:42,947 DEBUG [RS:0;jenkins-hbase4:39339] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39339,1693159182679' 2023-08-27 17:59:42,947 DEBUG [RS:0;jenkins-hbase4:39339] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-27 17:59:42,947 DEBUG [RS:0;jenkins-hbase4:39339] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-27 17:59:42,948 DEBUG [RS:0;jenkins-hbase4:39339] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-27 17:59:42,948 DEBUG [RS:0;jenkins-hbase4:39339] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-27 17:59:42,948 DEBUG [RS:0;jenkins-hbase4:39339] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 17:59:42,948 DEBUG [RS:0;jenkins-hbase4:39339] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39339,1693159182679' 2023-08-27 17:59:42,948 DEBUG [RS:0;jenkins-hbase4:39339] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-27 17:59:42,948 DEBUG [RS:0;jenkins-hbase4:39339] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-27 17:59:42,948 DEBUG [RS:0;jenkins-hbase4:39339] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-27 17:59:42,948 INFO [RS:0;jenkins-hbase4:39339] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-27 17:59:42,948 INFO [RS:0;jenkins-hbase4:39339] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-27 17:59:43,024 DEBUG [jenkins-hbase4:44803] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-27 17:59:43,025 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39339,1693159182679, state=OPENING 2023-08-27 17:59:43,027 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-27 17:59:43,028 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:59:43,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39339,1693159182679}] 2023-08-27 17:59:43,028 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-27 17:59:43,050 INFO [RS:0;jenkins-hbase4:39339] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39339%2C1693159182679, suffix=, logDir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/WALs/jenkins-hbase4.apache.org,39339,1693159182679, archiveDir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/oldWALs, maxLogs=32 2023-08-27 17:59:43,066 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42739,DS-b4e834c6-911c-4073-b606-b1bf97c30227,DISK] 2023-08-27 17:59:43,066 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44295,DS-f874d94b-e39a-48bb-affd-31f5b5389f70,DISK] 2023-08-27 17:59:43,068 INFO [RS:0;jenkins-hbase4:39339] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/WALs/jenkins-hbase4.apache.org,39339,1693159182679/jenkins-hbase4.apache.org%2C39339%2C1693159182679.1693159183051 2023-08-27 17:59:43,068 DEBUG [RS:0;jenkins-hbase4:39339] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42739,DS-b4e834c6-911c-4073-b606-b1bf97c30227,DISK], DatanodeInfoWithStorage[127.0.0.1:44295,DS-f874d94b-e39a-48bb-affd-31f5b5389f70,DISK]] 2023-08-27 17:59:43,182 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 17:59:43,182 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-27 17:59:43,184 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-27 17:59:43,189 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-27 17:59:43,189 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-27 17:59:43,191 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39339%2C1693159182679.meta, suffix=.meta, logDir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/WALs/jenkins-hbase4.apache.org,39339,1693159182679, archiveDir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/oldWALs, maxLogs=32 2023-08-27 17:59:43,191 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-27 17:59:43,205 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42739,DS-b4e834c6-911c-4073-b606-b1bf97c30227,DISK] 2023-08-27 17:59:43,206 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44295,DS-f874d94b-e39a-48bb-affd-31f5b5389f70,DISK] 2023-08-27 17:59:43,208 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/WALs/jenkins-hbase4.apache.org,39339,1693159182679/jenkins-hbase4.apache.org%2C39339%2C1693159182679.meta.1693159183191.meta 2023-08-27 17:59:43,208 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42739,DS-b4e834c6-911c-4073-b606-b1bf97c30227,DISK], DatanodeInfoWithStorage[127.0.0.1:44295,DS-f874d94b-e39a-48bb-affd-31f5b5389f70,DISK]] 2023-08-27 17:59:43,208 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-27 17:59:43,209 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-27 17:59:43,209 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-27 17:59:43,209 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-27 17:59:43,209 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-27 17:59:43,209 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:59:43,209 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-27 17:59:43,209 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-27 17:59:43,211 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-27 17:59:43,212 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/info 2023-08-27 17:59:43,212 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/info 2023-08-27 17:59:43,212 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-27 17:59:43,213 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:59:43,213 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-27 17:59:43,214 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/rep_barrier 2023-08-27 17:59:43,214 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/rep_barrier 2023-08-27 17:59:43,214 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-27 17:59:43,215 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:59:43,215 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-27 17:59:43,216 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/table 2023-08-27 17:59:43,216 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/table 2023-08-27 17:59:43,216 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-27 17:59:43,217 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:59:43,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740 2023-08-27 17:59:43,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740 2023-08-27 17:59:43,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-27 17:59:43,222 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-27 17:59:43,223 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=690521, jitterRate=-0.12195749580860138}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-27 17:59:43,223 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-27 17:59:43,224 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1693159183182 2023-08-27 17:59:43,228 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-27 17:59:43,228 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-27 17:59:43,228 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39339,1693159182679, state=OPEN 2023-08-27 17:59:43,231 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-27 17:59:43,231 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-27 17:59:43,233 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-27 17:59:43,233 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39339,1693159182679 in 203 msec 2023-08-27 17:59:43,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-27 17:59:43,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-08-27 17:59:43,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 406 msec 2023-08-27 17:59:43,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1693159183237, completionTime=-1 2023-08-27 17:59:43,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-27 17:59:43,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-27 17:59:43,239 DEBUG [hconnection-0x758340ff-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-27 17:59:43,241 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-27 17:59:43,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-27 17:59:43,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1693159243243 2023-08-27 17:59:43,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1693159303243 2023-08-27 17:59:43,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-08-27 17:59:43,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44803,1693159182634-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:43,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44803,1693159182634-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:43,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44803,1693159182634-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:43,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44803, period=300000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:43,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-27 17:59:43,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-27 17:59:43,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-27 17:59:43,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-27 17:59:43,250 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-27 17:59:43,251 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-27 17:59:43,252 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-27 17:59:43,253 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/.tmp/data/hbase/namespace/3bb29733054d9ce0d655fb93665aa483 2023-08-27 17:59:43,254 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/.tmp/data/hbase/namespace/3bb29733054d9ce0d655fb93665aa483 empty. 2023-08-27 17:59:43,254 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/.tmp/data/hbase/namespace/3bb29733054d9ce0d655fb93665aa483 2023-08-27 17:59:43,254 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-27 17:59:43,265 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-27 17:59:43,266 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3bb29733054d9ce0d655fb93665aa483, NAME => 'hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/.tmp 2023-08-27 17:59:43,274 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:59:43,274 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 3bb29733054d9ce0d655fb93665aa483, disabling compactions & flushes 2023-08-27 17:59:43,274 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483. 2023-08-27 17:59:43,274 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483. 2023-08-27 17:59:43,274 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483. after waiting 0 ms 2023-08-27 17:59:43,274 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483. 2023-08-27 17:59:43,274 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483. 2023-08-27 17:59:43,274 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 3bb29733054d9ce0d655fb93665aa483: 2023-08-27 17:59:43,277 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-27 17:59:43,278 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1693159183278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1693159183278"}]},"ts":"1693159183278"} 2023-08-27 17:59:43,280 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-27 17:59:43,281 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-27 17:59:43,282 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1693159183281"}]},"ts":"1693159183281"} 2023-08-27 17:59:43,283 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-27 17:59:43,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3bb29733054d9ce0d655fb93665aa483, ASSIGN}] 2023-08-27 17:59:43,291 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3bb29733054d9ce0d655fb93665aa483, ASSIGN 2023-08-27 17:59:43,292 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3bb29733054d9ce0d655fb93665aa483, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39339,1693159182679; forceNewPlan=false, retain=false 2023-08-27 17:59:43,443 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3bb29733054d9ce0d655fb93665aa483, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 17:59:43,443 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1693159183443"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1693159183443"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1693159183443"}]},"ts":"1693159183443"} 2023-08-27 17:59:43,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3bb29733054d9ce0d655fb93665aa483, server=jenkins-hbase4.apache.org,39339,1693159182679}] 2023-08-27 17:59:43,601 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483. 2023-08-27 17:59:43,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3bb29733054d9ce0d655fb93665aa483, NAME => 'hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483.', STARTKEY => '', ENDKEY => ''} 2023-08-27 17:59:43,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3bb29733054d9ce0d655fb93665aa483 2023-08-27 17:59:43,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:59:43,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3bb29733054d9ce0d655fb93665aa483 2023-08-27 17:59:43,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3bb29733054d9ce0d655fb93665aa483 2023-08-27 17:59:43,603 INFO [StoreOpener-3bb29733054d9ce0d655fb93665aa483-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3bb29733054d9ce0d655fb93665aa483 2023-08-27 17:59:43,605 DEBUG [StoreOpener-3bb29733054d9ce0d655fb93665aa483-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/namespace/3bb29733054d9ce0d655fb93665aa483/info 2023-08-27 17:59:43,605 DEBUG [StoreOpener-3bb29733054d9ce0d655fb93665aa483-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/namespace/3bb29733054d9ce0d655fb93665aa483/info 2023-08-27 17:59:43,605 INFO [StoreOpener-3bb29733054d9ce0d655fb93665aa483-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bb29733054d9ce0d655fb93665aa483 columnFamilyName info 2023-08-27 17:59:43,606 INFO [StoreOpener-3bb29733054d9ce0d655fb93665aa483-1] regionserver.HStore(310): Store=3bb29733054d9ce0d655fb93665aa483/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:59:43,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/namespace/3bb29733054d9ce0d655fb93665aa483 2023-08-27 17:59:43,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/namespace/3bb29733054d9ce0d655fb93665aa483 2023-08-27 17:59:43,610 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3bb29733054d9ce0d655fb93665aa483 2023-08-27 17:59:43,612 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/namespace/3bb29733054d9ce0d655fb93665aa483/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-27 17:59:43,613 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3bb29733054d9ce0d655fb93665aa483; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=870800, jitterRate=0.10728038847446442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-27 17:59:43,613 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3bb29733054d9ce0d655fb93665aa483: 2023-08-27 17:59:43,613 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483., pid=6, masterSystemTime=1693159183597 2023-08-27 17:59:43,616 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483. 2023-08-27 17:59:43,616 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483. 2023-08-27 17:59:43,617 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3bb29733054d9ce0d655fb93665aa483, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 17:59:43,617 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1693159183616"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1693159183616"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1693159183616"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1693159183616"}]},"ts":"1693159183616"} 2023-08-27 17:59:43,620 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-27 17:59:43,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3bb29733054d9ce0d655fb93665aa483, server=jenkins-hbase4.apache.org,39339,1693159182679 in 173 msec 2023-08-27 17:59:43,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-27 17:59:43,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3bb29733054d9ce0d655fb93665aa483, ASSIGN in 332 msec 2023-08-27 17:59:43,624 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-27 17:59:43,624 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1693159183624"}]},"ts":"1693159183624"} 2023-08-27 17:59:43,626 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-27 17:59:43,628 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-27 17:59:43,629 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 379 msec 2023-08-27 17:59:43,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-27 17:59:43,652 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-27 17:59:43,652 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:59:43,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-27 17:59:43,665 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-27 17:59:43,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-08-27 17:59:43,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-27 17:59:43,686 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-27 17:59:43,689 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-08-27 17:59:43,704 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-27 17:59:43,708 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-27 17:59:43,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.010sec 2023-08-27 17:59:43,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-27 17:59:43,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-27 17:59:43,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-27 17:59:43,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44803,1693159182634-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-27 17:59:43,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44803,1693159182634-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-27 17:59:43,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-27 17:59:43,793 DEBUG [Listener at localhost/33159] zookeeper.ReadOnlyZKClient(139): Connect 0x4b4c200d to 127.0.0.1:50926 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-27 17:59:43,798 DEBUG [Listener at localhost/33159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3df783af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-27 17:59:43,800 DEBUG [hconnection-0x32935195-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-27 17:59:43,801 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-27 17:59:43,803 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44803,1693159182634 2023-08-27 17:59:43,803 INFO [Listener at localhost/33159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 17:59:43,806 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-27 17:59:43,806 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 17:59:43,807 INFO [Listener at localhost/33159] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-27 17:59:43,808 DEBUG [Listener at localhost/33159] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-27 17:59:43,810 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-27 17:59:43,812 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44803] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-27 17:59:43,812 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44803] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-27 17:59:43,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-27 17:59:43,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44803] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRolling 2023-08-27 17:59:43,818 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-08-27 17:59:43,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRolling" procId is: 9 2023-08-27 17:59:43,819 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-27 17:59:43,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-27 17:59:43,821 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/.tmp/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 17:59:43,821 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/.tmp/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a empty. 2023-08-27 17:59:43,822 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/.tmp/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 17:59:43,822 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRolling regions 2023-08-27 17:59:43,836 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/.tmp/data/default/TestLogRolling-testLogRolling/.tabledesc/.tableinfo.0000000001 2023-08-27 17:59:43,838 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => c7481e51e8c91d609969b5d4e2380d3a, NAME => 'TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/.tmp 2023-08-27 17:59:43,845 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:59:43,846 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1604): Closing c7481e51e8c91d609969b5d4e2380d3a, disabling compactions & flushes 2023-08-27 17:59:43,846 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. 2023-08-27 17:59:43,846 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. 2023-08-27 17:59:43,846 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. after waiting 0 ms 2023-08-27 17:59:43,846 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. 2023-08-27 17:59:43,846 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. 2023-08-27 17:59:43,846 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1558): Region close journal for c7481e51e8c91d609969b5d4e2380d3a: 2023-08-27 17:59:43,848 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ADD_TO_META 2023-08-27 17:59:43,850 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1693159183850"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1693159183850"}]},"ts":"1693159183850"} 2023-08-27 17:59:43,852 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-27 17:59:43,853 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-27 17:59:43,853 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1693159183853"}]},"ts":"1693159183853"} 2023-08-27 17:59:43,854 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLING in hbase:meta 2023-08-27 17:59:43,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=c7481e51e8c91d609969b5d4e2380d3a, ASSIGN}] 2023-08-27 17:59:43,860 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=c7481e51e8c91d609969b5d4e2380d3a, ASSIGN 2023-08-27 17:59:43,862 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=c7481e51e8c91d609969b5d4e2380d3a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39339,1693159182679; forceNewPlan=false, retain=false 2023-08-27 17:59:44,013 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c7481e51e8c91d609969b5d4e2380d3a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 17:59:44,013 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1693159184013"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1693159184013"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1693159184013"}]},"ts":"1693159184013"} 2023-08-27 17:59:44,015 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure c7481e51e8c91d609969b5d4e2380d3a, server=jenkins-hbase4.apache.org,39339,1693159182679}] 2023-08-27 17:59:44,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. 2023-08-27 17:59:44,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c7481e51e8c91d609969b5d4e2380d3a, NAME => 'TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.', STARTKEY => '', ENDKEY => ''} 2023-08-27 17:59:44,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 17:59:44,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 17:59:44,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 17:59:44,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 17:59:44,172 INFO [StoreOpener-c7481e51e8c91d609969b5d4e2380d3a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 17:59:44,173 DEBUG [StoreOpener-c7481e51e8c91d609969b5d4e2380d3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info 2023-08-27 17:59:44,173 DEBUG [StoreOpener-c7481e51e8c91d609969b5d4e2380d3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info 2023-08-27 17:59:44,173 INFO [StoreOpener-c7481e51e8c91d609969b5d4e2380d3a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7481e51e8c91d609969b5d4e2380d3a columnFamilyName info 2023-08-27 17:59:44,174 INFO [StoreOpener-c7481e51e8c91d609969b5d4e2380d3a-1] regionserver.HStore(310): Store=c7481e51e8c91d609969b5d4e2380d3a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 17:59:44,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 17:59:44,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 17:59:44,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 17:59:44,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-27 17:59:44,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c7481e51e8c91d609969b5d4e2380d3a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=840483, jitterRate=0.06873014569282532}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-27 17:59:44,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c7481e51e8c91d609969b5d4e2380d3a: 2023-08-27 17:59:44,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a., pid=11, masterSystemTime=1693159184166 2023-08-27 17:59:44,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. 2023-08-27 17:59:44,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. 2023-08-27 17:59:44,185 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c7481e51e8c91d609969b5d4e2380d3a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 17:59:44,185 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1693159184185"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1693159184185"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1693159184185"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1693159184185"}]},"ts":"1693159184185"} 2023-08-27 17:59:44,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-27 17:59:44,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure c7481e51e8c91d609969b5d4e2380d3a, server=jenkins-hbase4.apache.org,39339,1693159182679 in 172 msec 2023-08-27 17:59:44,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-27 17:59:44,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=c7481e51e8c91d609969b5d4e2380d3a, ASSIGN in 330 msec 2023-08-27 17:59:44,192 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-27 17:59:44,192 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1693159184192"}]},"ts":"1693159184192"} 2023-08-27 17:59:44,194 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLED in hbase:meta 2023-08-27 17:59:44,196 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_POST_OPERATION 2023-08-27 17:59:44,197 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRolling in 384 msec 2023-08-27 17:59:46,895 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-27 17:59:48,921 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-27 17:59:48,921 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-27 17:59:48,922 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRolling' 2023-08-27 17:59:53,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-27 17:59:53,821 INFO [Listener at localhost/33159] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRolling, procId: 9 completed 2023-08-27 17:59:53,823 DEBUG [Listener at localhost/33159] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRolling 2023-08-27 17:59:53,823 DEBUG [Listener at localhost/33159] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. 2023-08-27 17:59:53,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 17:59:53,837 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing c7481e51e8c91d609969b5d4e2380d3a 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-27 17:59:53,853 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=12 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp/info/2f8689a8a01d488190aaeef30c9aba2d 2023-08-27 17:59:53,864 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp/info/2f8689a8a01d488190aaeef30c9aba2d as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/2f8689a8a01d488190aaeef30c9aba2d 2023-08-27 17:59:53,870 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/2f8689a8a01d488190aaeef30c9aba2d, entries=8, sequenceid=12, filesize=13.0 K 2023-08-27 17:59:53,870 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=c7481e51e8c91d609969b5d4e2380d3a, server=jenkins-hbase4.apache.org,39339,1693159182679 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-27 17:59:53,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] ipc.CallRunner(144): callId: 38 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.14.131:54214 deadline: 1693159203870, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=c7481e51e8c91d609969b5d4e2380d3a, server=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 17:59:53,871 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for c7481e51e8c91d609969b5d4e2380d3a in 34ms, sequenceid=12, compaction requested=false 2023-08-27 17:59:53,872 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for c7481e51e8c91d609969b5d4e2380d3a: 2023-08-27 18:00:03,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 18:00:03,956 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing c7481e51e8c91d609969b5d4e2380d3a 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-27 18:00:03,973 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=37 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp/info/da882115679b457a97a485facb9f3a39 2023-08-27 18:00:03,982 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp/info/da882115679b457a97a485facb9f3a39 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/da882115679b457a97a485facb9f3a39 2023-08-27 18:00:03,989 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/da882115679b457a97a485facb9f3a39, entries=22, sequenceid=37, filesize=27.4 K 2023-08-27 18:00:03,990 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=2.05 KB/2102 for c7481e51e8c91d609969b5d4e2380d3a in 33ms, sequenceid=37, compaction requested=false 2023-08-27 18:00:03,990 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for c7481e51e8c91d609969b5d4e2380d3a: 2023-08-27 18:00:03,990 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=40.3 K, sizeToCheck=16.0 K 2023-08-27 18:00:03,990 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-27 18:00:03,991 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/da882115679b457a97a485facb9f3a39 because midkey is the same as first or last row 2023-08-27 18:00:05,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 18:00:05,970 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing c7481e51e8c91d609969b5d4e2380d3a 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-27 18:00:05,990 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=48 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp/info/a26626e626df4c9baa7591c75ff76525 2023-08-27 18:00:05,998 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp/info/a26626e626df4c9baa7591c75ff76525 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/a26626e626df4c9baa7591c75ff76525 2023-08-27 18:00:05,999 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=c7481e51e8c91d609969b5d4e2380d3a, server=jenkins-hbase4.apache.org,39339,1693159182679 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-27 18:00:05,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] ipc.CallRunner(144): callId: 70 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.14.131:54214 deadline: 1693159215999, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=c7481e51e8c91d609969b5d4e2380d3a, server=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:00:06,004 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/a26626e626df4c9baa7591c75ff76525, entries=8, sequenceid=48, filesize=13.0 K 2023-08-27 18:00:06,004 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for c7481e51e8c91d609969b5d4e2380d3a in 34ms, sequenceid=48, compaction requested=true 2023-08-27 18:00:06,005 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for c7481e51e8c91d609969b5d4e2380d3a: 2023-08-27 18:00:06,005 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=53.3 K, sizeToCheck=16.0 K 2023-08-27 18:00:06,005 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-27 18:00:06,005 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/da882115679b457a97a485facb9f3a39 because midkey is the same as first or last row 2023-08-27 18:00:06,006 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:00:06,006 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-27 18:00:06,008 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 54576 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-27 18:00:06,008 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1912): c7481e51e8c91d609969b5d4e2380d3a/info is initiating minor compaction (all files) 2023-08-27 18:00:06,008 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c7481e51e8c91d609969b5d4e2380d3a/info in TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. 2023-08-27 18:00:06,008 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/2f8689a8a01d488190aaeef30c9aba2d, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/da882115679b457a97a485facb9f3a39, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/a26626e626df4c9baa7591c75ff76525] into tmpdir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp, totalSize=53.3 K 2023-08-27 18:00:06,009 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting 2f8689a8a01d488190aaeef30c9aba2d, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1693159193826 2023-08-27 18:00:06,009 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting da882115679b457a97a485facb9f3a39, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=37, earliestPutTs=1693159193838 2023-08-27 18:00:06,010 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting a26626e626df4c9baa7591c75ff76525, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1693159203957 2023-08-27 18:00:06,023 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] throttle.PressureAwareThroughputController(145): c7481e51e8c91d609969b5d4e2380d3a#info#compaction#18 average throughput is 19.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-27 18:00:06,041 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp/info/d21e3174c292468d8e84f65c7696ada2 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/d21e3174c292468d8e84f65c7696ada2 2023-08-27 18:00:06,047 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c7481e51e8c91d609969b5d4e2380d3a/info of c7481e51e8c91d609969b5d4e2380d3a into d21e3174c292468d8e84f65c7696ada2(size=43.9 K), total size for store is 43.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-27 18:00:06,047 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c7481e51e8c91d609969b5d4e2380d3a: 2023-08-27 18:00:06,047 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a., storeName=c7481e51e8c91d609969b5d4e2380d3a/info, priority=13, startTime=1693159206006; duration=0sec 2023-08-27 18:00:06,048 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=43.9 K, sizeToCheck=16.0 K 2023-08-27 18:00:06,048 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-27 18:00:06,049 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.StoreUtils(129): cannot split hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/d21e3174c292468d8e84f65c7696ada2 because midkey is the same as first or last row 2023-08-27 18:00:06,049 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:00:16,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 18:00:16,005 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing c7481e51e8c91d609969b5d4e2380d3a 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-27 18:00:16,017 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=74 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp/info/504d9da91f8a433db6387e3f983a1c89 2023-08-27 18:00:16,023 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp/info/504d9da91f8a433db6387e3f983a1c89 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/504d9da91f8a433db6387e3f983a1c89 2023-08-27 18:00:16,028 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/504d9da91f8a433db6387e3f983a1c89, entries=22, sequenceid=74, filesize=27.4 K 2023-08-27 18:00:16,029 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=4.11 KB/4204 for c7481e51e8c91d609969b5d4e2380d3a in 24ms, sequenceid=74, compaction requested=false 2023-08-27 18:00:16,029 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for c7481e51e8c91d609969b5d4e2380d3a: 2023-08-27 18:00:16,030 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=71.3 K, sizeToCheck=16.0 K 2023-08-27 18:00:16,030 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-27 18:00:16,030 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/d21e3174c292468d8e84f65c7696ada2 because midkey is the same as first or last row 2023-08-27 18:00:18,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 18:00:18,017 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing c7481e51e8c91d609969b5d4e2380d3a 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-27 18:00:18,029 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=85 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp/info/780630c82cb84c00b72f74ca1034dc66 2023-08-27 18:00:18,037 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp/info/780630c82cb84c00b72f74ca1034dc66 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/780630c82cb84c00b72f74ca1034dc66 2023-08-27 18:00:18,043 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=c7481e51e8c91d609969b5d4e2380d3a, server=jenkins-hbase4.apache.org,39339,1693159182679 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-27 18:00:18,043 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/780630c82cb84c00b72f74ca1034dc66, entries=8, sequenceid=85, filesize=13.0 K 2023-08-27 18:00:18,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] ipc.CallRunner(144): callId: 102 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.14.131:54214 deadline: 1693159228043, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=c7481e51e8c91d609969b5d4e2380d3a, server=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:00:18,044 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for c7481e51e8c91d609969b5d4e2380d3a in 27ms, sequenceid=85, compaction requested=true 2023-08-27 18:00:18,044 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for c7481e51e8c91d609969b5d4e2380d3a: 2023-08-27 18:00:18,044 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=84.3 K, sizeToCheck=16.0 K 2023-08-27 18:00:18,044 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-27 18:00:18,044 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/d21e3174c292468d8e84f65c7696ada2 because midkey is the same as first or last row 2023-08-27 18:00:18,045 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:00:18,045 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-27 18:00:18,046 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 86295 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-27 18:00:18,046 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1912): c7481e51e8c91d609969b5d4e2380d3a/info is initiating minor compaction (all files) 2023-08-27 18:00:18,046 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c7481e51e8c91d609969b5d4e2380d3a/info in TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. 2023-08-27 18:00:18,046 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/d21e3174c292468d8e84f65c7696ada2, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/504d9da91f8a433db6387e3f983a1c89, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/780630c82cb84c00b72f74ca1034dc66] into tmpdir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp, totalSize=84.3 K 2023-08-27 18:00:18,047 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting d21e3174c292468d8e84f65c7696ada2, keycount=38, bloomtype=ROW, size=43.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1693159193826 2023-08-27 18:00:18,047 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting 504d9da91f8a433db6387e3f983a1c89, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=74, earliestPutTs=1693159205970 2023-08-27 18:00:18,047 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting 780630c82cb84c00b72f74ca1034dc66, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=85, earliestPutTs=1693159216006 2023-08-27 18:00:18,063 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] throttle.PressureAwareThroughputController(145): c7481e51e8c91d609969b5d4e2380d3a#info#compaction#21 average throughput is 22.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-27 18:00:18,079 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp/info/db9dc2eed621450abc48e064202751a7 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/db9dc2eed621450abc48e064202751a7 2023-08-27 18:00:18,085 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c7481e51e8c91d609969b5d4e2380d3a/info of c7481e51e8c91d609969b5d4e2380d3a into db9dc2eed621450abc48e064202751a7(size=75.0 K), total size for store is 75.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-27 18:00:18,085 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c7481e51e8c91d609969b5d4e2380d3a: 2023-08-27 18:00:18,085 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a., storeName=c7481e51e8c91d609969b5d4e2380d3a/info, priority=13, startTime=1693159218045; duration=0sec 2023-08-27 18:00:18,085 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=75.0 K, sizeToCheck=16.0 K 2023-08-27 18:00:18,085 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-27 18:00:18,086 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit(227): Splitting TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a., compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:00:18,086 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:00:18,088 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44803] assignment.AssignmentManager(1140): Split request from jenkins-hbase4.apache.org,39339,1693159182679, parent={ENCODED => c7481e51e8c91d609969b5d4e2380d3a, NAME => 'TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.', STARTKEY => '', ENDKEY => ''} splitKey=row0064 2023-08-27 18:00:18,095 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44803] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:00:18,101 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44803] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=c7481e51e8c91d609969b5d4e2380d3a, daughterA=21f5c7d650d644e803d714d5e3384c08, daughterB=b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:00:18,102 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=c7481e51e8c91d609969b5d4e2380d3a, daughterA=21f5c7d650d644e803d714d5e3384c08, daughterB=b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:00:18,102 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=c7481e51e8c91d609969b5d4e2380d3a, daughterA=21f5c7d650d644e803d714d5e3384c08, daughterB=b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:00:18,102 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=c7481e51e8c91d609969b5d4e2380d3a, daughterA=21f5c7d650d644e803d714d5e3384c08, daughterB=b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:00:18,109 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=c7481e51e8c91d609969b5d4e2380d3a, UNASSIGN}] 2023-08-27 18:00:18,111 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=c7481e51e8c91d609969b5d4e2380d3a, UNASSIGN 2023-08-27 18:00:18,112 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c7481e51e8c91d609969b5d4e2380d3a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:00:18,112 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1693159218111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1693159218111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1693159218111"}]},"ts":"1693159218111"} 2023-08-27 18:00:18,113 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; CloseRegionProcedure c7481e51e8c91d609969b5d4e2380d3a, server=jenkins-hbase4.apache.org,39339,1693159182679}] 2023-08-27 18:00:18,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 18:00:18,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c7481e51e8c91d609969b5d4e2380d3a, disabling compactions & flushes 2023-08-27 18:00:18,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. 2023-08-27 18:00:18,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. 2023-08-27 18:00:18,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. after waiting 0 ms 2023-08-27 18:00:18,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. 2023-08-27 18:00:18,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c7481e51e8c91d609969b5d4e2380d3a 1/1 column families, dataSize=21.55 KB heapSize=23.38 KB 2023-08-27 18:00:18,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=21.55 KB at sequenceid=110 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp/info/e8dab9429f9c4cbea6d98b6294250fe1 2023-08-27 18:00:18,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.tmp/info/e8dab9429f9c4cbea6d98b6294250fe1 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/e8dab9429f9c4cbea6d98b6294250fe1 2023-08-27 18:00:18,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/e8dab9429f9c4cbea6d98b6294250fe1, entries=21, sequenceid=110, filesize=26.3 K 2023-08-27 18:00:18,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~21.55 KB/22071, heapSize ~23.37 KB/23928, currentSize=0 B/0 for c7481e51e8c91d609969b5d4e2380d3a in 24ms, sequenceid=110, compaction requested=false 2023-08-27 18:00:18,303 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/2f8689a8a01d488190aaeef30c9aba2d, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/da882115679b457a97a485facb9f3a39, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/d21e3174c292468d8e84f65c7696ada2, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/a26626e626df4c9baa7591c75ff76525, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/504d9da91f8a433db6387e3f983a1c89, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/780630c82cb84c00b72f74ca1034dc66] to archive 2023-08-27 18:00:18,304 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-27 18:00:18,305 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/2f8689a8a01d488190aaeef30c9aba2d to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/2f8689a8a01d488190aaeef30c9aba2d 2023-08-27 18:00:18,307 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/da882115679b457a97a485facb9f3a39 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/da882115679b457a97a485facb9f3a39 2023-08-27 18:00:18,309 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/d21e3174c292468d8e84f65c7696ada2 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/d21e3174c292468d8e84f65c7696ada2 2023-08-27 18:00:18,310 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/a26626e626df4c9baa7591c75ff76525 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/a26626e626df4c9baa7591c75ff76525 2023-08-27 18:00:18,311 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/504d9da91f8a433db6387e3f983a1c89 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/504d9da91f8a433db6387e3f983a1c89 2023-08-27 18:00:18,312 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/780630c82cb84c00b72f74ca1034dc66 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/780630c82cb84c00b72f74ca1034dc66 2023-08-27 18:00:18,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/recovered.edits/113.seqid, newMaxSeqId=113, maxSeqId=1 2023-08-27 18:00:18,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. 2023-08-27 18:00:18,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c7481e51e8c91d609969b5d4e2380d3a: 2023-08-27 18:00:18,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 18:00:18,321 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c7481e51e8c91d609969b5d4e2380d3a, regionState=CLOSED 2023-08-27 18:00:18,321 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1693159218321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1693159218321"}]},"ts":"1693159218321"} 2023-08-27 18:00:18,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-08-27 18:00:18,325 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; CloseRegionProcedure c7481e51e8c91d609969b5d4e2380d3a, server=jenkins-hbase4.apache.org,39339,1693159182679 in 209 msec 2023-08-27 18:00:18,326 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-08-27 18:00:18,327 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=c7481e51e8c91d609969b5d4e2380d3a, UNASSIGN in 216 msec 2023-08-27 18:00:18,337 INFO [PEWorker-4] assignment.SplitTableRegionProcedure(694): pid=12 splitting 2 storefiles, region=c7481e51e8c91d609969b5d4e2380d3a, threads=2 2023-08-27 18:00:18,338 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/db9dc2eed621450abc48e064202751a7 for region: c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 18:00:18,338 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/e8dab9429f9c4cbea6d98b6294250fe1 for region: c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 18:00:18,349 DEBUG [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/e8dab9429f9c4cbea6d98b6294250fe1, top=true 2023-08-27 18:00:18,359 INFO [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/.splits/b5fad1490e85d434f2a7ec2fe86dcd51/info/TestLogRolling-testLogRolling=c7481e51e8c91d609969b5d4e2380d3a-e8dab9429f9c4cbea6d98b6294250fe1 for child: b5fad1490e85d434f2a7ec2fe86dcd51, parent: c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 18:00:18,359 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/e8dab9429f9c4cbea6d98b6294250fe1 for region: c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 18:00:18,372 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/db9dc2eed621450abc48e064202751a7 for region: c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 18:00:18,372 DEBUG [PEWorker-4] assignment.SplitTableRegionProcedure(755): pid=12 split storefiles for region c7481e51e8c91d609969b5d4e2380d3a Daughter A: 1 storefiles, Daughter B: 2 storefiles. 2023-08-27 18:00:18,399 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/21f5c7d650d644e803d714d5e3384c08/recovered.edits/113.seqid, newMaxSeqId=113, maxSeqId=-1 2023-08-27 18:00:18,401 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/recovered.edits/113.seqid, newMaxSeqId=113, maxSeqId=-1 2023-08-27 18:00:18,403 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1693159218403"},{"qualifier":"splitA","vlen":70,"tag":[],"timestamp":"1693159218403"},{"qualifier":"splitB","vlen":70,"tag":[],"timestamp":"1693159218403"}]},"ts":"1693159218403"} 2023-08-27 18:00:18,403 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1693159218403"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1693159218403"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1693159218403"}]},"ts":"1693159218403"} 2023-08-27 18:00:18,403 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1693159218403"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1693159218403"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1693159218403"}]},"ts":"1693159218403"} 2023-08-27 18:00:18,443 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39339] regionserver.HRegion(9158): Flush requested on 1588230740 2023-08-27 18:00:18,443 DEBUG [MemStoreFlusher.0] regionserver.FlushAllLargeStoresPolicy(69): Since none of the CFs were above the size, flushing all. 2023-08-27 18:00:18,443 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=4.82 KB heapSize=8.36 KB 2023-08-27 18:00:18,453 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=21f5c7d650d644e803d714d5e3384c08, ASSIGN}, {pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=b5fad1490e85d434f2a7ec2fe86dcd51, ASSIGN}] 2023-08-27 18:00:18,454 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=b5fad1490e85d434f2a7ec2fe86dcd51, ASSIGN 2023-08-27 18:00:18,455 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=21f5c7d650d644e803d714d5e3384c08, ASSIGN 2023-08-27 18:00:18,455 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=b5fad1490e85d434f2a7ec2fe86dcd51, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,39339,1693159182679; forceNewPlan=false, retain=false 2023-08-27 18:00:18,455 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=21f5c7d650d644e803d714d5e3384c08, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,39339,1693159182679; forceNewPlan=false, retain=false 2023-08-27 18:00:18,457 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=4.61 KB at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/.tmp/info/cdbd08e2ab7046eb9e59757184797113 2023-08-27 18:00:18,471 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=216 B at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/.tmp/table/221283134a394d0489e5990df8906a37 2023-08-27 18:00:18,477 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/.tmp/info/cdbd08e2ab7046eb9e59757184797113 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/info/cdbd08e2ab7046eb9e59757184797113 2023-08-27 18:00:18,482 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/info/cdbd08e2ab7046eb9e59757184797113, entries=29, sequenceid=17, filesize=8.6 K 2023-08-27 18:00:18,483 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/.tmp/table/221283134a394d0489e5990df8906a37 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/table/221283134a394d0489e5990df8906a37 2023-08-27 18:00:18,488 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/table/221283134a394d0489e5990df8906a37, entries=4, sequenceid=17, filesize=4.8 K 2023-08-27 18:00:18,489 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~4.82 KB/4934, heapSize ~8.08 KB/8272, currentSize=0 B/0 for 1588230740 in 46ms, sequenceid=17, compaction requested=false 2023-08-27 18:00:18,489 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-08-27 18:00:18,606 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b5fad1490e85d434f2a7ec2fe86dcd51, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:00:18,606 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=21f5c7d650d644e803d714d5e3384c08, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:00:18,606 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1693159218606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1693159218606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1693159218606"}]},"ts":"1693159218606"} 2023-08-27 18:00:18,607 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1693159218606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1693159218606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1693159218606"}]},"ts":"1693159218606"} 2023-08-27 18:00:18,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure b5fad1490e85d434f2a7ec2fe86dcd51, server=jenkins-hbase4.apache.org,39339,1693159182679}] 2023-08-27 18:00:18,609 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=18, ppid=15, state=RUNNABLE; OpenRegionProcedure 21f5c7d650d644e803d714d5e3384c08, server=jenkins-hbase4.apache.org,39339,1693159182679}] 2023-08-27 18:00:18,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:00:18,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5fad1490e85d434f2a7ec2fe86dcd51, NAME => 'TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51.', STARTKEY => 'row0064', ENDKEY => ''} 2023-08-27 18:00:18,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:00:18,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 18:00:18,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:00:18,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:00:18,766 INFO [StoreOpener-b5fad1490e85d434f2a7ec2fe86dcd51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:00:18,767 DEBUG [StoreOpener-b5fad1490e85d434f2a7ec2fe86dcd51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info 2023-08-27 18:00:18,767 DEBUG [StoreOpener-b5fad1490e85d434f2a7ec2fe86dcd51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info 2023-08-27 18:00:18,767 INFO [StoreOpener-b5fad1490e85d434f2a7ec2fe86dcd51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5fad1490e85d434f2a7ec2fe86dcd51 columnFamilyName info 2023-08-27 18:00:18,777 DEBUG [StoreOpener-b5fad1490e85d434f2a7ec2fe86dcd51-1] regionserver.HStore(539): loaded hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/TestLogRolling-testLogRolling=c7481e51e8c91d609969b5d4e2380d3a-e8dab9429f9c4cbea6d98b6294250fe1 2023-08-27 18:00:18,787 DEBUG [StoreOpener-b5fad1490e85d434f2a7ec2fe86dcd51-1] regionserver.HStore(539): loaded hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/db9dc2eed621450abc48e064202751a7.c7481e51e8c91d609969b5d4e2380d3a->hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/db9dc2eed621450abc48e064202751a7-top 2023-08-27 18:00:18,787 INFO [StoreOpener-b5fad1490e85d434f2a7ec2fe86dcd51-1] regionserver.HStore(310): Store=b5fad1490e85d434f2a7ec2fe86dcd51/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 18:00:18,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:00:18,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:00:18,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:00:18,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b5fad1490e85d434f2a7ec2fe86dcd51; next sequenceid=114; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=804389, jitterRate=0.022834688425064087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-27 18:00:18,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:00:18,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51., pid=17, masterSystemTime=1693159218760 2023-08-27 18:00:18,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:00:18,796 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 2 store files, 0 compacting, 2 eligible, 16 blocking 2023-08-27 18:00:18,797 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:00:18,797 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1912): b5fad1490e85d434f2a7ec2fe86dcd51/info is initiating minor compaction (all files) 2023-08-27 18:00:18,797 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b5fad1490e85d434f2a7ec2fe86dcd51/info in TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:00:18,798 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/db9dc2eed621450abc48e064202751a7.c7481e51e8c91d609969b5d4e2380d3a->hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/db9dc2eed621450abc48e064202751a7-top, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/TestLogRolling-testLogRolling=c7481e51e8c91d609969b5d4e2380d3a-e8dab9429f9c4cbea6d98b6294250fe1] into tmpdir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp, totalSize=101.3 K 2023-08-27 18:00:18,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:00:18,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:00:18,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08. 2023-08-27 18:00:18,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 21f5c7d650d644e803d714d5e3384c08, NAME => 'TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08.', STARTKEY => '', ENDKEY => 'row0064'} 2023-08-27 18:00:18,798 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting db9dc2eed621450abc48e064202751a7.c7481e51e8c91d609969b5d4e2380d3a, keycount=34, bloomtype=ROW, size=75.0 K, encoding=NONE, compression=NONE, seqNum=86, earliestPutTs=1693159193826 2023-08-27 18:00:18,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling 21f5c7d650d644e803d714d5e3384c08 2023-08-27 18:00:18,799 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b5fad1490e85d434f2a7ec2fe86dcd51, regionState=OPEN, openSeqNum=114, regionLocation=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:00:18,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 18:00:18,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 21f5c7d650d644e803d714d5e3384c08 2023-08-27 18:00:18,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 21f5c7d650d644e803d714d5e3384c08 2023-08-27 18:00:18,799 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1693159218799"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1693159218799"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1693159218799"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1693159218799"}]},"ts":"1693159218799"} 2023-08-27 18:00:18,799 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting TestLogRolling-testLogRolling=c7481e51e8c91d609969b5d4e2380d3a-e8dab9429f9c4cbea6d98b6294250fe1, keycount=21, bloomtype=ROW, size=26.3 K, encoding=NONE, compression=NONE, seqNum=110, earliestPutTs=1693159218018 2023-08-27 18:00:18,801 INFO [StoreOpener-21f5c7d650d644e803d714d5e3384c08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 21f5c7d650d644e803d714d5e3384c08 2023-08-27 18:00:18,802 DEBUG [StoreOpener-21f5c7d650d644e803d714d5e3384c08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/21f5c7d650d644e803d714d5e3384c08/info 2023-08-27 18:00:18,802 DEBUG [StoreOpener-21f5c7d650d644e803d714d5e3384c08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/21f5c7d650d644e803d714d5e3384c08/info 2023-08-27 18:00:18,803 INFO [StoreOpener-21f5c7d650d644e803d714d5e3384c08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21f5c7d650d644e803d714d5e3384c08 columnFamilyName info 2023-08-27 18:00:18,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-08-27 18:00:18,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure b5fad1490e85d434f2a7ec2fe86dcd51, server=jenkins-hbase4.apache.org,39339,1693159182679 in 193 msec 2023-08-27 18:00:18,864 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=b5fad1490e85d434f2a7ec2fe86dcd51, ASSIGN in 407 msec 2023-08-27 18:00:18,868 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] throttle.PressureAwareThroughputController(145): b5fad1490e85d434f2a7ec2fe86dcd51#info#compaction#25 average throughput is 26.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-27 18:00:18,873 DEBUG [StoreOpener-21f5c7d650d644e803d714d5e3384c08-1] regionserver.HStore(539): loaded hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/21f5c7d650d644e803d714d5e3384c08/info/db9dc2eed621450abc48e064202751a7.c7481e51e8c91d609969b5d4e2380d3a->hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/db9dc2eed621450abc48e064202751a7-bottom 2023-08-27 18:00:18,873 INFO [StoreOpener-21f5c7d650d644e803d714d5e3384c08-1] regionserver.HStore(310): Store=21f5c7d650d644e803d714d5e3384c08/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 18:00:18,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/21f5c7d650d644e803d714d5e3384c08 2023-08-27 18:00:18,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/21f5c7d650d644e803d714d5e3384c08 2023-08-27 18:00:18,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 21f5c7d650d644e803d714d5e3384c08 2023-08-27 18:00:18,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 21f5c7d650d644e803d714d5e3384c08; next sequenceid=114; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=871299, jitterRate=0.10791502892971039}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-27 18:00:18,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 21f5c7d650d644e803d714d5e3384c08: 2023-08-27 18:00:18,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08., pid=18, masterSystemTime=1693159218760 2023-08-27 18:00:18,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-08-27 18:00:18,887 DEBUG [RS:0;jenkins-hbase4:39339-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-08-27 18:00:18,888 INFO [RS:0;jenkins-hbase4:39339-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08. 2023-08-27 18:00:18,888 DEBUG [RS:0;jenkins-hbase4:39339-longCompactions-0] regionserver.HStore(1912): 21f5c7d650d644e803d714d5e3384c08/info is initiating minor compaction (all files) 2023-08-27 18:00:18,888 INFO [RS:0;jenkins-hbase4:39339-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 21f5c7d650d644e803d714d5e3384c08/info in TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08. 2023-08-27 18:00:18,889 INFO [RS:0;jenkins-hbase4:39339-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/21f5c7d650d644e803d714d5e3384c08/info/db9dc2eed621450abc48e064202751a7.c7481e51e8c91d609969b5d4e2380d3a->hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/db9dc2eed621450abc48e064202751a7-bottom] into tmpdir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/21f5c7d650d644e803d714d5e3384c08/.tmp, totalSize=75.0 K 2023-08-27 18:00:18,889 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/494382924b2b4dc4b0bf070245fafd81 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/494382924b2b4dc4b0bf070245fafd81 2023-08-27 18:00:18,889 DEBUG [RS:0;jenkins-hbase4:39339-longCompactions-0] compactions.Compactor(207): Compacting db9dc2eed621450abc48e064202751a7.c7481e51e8c91d609969b5d4e2380d3a, keycount=34, bloomtype=ROW, size=75.0 K, encoding=NONE, compression=NONE, seqNum=85, earliestPutTs=1693159193826 2023-08-27 18:00:18,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08. 2023-08-27 18:00:18,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08. 2023-08-27 18:00:18,891 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=21f5c7d650d644e803d714d5e3384c08, regionState=OPEN, openSeqNum=114, regionLocation=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:00:18,891 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1693159218891"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1693159218891"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1693159218891"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1693159218891"}]},"ts":"1693159218891"} 2023-08-27 18:00:18,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=15 2023-08-27 18:00:18,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=15, state=SUCCESS; OpenRegionProcedure 21f5c7d650d644e803d714d5e3384c08, server=jenkins-hbase4.apache.org,39339,1693159182679 in 284 msec 2023-08-27 18:00:18,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=12 2023-08-27 18:00:18,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=21f5c7d650d644e803d714d5e3384c08, ASSIGN in 443 msec 2023-08-27 18:00:18,898 INFO [RS:0;jenkins-hbase4:39339-longCompactions-0] throttle.PressureAwareThroughputController(145): 21f5c7d650d644e803d714d5e3384c08#info#compaction#26 average throughput is 31.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-27 18:00:18,900 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=c7481e51e8c91d609969b5d4e2380d3a, daughterA=21f5c7d650d644e803d714d5e3384c08, daughterB=b5fad1490e85d434f2a7ec2fe86dcd51 in 803 msec 2023-08-27 18:00:18,901 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 (all) file(s) in b5fad1490e85d434f2a7ec2fe86dcd51/info of b5fad1490e85d434f2a7ec2fe86dcd51 into 494382924b2b4dc4b0bf070245fafd81(size=31.6 K), total size for store is 31.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-27 18:00:18,902 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:00:18,902 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51., storeName=b5fad1490e85d434f2a7ec2fe86dcd51/info, priority=14, startTime=1693159218795; duration=0sec 2023-08-27 18:00:18,902 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:00:18,918 DEBUG [RS:0;jenkins-hbase4:39339-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/21f5c7d650d644e803d714d5e3384c08/.tmp/info/53dc7657c4fb4b08acbd5fc8f4b98747 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/21f5c7d650d644e803d714d5e3384c08/info/53dc7657c4fb4b08acbd5fc8f4b98747 2023-08-27 18:00:18,925 INFO [RS:0;jenkins-hbase4:39339-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 21f5c7d650d644e803d714d5e3384c08/info of 21f5c7d650d644e803d714d5e3384c08 into 53dc7657c4fb4b08acbd5fc8f4b98747(size=69.7 K), total size for store is 69.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-27 18:00:18,925 DEBUG [RS:0;jenkins-hbase4:39339-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 21f5c7d650d644e803d714d5e3384c08: 2023-08-27 18:00:18,925 INFO [RS:0;jenkins-hbase4:39339-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08., storeName=21f5c7d650d644e803d714d5e3384c08/info, priority=15, startTime=1693159218887; duration=0sec 2023-08-27 18:00:18,926 DEBUG [RS:0;jenkins-hbase4:39339-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:00:23,860 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-27 18:00:28,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] ipc.CallRunner(144): callId: 104 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.14.131:54214 deadline: 1693159238089, exception=org.apache.hadoop.hbase.NotServingRegionException: TestLogRolling-testLogRolling,,1693159183812.c7481e51e8c91d609969b5d4e2380d3a. is not online on jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:00:50,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:00:50,258 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing b5fad1490e85d434f2a7ec2fe86dcd51 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-27 18:00:50,274 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=125 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/d0ad7ba00a824cee8331548e77afcc0d 2023-08-27 18:00:50,280 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/d0ad7ba00a824cee8331548e77afcc0d as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/d0ad7ba00a824cee8331548e77afcc0d 2023-08-27 18:00:50,286 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/d0ad7ba00a824cee8331548e77afcc0d, entries=8, sequenceid=125, filesize=13.0 K 2023-08-27 18:00:50,288 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for b5fad1490e85d434f2a7ec2fe86dcd51 in 30ms, sequenceid=125, compaction requested=false 2023-08-27 18:00:50,288 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:00:50,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:00:50,288 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing b5fad1490e85d434f2a7ec2fe86dcd51 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-27 18:00:50,301 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=b5fad1490e85d434f2a7ec2fe86dcd51, server=jenkins-hbase4.apache.org,39339,1693159182679 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-27 18:00:50,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] ipc.CallRunner(144): callId: 145 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:54214 deadline: 1693159260301, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=b5fad1490e85d434f2a7ec2fe86dcd51, server=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:00:50,702 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=150 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/ed2db6b0cece4ba18af06c65a501b9f6 2023-08-27 18:00:50,708 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/ed2db6b0cece4ba18af06c65a501b9f6 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/ed2db6b0cece4ba18af06c65a501b9f6 2023-08-27 18:00:50,713 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/ed2db6b0cece4ba18af06c65a501b9f6, entries=22, sequenceid=150, filesize=27.4 K 2023-08-27 18:00:50,714 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=7.18 KB/7357 for b5fad1490e85d434f2a7ec2fe86dcd51 in 426ms, sequenceid=150, compaction requested=true 2023-08-27 18:00:50,714 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:00:50,714 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:00:50,714 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-27 18:00:50,715 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 73719 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-27 18:00:50,715 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1912): b5fad1490e85d434f2a7ec2fe86dcd51/info is initiating minor compaction (all files) 2023-08-27 18:00:50,715 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b5fad1490e85d434f2a7ec2fe86dcd51/info in TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:00:50,716 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/494382924b2b4dc4b0bf070245fafd81, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/d0ad7ba00a824cee8331548e77afcc0d, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/ed2db6b0cece4ba18af06c65a501b9f6] into tmpdir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp, totalSize=72.0 K 2023-08-27 18:00:50,716 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting 494382924b2b4dc4b0bf070245fafd81, keycount=26, bloomtype=ROW, size=31.6 K, encoding=NONE, compression=NONE, seqNum=110, earliestPutTs=1693159216009 2023-08-27 18:00:50,716 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting d0ad7ba00a824cee8331548e77afcc0d, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=125, earliestPutTs=1693159248250 2023-08-27 18:00:50,717 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting ed2db6b0cece4ba18af06c65a501b9f6, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=150, earliestPutTs=1693159250259 2023-08-27 18:00:50,730 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] throttle.PressureAwareThroughputController(145): b5fad1490e85d434f2a7ec2fe86dcd51#info#compaction#29 average throughput is 28.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-27 18:00:50,747 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/6758f0352bdb41fdaf09ced6fed52677 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6758f0352bdb41fdaf09ced6fed52677 2023-08-27 18:00:50,753 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b5fad1490e85d434f2a7ec2fe86dcd51/info of b5fad1490e85d434f2a7ec2fe86dcd51 into 6758f0352bdb41fdaf09ced6fed52677(size=62.7 K), total size for store is 62.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-27 18:00:50,753 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:00:50,754 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51., storeName=b5fad1490e85d434f2a7ec2fe86dcd51/info, priority=13, startTime=1693159250714; duration=0sec 2023-08-27 18:00:50,754 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:01:00,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:01:00,403 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing b5fad1490e85d434f2a7ec2fe86dcd51 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-27 18:01:00,413 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=162 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/aadb2c8ed1554211b7b6d878e515ffa0 2023-08-27 18:01:00,419 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/aadb2c8ed1554211b7b6d878e515ffa0 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/aadb2c8ed1554211b7b6d878e515ffa0 2023-08-27 18:01:00,424 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/aadb2c8ed1554211b7b6d878e515ffa0, entries=8, sequenceid=162, filesize=13.0 K 2023-08-27 18:01:00,425 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=1.03 KB/1051 for b5fad1490e85d434f2a7ec2fe86dcd51 in 22ms, sequenceid=162, compaction requested=false 2023-08-27 18:01:00,425 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:02,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:01:02,414 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing b5fad1490e85d434f2a7ec2fe86dcd51 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-27 18:01:02,432 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=173 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/f5d009fdb23d42f2a4389e365fca1e7c 2023-08-27 18:01:02,439 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/f5d009fdb23d42f2a4389e365fca1e7c as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/f5d009fdb23d42f2a4389e365fca1e7c 2023-08-27 18:01:02,446 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/f5d009fdb23d42f2a4389e365fca1e7c, entries=8, sequenceid=173, filesize=13.0 K 2023-08-27 18:01:02,446 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=13.34 KB/13663 for b5fad1490e85d434f2a7ec2fe86dcd51 in 32ms, sequenceid=173, compaction requested=true 2023-08-27 18:01:02,447 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:02,447 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:01:02,447 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-27 18:01:02,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:01:02,448 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing b5fad1490e85d434f2a7ec2fe86dcd51 1/1 column families, dataSize=14.37 KB heapSize=15.67 KB 2023-08-27 18:01:02,448 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 90753 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-27 18:01:02,448 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1912): b5fad1490e85d434f2a7ec2fe86dcd51/info is initiating minor compaction (all files) 2023-08-27 18:01:02,449 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b5fad1490e85d434f2a7ec2fe86dcd51/info in TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:01:02,449 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6758f0352bdb41fdaf09ced6fed52677, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/aadb2c8ed1554211b7b6d878e515ffa0, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/f5d009fdb23d42f2a4389e365fca1e7c] into tmpdir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp, totalSize=88.6 K 2023-08-27 18:01:02,449 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting 6758f0352bdb41fdaf09ced6fed52677, keycount=56, bloomtype=ROW, size=62.7 K, encoding=NONE, compression=NONE, seqNum=150, earliestPutTs=1693159216009 2023-08-27 18:01:02,450 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting aadb2c8ed1554211b7b6d878e515ffa0, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=162, earliestPutTs=1693159250289 2023-08-27 18:01:02,451 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting f5d009fdb23d42f2a4389e365fca1e7c, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=173, earliestPutTs=1693159260403 2023-08-27 18:01:02,466 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=14.37 KB at sequenceid=190 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/92146743314d4cdcb15aa87fb705aa79 2023-08-27 18:01:02,479 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] throttle.PressureAwareThroughputController(145): b5fad1490e85d434f2a7ec2fe86dcd51#info#compaction#33 average throughput is 36.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-27 18:01:02,480 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/92146743314d4cdcb15aa87fb705aa79 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/92146743314d4cdcb15aa87fb705aa79 2023-08-27 18:01:02,494 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/92146743314d4cdcb15aa87fb705aa79, entries=14, sequenceid=190, filesize=19.2 K 2023-08-27 18:01:02,495 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~14.37 KB/14714, heapSize ~15.66 KB/16032, currentSize=11.29 KB/11561 for b5fad1490e85d434f2a7ec2fe86dcd51 in 47ms, sequenceid=190, compaction requested=false 2023-08-27 18:01:02,495 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:02,498 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/6f16bb876bfb439b8eb22ea99829b213 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6f16bb876bfb439b8eb22ea99829b213 2023-08-27 18:01:02,506 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b5fad1490e85d434f2a7ec2fe86dcd51/info of b5fad1490e85d434f2a7ec2fe86dcd51 into 6f16bb876bfb439b8eb22ea99829b213(size=79.3 K), total size for store is 98.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-27 18:01:02,506 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:02,506 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51., storeName=b5fad1490e85d434f2a7ec2fe86dcd51/info, priority=13, startTime=1693159262447; duration=0sec 2023-08-27 18:01:02,507 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:01:04,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:01:04,473 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing b5fad1490e85d434f2a7ec2fe86dcd51 1/1 column families, dataSize=12.32 KB heapSize=13.47 KB 2023-08-27 18:01:04,496 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=b5fad1490e85d434f2a7ec2fe86dcd51, server=jenkins-hbase4.apache.org,39339,1693159182679 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-27 18:01:04,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] ipc.CallRunner(144): callId: 199 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:54214 deadline: 1693159274496, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=b5fad1490e85d434f2a7ec2fe86dcd51, server=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:01:04,888 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.32 KB at sequenceid=206 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/f1cb01c30b8e4ab8ae131579e01fd856 2023-08-27 18:01:04,894 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/f1cb01c30b8e4ab8ae131579e01fd856 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/f1cb01c30b8e4ab8ae131579e01fd856 2023-08-27 18:01:04,899 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/f1cb01c30b8e4ab8ae131579e01fd856, entries=12, sequenceid=206, filesize=17.1 K 2023-08-27 18:01:04,900 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~12.32 KB/12612, heapSize ~13.45 KB/13776, currentSize=17.45 KB/17867 for b5fad1490e85d434f2a7ec2fe86dcd51 in 427ms, sequenceid=206, compaction requested=true 2023-08-27 18:01:04,900 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:04,900 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:01:04,900 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-27 18:01:04,901 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 118322 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-27 18:01:04,902 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1912): b5fad1490e85d434f2a7ec2fe86dcd51/info is initiating minor compaction (all files) 2023-08-27 18:01:04,902 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b5fad1490e85d434f2a7ec2fe86dcd51/info in TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:01:04,902 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6f16bb876bfb439b8eb22ea99829b213, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/92146743314d4cdcb15aa87fb705aa79, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/f1cb01c30b8e4ab8ae131579e01fd856] into tmpdir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp, totalSize=115.5 K 2023-08-27 18:01:04,902 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting 6f16bb876bfb439b8eb22ea99829b213, keycount=72, bloomtype=ROW, size=79.3 K, encoding=NONE, compression=NONE, seqNum=173, earliestPutTs=1693159216009 2023-08-27 18:01:04,903 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting 92146743314d4cdcb15aa87fb705aa79, keycount=14, bloomtype=ROW, size=19.2 K, encoding=NONE, compression=NONE, seqNum=190, earliestPutTs=1693159262415 2023-08-27 18:01:04,903 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting f1cb01c30b8e4ab8ae131579e01fd856, keycount=12, bloomtype=ROW, size=17.1 K, encoding=NONE, compression=NONE, seqNum=206, earliestPutTs=1693159262449 2023-08-27 18:01:04,915 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] throttle.PressureAwareThroughputController(145): b5fad1490e85d434f2a7ec2fe86dcd51#info#compaction#35 average throughput is 32.74 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-27 18:01:04,926 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/943687c42f454a00a65d29f457292e10 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/943687c42f454a00a65d29f457292e10 2023-08-27 18:01:04,931 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b5fad1490e85d434f2a7ec2fe86dcd51/info of b5fad1490e85d434f2a7ec2fe86dcd51 into 943687c42f454a00a65d29f457292e10(size=106.1 K), total size for store is 106.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-27 18:01:04,931 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:04,931 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51., storeName=b5fad1490e85d434f2a7ec2fe86dcd51/info, priority=13, startTime=1693159264900; duration=0sec 2023-08-27 18:01:04,931 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:01:14,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:01:14,584 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing b5fad1490e85d434f2a7ec2fe86dcd51 1/1 column families, dataSize=18.47 KB heapSize=20.08 KB 2023-08-27 18:01:14,597 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=b5fad1490e85d434f2a7ec2fe86dcd51, server=jenkins-hbase4.apache.org,39339,1693159182679 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-27 18:01:14,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:54214 deadline: 1693159284596, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=b5fad1490e85d434f2a7ec2fe86dcd51, server=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:01:14,604 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=18.47 KB at sequenceid=228 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/64972583c8834105ba96c563b02de7c4 2023-08-27 18:01:14,610 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/64972583c8834105ba96c563b02de7c4 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/64972583c8834105ba96c563b02de7c4 2023-08-27 18:01:14,614 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/64972583c8834105ba96c563b02de7c4, entries=18, sequenceid=228, filesize=23.3 K 2023-08-27 18:01:14,615 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~18.47 KB/18918, heapSize ~20.06 KB/20544, currentSize=11.29 KB/11561 for b5fad1490e85d434f2a7ec2fe86dcd51 in 31ms, sequenceid=228, compaction requested=false 2023-08-27 18:01:14,615 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:24,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:01:24,654 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing b5fad1490e85d434f2a7ec2fe86dcd51 1/1 column families, dataSize=12.32 KB heapSize=13.47 KB 2023-08-27 18:01:24,667 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.32 KB at sequenceid=243 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/616a0249b5114f66bd64fb3ef8ac221f 2023-08-27 18:01:24,675 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/616a0249b5114f66bd64fb3ef8ac221f as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/616a0249b5114f66bd64fb3ef8ac221f 2023-08-27 18:01:24,680 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/616a0249b5114f66bd64fb3ef8ac221f, entries=12, sequenceid=243, filesize=17.1 K 2023-08-27 18:01:24,681 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~12.32 KB/12612, heapSize ~13.45 KB/13776, currentSize=1.03 KB/1051 for b5fad1490e85d434f2a7ec2fe86dcd51 in 26ms, sequenceid=243, compaction requested=true 2023-08-27 18:01:24,681 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:24,681 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:01:24,681 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-27 18:01:24,682 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 150026 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-27 18:01:24,682 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1912): b5fad1490e85d434f2a7ec2fe86dcd51/info is initiating minor compaction (all files) 2023-08-27 18:01:24,682 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b5fad1490e85d434f2a7ec2fe86dcd51/info in TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:01:24,682 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/943687c42f454a00a65d29f457292e10, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/64972583c8834105ba96c563b02de7c4, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/616a0249b5114f66bd64fb3ef8ac221f] into tmpdir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp, totalSize=146.5 K 2023-08-27 18:01:24,682 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting 943687c42f454a00a65d29f457292e10, keycount=98, bloomtype=ROW, size=106.1 K, encoding=NONE, compression=NONE, seqNum=206, earliestPutTs=1693159216009 2023-08-27 18:01:24,683 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting 64972583c8834105ba96c563b02de7c4, keycount=18, bloomtype=ROW, size=23.3 K, encoding=NONE, compression=NONE, seqNum=228, earliestPutTs=1693159264474 2023-08-27 18:01:24,683 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting 616a0249b5114f66bd64fb3ef8ac221f, keycount=12, bloomtype=ROW, size=17.1 K, encoding=NONE, compression=NONE, seqNum=243, earliestPutTs=1693159274585 2023-08-27 18:01:24,696 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] throttle.PressureAwareThroughputController(145): b5fad1490e85d434f2a7ec2fe86dcd51#info#compaction#38 average throughput is 42.77 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-27 18:01:24,716 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/5e0ab448f92f4ea1ac07d2825ea7db30 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/5e0ab448f92f4ea1ac07d2825ea7db30 2023-08-27 18:01:24,722 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b5fad1490e85d434f2a7ec2fe86dcd51/info of b5fad1490e85d434f2a7ec2fe86dcd51 into 5e0ab448f92f4ea1ac07d2825ea7db30(size=137.3 K), total size for store is 137.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-27 18:01:24,722 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:24,722 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51., storeName=b5fad1490e85d434f2a7ec2fe86dcd51/info, priority=13, startTime=1693159284681; duration=0sec 2023-08-27 18:01:24,722 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:01:26,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:01:26,664 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing b5fad1490e85d434f2a7ec2fe86dcd51 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-27 18:01:26,677 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=255 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/5f9c28b73c134576b8cfcb2ec941318d 2023-08-27 18:01:26,684 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/5f9c28b73c134576b8cfcb2ec941318d as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/5f9c28b73c134576b8cfcb2ec941318d 2023-08-27 18:01:26,689 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=b5fad1490e85d434f2a7ec2fe86dcd51, server=jenkins-hbase4.apache.org,39339,1693159182679 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-27 18:01:26,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:54214 deadline: 1693159296689, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=b5fad1490e85d434f2a7ec2fe86dcd51, server=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:01:26,690 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/5f9c28b73c134576b8cfcb2ec941318d, entries=8, sequenceid=255, filesize=13.0 K 2023-08-27 18:01:26,691 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for b5fad1490e85d434f2a7ec2fe86dcd51 in 27ms, sequenceid=255, compaction requested=false 2023-08-27 18:01:26,691 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:36,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:01:36,774 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing b5fad1490e85d434f2a7ec2fe86dcd51 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-27 18:01:36,786 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=280 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/6c7cd9a772b74d6ba787263400aaf5b9 2023-08-27 18:01:36,792 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/6c7cd9a772b74d6ba787263400aaf5b9 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6c7cd9a772b74d6ba787263400aaf5b9 2023-08-27 18:01:36,797 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6c7cd9a772b74d6ba787263400aaf5b9, entries=22, sequenceid=280, filesize=27.4 K 2023-08-27 18:01:36,797 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=3.08 KB/3153 for b5fad1490e85d434f2a7ec2fe86dcd51 in 24ms, sequenceid=280, compaction requested=true 2023-08-27 18:01:36,798 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:36,798 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:01:36,798 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-27 18:01:36,799 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181944 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-27 18:01:36,799 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1912): b5fad1490e85d434f2a7ec2fe86dcd51/info is initiating minor compaction (all files) 2023-08-27 18:01:36,799 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b5fad1490e85d434f2a7ec2fe86dcd51/info in TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:01:36,799 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/5e0ab448f92f4ea1ac07d2825ea7db30, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/5f9c28b73c134576b8cfcb2ec941318d, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6c7cd9a772b74d6ba787263400aaf5b9] into tmpdir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp, totalSize=177.7 K 2023-08-27 18:01:36,799 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting 5e0ab448f92f4ea1ac07d2825ea7db30, keycount=128, bloomtype=ROW, size=137.3 K, encoding=NONE, compression=NONE, seqNum=243, earliestPutTs=1693159216009 2023-08-27 18:01:36,800 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting 5f9c28b73c134576b8cfcb2ec941318d, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=255, earliestPutTs=1693159284654 2023-08-27 18:01:36,800 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting 6c7cd9a772b74d6ba787263400aaf5b9, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=280, earliestPutTs=1693159286665 2023-08-27 18:01:36,811 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] throttle.PressureAwareThroughputController(145): b5fad1490e85d434f2a7ec2fe86dcd51#info#compaction#41 average throughput is 79.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-27 18:01:36,824 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/94c15f44a5674c038dfdef610ed7978a as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/94c15f44a5674c038dfdef610ed7978a 2023-08-27 18:01:36,830 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b5fad1490e85d434f2a7ec2fe86dcd51/info of b5fad1490e85d434f2a7ec2fe86dcd51 into 94c15f44a5674c038dfdef610ed7978a(size=168.3 K), total size for store is 168.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-27 18:01:36,830 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:36,830 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51., storeName=b5fad1490e85d434f2a7ec2fe86dcd51/info, priority=13, startTime=1693159296798; duration=0sec 2023-08-27 18:01:36,830 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:01:38,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:01:38,786 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing b5fad1490e85d434f2a7ec2fe86dcd51 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-27 18:01:38,798 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=292 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/bd156fcce0994109b6904b017720e7a8 2023-08-27 18:01:38,805 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/bd156fcce0994109b6904b017720e7a8 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/bd156fcce0994109b6904b017720e7a8 2023-08-27 18:01:38,810 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=b5fad1490e85d434f2a7ec2fe86dcd51, server=jenkins-hbase4.apache.org,39339,1693159182679 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-27 18:01:38,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] ipc.CallRunner(144): callId: 277 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:54214 deadline: 1693159308810, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=b5fad1490e85d434f2a7ec2fe86dcd51, server=jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:01:38,810 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/bd156fcce0994109b6904b017720e7a8, entries=8, sequenceid=292, filesize=13.0 K 2023-08-27 18:01:38,813 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for b5fad1490e85d434f2a7ec2fe86dcd51 in 27ms, sequenceid=292, compaction requested=false 2023-08-27 18:01:38,813 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:42,928 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/21f5c7d650d644e803d714d5e3384c08/info/db9dc2eed621450abc48e064202751a7.c7481e51e8c91d609969b5d4e2380d3a->hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/db9dc2eed621450abc48e064202751a7-bottom] to archive 2023-08-27 18:01:42,930 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-08-27 18:01:42,932 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/21f5c7d650d644e803d714d5e3384c08/info/db9dc2eed621450abc48e064202751a7.c7481e51e8c91d609969b5d4e2380d3a to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/21f5c7d650d644e803d714d5e3384c08/info/db9dc2eed621450abc48e064202751a7.c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 18:01:42,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/db9dc2eed621450abc48e064202751a7.c7481e51e8c91d609969b5d4e2380d3a->hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/c7481e51e8c91d609969b5d4e2380d3a/info/db9dc2eed621450abc48e064202751a7-top, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/494382924b2b4dc4b0bf070245fafd81, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/TestLogRolling-testLogRolling=c7481e51e8c91d609969b5d4e2380d3a-e8dab9429f9c4cbea6d98b6294250fe1, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/d0ad7ba00a824cee8331548e77afcc0d, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6758f0352bdb41fdaf09ced6fed52677, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/ed2db6b0cece4ba18af06c65a501b9f6, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/aadb2c8ed1554211b7b6d878e515ffa0, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6f16bb876bfb439b8eb22ea99829b213, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/f5d009fdb23d42f2a4389e365fca1e7c, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/92146743314d4cdcb15aa87fb705aa79, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/943687c42f454a00a65d29f457292e10, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/f1cb01c30b8e4ab8ae131579e01fd856, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/64972583c8834105ba96c563b02de7c4, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/5e0ab448f92f4ea1ac07d2825ea7db30, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/616a0249b5114f66bd64fb3ef8ac221f, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/5f9c28b73c134576b8cfcb2ec941318d, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6c7cd9a772b74d6ba787263400aaf5b9] to archive 2023-08-27 18:01:42,947 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-08-27 18:01:42,948 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/db9dc2eed621450abc48e064202751a7.c7481e51e8c91d609969b5d4e2380d3a to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/db9dc2eed621450abc48e064202751a7.c7481e51e8c91d609969b5d4e2380d3a 2023-08-27 18:01:42,950 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/494382924b2b4dc4b0bf070245fafd81 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/494382924b2b4dc4b0bf070245fafd81 2023-08-27 18:01:42,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/TestLogRolling-testLogRolling=c7481e51e8c91d609969b5d4e2380d3a-e8dab9429f9c4cbea6d98b6294250fe1 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/TestLogRolling-testLogRolling=c7481e51e8c91d609969b5d4e2380d3a-e8dab9429f9c4cbea6d98b6294250fe1 2023-08-27 18:01:42,952 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/d0ad7ba00a824cee8331548e77afcc0d to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/d0ad7ba00a824cee8331548e77afcc0d 2023-08-27 18:01:42,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6758f0352bdb41fdaf09ced6fed52677 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6758f0352bdb41fdaf09ced6fed52677 2023-08-27 18:01:42,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/ed2db6b0cece4ba18af06c65a501b9f6 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/ed2db6b0cece4ba18af06c65a501b9f6 2023-08-27 18:01:42,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/aadb2c8ed1554211b7b6d878e515ffa0 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/aadb2c8ed1554211b7b6d878e515ffa0 2023-08-27 18:01:42,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6f16bb876bfb439b8eb22ea99829b213 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6f16bb876bfb439b8eb22ea99829b213 2023-08-27 18:01:42,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/f5d009fdb23d42f2a4389e365fca1e7c to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/f5d009fdb23d42f2a4389e365fca1e7c 2023-08-27 18:01:42,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/92146743314d4cdcb15aa87fb705aa79 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/92146743314d4cdcb15aa87fb705aa79 2023-08-27 18:01:42,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/943687c42f454a00a65d29f457292e10 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/943687c42f454a00a65d29f457292e10 2023-08-27 18:01:42,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/f1cb01c30b8e4ab8ae131579e01fd856 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/f1cb01c30b8e4ab8ae131579e01fd856 2023-08-27 18:01:42,962 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/64972583c8834105ba96c563b02de7c4 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/64972583c8834105ba96c563b02de7c4 2023-08-27 18:01:42,964 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/5e0ab448f92f4ea1ac07d2825ea7db30 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/5e0ab448f92f4ea1ac07d2825ea7db30 2023-08-27 18:01:42,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/616a0249b5114f66bd64fb3ef8ac221f to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/616a0249b5114f66bd64fb3ef8ac221f 2023-08-27 18:01:42,966 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/5f9c28b73c134576b8cfcb2ec941318d to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/5f9c28b73c134576b8cfcb2ec941318d 2023-08-27 18:01:42,967 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6c7cd9a772b74d6ba787263400aaf5b9 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/6c7cd9a772b74d6ba787263400aaf5b9 2023-08-27 18:01:48,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39339] regionserver.HRegion(9158): Flush requested on b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:01:48,912 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing b5fad1490e85d434f2a7ec2fe86dcd51 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-27 18:01:48,923 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=317 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/9e7b69d023e84b5ab5ebf4dc0bdce8a8 2023-08-27 18:01:48,928 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/9e7b69d023e84b5ab5ebf4dc0bdce8a8 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/9e7b69d023e84b5ab5ebf4dc0bdce8a8 2023-08-27 18:01:48,933 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/9e7b69d023e84b5ab5ebf4dc0bdce8a8, entries=22, sequenceid=317, filesize=27.4 K 2023-08-27 18:01:48,934 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=5.13 KB/5255 for b5fad1490e85d434f2a7ec2fe86dcd51 in 22ms, sequenceid=317, compaction requested=true 2023-08-27 18:01:48,934 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:48,934 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:01:48,934 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-27 18:01:48,935 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 213674 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-27 18:01:48,935 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1912): b5fad1490e85d434f2a7ec2fe86dcd51/info is initiating minor compaction (all files) 2023-08-27 18:01:48,935 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b5fad1490e85d434f2a7ec2fe86dcd51/info in TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:01:48,935 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/94c15f44a5674c038dfdef610ed7978a, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/bd156fcce0994109b6904b017720e7a8, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/9e7b69d023e84b5ab5ebf4dc0bdce8a8] into tmpdir=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp, totalSize=208.7 K 2023-08-27 18:01:48,936 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting 94c15f44a5674c038dfdef610ed7978a, keycount=158, bloomtype=ROW, size=168.3 K, encoding=NONE, compression=NONE, seqNum=280, earliestPutTs=1693159216009 2023-08-27 18:01:48,936 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting bd156fcce0994109b6904b017720e7a8, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=292, earliestPutTs=1693159296774 2023-08-27 18:01:48,936 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] compactions.Compactor(207): Compacting 9e7b69d023e84b5ab5ebf4dc0bdce8a8, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=317, earliestPutTs=1693159298787 2023-08-27 18:01:48,949 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] throttle.PressureAwareThroughputController(145): b5fad1490e85d434f2a7ec2fe86dcd51#info#compaction#44 average throughput is 62.81 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-27 18:01:48,966 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/344e2fb819004564ad1b94a715ade754 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/344e2fb819004564ad1b94a715ade754 2023-08-27 18:01:48,971 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b5fad1490e85d434f2a7ec2fe86dcd51/info of b5fad1490e85d434f2a7ec2fe86dcd51 into 344e2fb819004564ad1b94a715ade754(size=198.6 K), total size for store is 198.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-27 18:01:48,971 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:48,971 INFO [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51., storeName=b5fad1490e85d434f2a7ec2fe86dcd51/info, priority=13, startTime=1693159308934; duration=0sec 2023-08-27 18:01:48,971 DEBUG [RS:0;jenkins-hbase4:39339-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-27 18:01:50,918 INFO [Listener at localhost/33159] wal.AbstractTestLogRolling(188): after writing there are 0 log files 2023-08-27 18:01:50,935 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44295,DS-f874d94b-e39a-48bb-affd-31f5b5389f70,DISK] 2023-08-27 18:01:50,936 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42739,DS-b4e834c6-911c-4073-b606-b1bf97c30227,DISK] 2023-08-27 18:01:50,939 INFO [Listener at localhost/33159] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/WALs/jenkins-hbase4.apache.org,39339,1693159182679/jenkins-hbase4.apache.org%2C39339%2C1693159182679.1693159183051 with entries=309, filesize=300.61 KB; new WAL /user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/WALs/jenkins-hbase4.apache.org,39339,1693159182679/jenkins-hbase4.apache.org%2C39339%2C1693159182679.1693159310918 2023-08-27 18:01:50,939 DEBUG [Listener at localhost/33159] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44295,DS-f874d94b-e39a-48bb-affd-31f5b5389f70,DISK], DatanodeInfoWithStorage[127.0.0.1:42739,DS-b4e834c6-911c-4073-b606-b1bf97c30227,DISK]] 2023-08-27 18:01:50,939 DEBUG [Listener at localhost/33159] wal.AbstractFSWAL(716): hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/WALs/jenkins-hbase4.apache.org,39339,1693159182679/jenkins-hbase4.apache.org%2C39339%2C1693159182679.1693159183051 is not closed yet, will try archiving it next time 2023-08-27 18:01:50,945 DEBUG [Listener at localhost/33159] regionserver.HRegion(2446): Flush status journal for 21f5c7d650d644e803d714d5e3384c08: 2023-08-27 18:01:50,945 INFO [Listener at localhost/33159] regionserver.HRegion(2745): Flushing 3bb29733054d9ce0d655fb93665aa483 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-27 18:01:50,955 INFO [Listener at localhost/33159] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/namespace/3bb29733054d9ce0d655fb93665aa483/.tmp/info/7f31b853b453410b9e1031ae8610287b 2023-08-27 18:01:50,962 DEBUG [Listener at localhost/33159] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/namespace/3bb29733054d9ce0d655fb93665aa483/.tmp/info/7f31b853b453410b9e1031ae8610287b as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/namespace/3bb29733054d9ce0d655fb93665aa483/info/7f31b853b453410b9e1031ae8610287b 2023-08-27 18:01:50,967 INFO [Listener at localhost/33159] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/namespace/3bb29733054d9ce0d655fb93665aa483/info/7f31b853b453410b9e1031ae8610287b, entries=2, sequenceid=6, filesize=4.8 K 2023-08-27 18:01:50,968 INFO [Listener at localhost/33159] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3bb29733054d9ce0d655fb93665aa483 in 23ms, sequenceid=6, compaction requested=false 2023-08-27 18:01:50,968 DEBUG [Listener at localhost/33159] regionserver.HRegion(2446): Flush status journal for 3bb29733054d9ce0d655fb93665aa483: 2023-08-27 18:01:50,968 INFO [Listener at localhost/33159] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.26 KB heapSize=4.19 KB 2023-08-27 18:01:50,981 INFO [Listener at localhost/33159] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.26 KB at sequenceid=24 (bloomFilter=false), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/.tmp/info/e8103a92ab5a4ea7a3761758f4c71572 2023-08-27 18:01:50,986 DEBUG [Listener at localhost/33159] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/.tmp/info/e8103a92ab5a4ea7a3761758f4c71572 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/info/e8103a92ab5a4ea7a3761758f4c71572 2023-08-27 18:01:50,990 INFO [Listener at localhost/33159] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/info/e8103a92ab5a4ea7a3761758f4c71572, entries=16, sequenceid=24, filesize=7.0 K 2023-08-27 18:01:50,991 INFO [Listener at localhost/33159] regionserver.HRegion(2948): Finished flush of dataSize ~2.26 KB/2312, heapSize ~3.67 KB/3760, currentSize=0 B/0 for 1588230740 in 23ms, sequenceid=24, compaction requested=false 2023-08-27 18:01:50,991 DEBUG [Listener at localhost/33159] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-08-27 18:01:50,991 INFO [Listener at localhost/33159] regionserver.HRegion(2745): Flushing b5fad1490e85d434f2a7ec2fe86dcd51 1/1 column families, dataSize=5.13 KB heapSize=5.76 KB 2023-08-27 18:01:51,003 INFO [Listener at localhost/33159] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=5.13 KB at sequenceid=326 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/1356c7ee7c314dbe9a7d951c2936afe1 2023-08-27 18:01:51,009 DEBUG [Listener at localhost/33159] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/.tmp/info/1356c7ee7c314dbe9a7d951c2936afe1 as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/1356c7ee7c314dbe9a7d951c2936afe1 2023-08-27 18:01:51,014 INFO [Listener at localhost/33159] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/1356c7ee7c314dbe9a7d951c2936afe1, entries=5, sequenceid=326, filesize=9.9 K 2023-08-27 18:01:51,015 INFO [Listener at localhost/33159] regionserver.HRegion(2948): Finished flush of dataSize ~5.13 KB/5255, heapSize ~5.74 KB/5880, currentSize=0 B/0 for b5fad1490e85d434f2a7ec2fe86dcd51 in 24ms, sequenceid=326, compaction requested=false 2023-08-27 18:01:51,015 DEBUG [Listener at localhost/33159] regionserver.HRegion(2446): Flush status journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:51,030 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44295,DS-f874d94b-e39a-48bb-affd-31f5b5389f70,DISK] 2023-08-27 18:01:51,030 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42739,DS-b4e834c6-911c-4073-b606-b1bf97c30227,DISK] 2023-08-27 18:01:51,032 INFO [Listener at localhost/33159] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/WALs/jenkins-hbase4.apache.org,39339,1693159182679/jenkins-hbase4.apache.org%2C39339%2C1693159182679.1693159310918 with entries=4, filesize=1.22 KB; new WAL /user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/WALs/jenkins-hbase4.apache.org,39339,1693159182679/jenkins-hbase4.apache.org%2C39339%2C1693159182679.1693159311015 2023-08-27 18:01:51,032 DEBUG [Listener at localhost/33159] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44295,DS-f874d94b-e39a-48bb-affd-31f5b5389f70,DISK], DatanodeInfoWithStorage[127.0.0.1:42739,DS-b4e834c6-911c-4073-b606-b1bf97c30227,DISK]] 2023-08-27 18:01:51,032 DEBUG [Listener at localhost/33159] wal.AbstractFSWAL(716): hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/WALs/jenkins-hbase4.apache.org,39339,1693159182679/jenkins-hbase4.apache.org%2C39339%2C1693159182679.1693159310918 is not closed yet, will try archiving it next time 2023-08-27 18:01:51,032 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/WALs/jenkins-hbase4.apache.org,39339,1693159182679/jenkins-hbase4.apache.org%2C39339%2C1693159182679.1693159183051 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/oldWALs/jenkins-hbase4.apache.org%2C39339%2C1693159182679.1693159183051 2023-08-27 18:01:51,033 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [5,000] milli-secs(wait.for.ratio=[1]) 2023-08-27 18:01:51,035 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/WALs/jenkins-hbase4.apache.org,39339,1693159182679/jenkins-hbase4.apache.org%2C39339%2C1693159182679.1693159310918 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/oldWALs/jenkins-hbase4.apache.org%2C39339%2C1693159182679.1693159310918 2023-08-27 18:01:51,133 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-27 18:01:51,134 INFO [Listener at localhost/33159] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-27 18:01:51,134 DEBUG [Listener at localhost/33159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b4c200d to 127.0.0.1:50926 2023-08-27 18:01:51,134 DEBUG [Listener at localhost/33159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 18:01:51,134 DEBUG [Listener at localhost/33159] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-27 18:01:51,134 DEBUG [Listener at localhost/33159] util.JVMClusterUtil(257): Found active master hash=1357150549, stopped=false 2023-08-27 18:01:51,134 INFO [Listener at localhost/33159] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44803,1693159182634 2023-08-27 18:01:51,136 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-27 18:01:51,136 INFO [Listener at localhost/33159] procedure2.ProcedureExecutor(629): Stopping 2023-08-27 18:01:51,136 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 18:01:51,136 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:39339-0x1004ee608bf0001, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-27 18:01:51,136 DEBUG [Listener at localhost/33159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a4bf7eb to 127.0.0.1:50926 2023-08-27 18:01:51,137 DEBUG [Listener at localhost/33159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 18:01:51,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 18:01:51,137 INFO [Listener at localhost/33159] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39339,1693159182679' ***** 2023-08-27 18:01:51,137 INFO [Listener at localhost/33159] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-27 18:01:51,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39339-0x1004ee608bf0001, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 18:01:51,137 INFO [RS:0;jenkins-hbase4:39339] regionserver.HeapMemoryManager(220): Stopping 2023-08-27 18:01:51,137 INFO [RS:0;jenkins-hbase4:39339] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-27 18:01:51,137 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-27 18:01:51,137 INFO [RS:0;jenkins-hbase4:39339] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-27 18:01:51,137 INFO [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(3305): Received CLOSE for 21f5c7d650d644e803d714d5e3384c08 2023-08-27 18:01:51,137 INFO [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(3305): Received CLOSE for 3bb29733054d9ce0d655fb93665aa483 2023-08-27 18:01:51,138 INFO [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(3305): Received CLOSE for b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:01:51,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 21f5c7d650d644e803d714d5e3384c08, disabling compactions & flushes 2023-08-27 18:01:51,138 INFO [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:01:51,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08. 2023-08-27 18:01:51,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08. 2023-08-27 18:01:51,138 DEBUG [RS:0;jenkins-hbase4:39339] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c9dd76b to 127.0.0.1:50926 2023-08-27 18:01:51,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08. after waiting 0 ms 2023-08-27 18:01:51,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08. 2023-08-27 18:01:51,138 DEBUG [RS:0;jenkins-hbase4:39339] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 18:01:51,139 INFO [RS:0;jenkins-hbase4:39339] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-27 18:01:51,139 INFO [RS:0;jenkins-hbase4:39339] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-27 18:01:51,139 INFO [RS:0;jenkins-hbase4:39339] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-27 18:01:51,139 INFO [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-27 18:01:51,139 INFO [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(1474): Waiting on 4 regions to close 2023-08-27 18:01:51,139 DEBUG [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(1478): Online Regions={21f5c7d650d644e803d714d5e3384c08=TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08., 3bb29733054d9ce0d655fb93665aa483=hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483., 1588230740=hbase:meta,,1.1588230740, b5fad1490e85d434f2a7ec2fe86dcd51=TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51.} 2023-08-27 18:01:51,139 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-27 18:01:51,139 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-27 18:01:51,139 DEBUG [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(1504): Waiting on 1588230740, 21f5c7d650d644e803d714d5e3384c08, 3bb29733054d9ce0d655fb93665aa483, b5fad1490e85d434f2a7ec2fe86dcd51 2023-08-27 18:01:51,139 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-27 18:01:51,140 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-27 18:01:51,140 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-27 18:01:51,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/21f5c7d650d644e803d714d5e3384c08/recovered.edits/118.seqid, newMaxSeqId=118, maxSeqId=113 2023-08-27 18:01:51,147 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/meta/1588230740/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-08-27 18:01:51,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08. 2023-08-27 18:01:51,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 21f5c7d650d644e803d714d5e3384c08: 2023-08-27 18:01:51,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,,1693159218095.21f5c7d650d644e803d714d5e3384c08. 2023-08-27 18:01:51,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3bb29733054d9ce0d655fb93665aa483, disabling compactions & flushes 2023-08-27 18:01:51,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483. 2023-08-27 18:01:51,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483. 2023-08-27 18:01:51,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483. after waiting 0 ms 2023-08-27 18:01:51,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483. 2023-08-27 18:01:51,148 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-27 18:01:51,148 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-27 18:01:51,148 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-27 18:01:51,148 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-27 18:01:51,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/hbase/namespace/3bb29733054d9ce0d655fb93665aa483/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-27 18:01:51,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483. 2023-08-27 18:01:51,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3bb29733054d9ce0d655fb93665aa483: 2023-08-27 18:01:51,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1693159183249.3bb29733054d9ce0d655fb93665aa483. 2023-08-27 18:01:51,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b5fad1490e85d434f2a7ec2fe86dcd51, disabling compactions & flushes 2023-08-27 18:01:51,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:01:51,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:01:51,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. after waiting 0 ms 2023-08-27 18:01:51,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:01:51,152 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/94c15f44a5674c038dfdef610ed7978a, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/bd156fcce0994109b6904b017720e7a8, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/9e7b69d023e84b5ab5ebf4dc0bdce8a8] to archive 2023-08-27 18:01:51,153 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-27 18:01:51,155 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/94c15f44a5674c038dfdef610ed7978a to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/94c15f44a5674c038dfdef610ed7978a 2023-08-27 18:01:51,156 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/bd156fcce0994109b6904b017720e7a8 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/bd156fcce0994109b6904b017720e7a8 2023-08-27 18:01:51,157 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/9e7b69d023e84b5ab5ebf4dc0bdce8a8 to hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/archive/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/info/9e7b69d023e84b5ab5ebf4dc0bdce8a8 2023-08-27 18:01:51,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/data/default/TestLogRolling-testLogRolling/b5fad1490e85d434f2a7ec2fe86dcd51/recovered.edits/329.seqid, newMaxSeqId=329, maxSeqId=113 2023-08-27 18:01:51,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:01:51,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b5fad1490e85d434f2a7ec2fe86dcd51: 2023-08-27 18:01:51,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,row0064,1693159218095.b5fad1490e85d434f2a7ec2fe86dcd51. 2023-08-27 18:01:51,340 INFO [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39339,1693159182679; all regions closed. 2023-08-27 18:01:51,346 DEBUG [RS:0;jenkins-hbase4:39339] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/oldWALs 2023-08-27 18:01:51,346 INFO [RS:0;jenkins-hbase4:39339] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39339%2C1693159182679.meta:.meta(num 1693159183191) 2023-08-27 18:01:51,350 DEBUG [RS:0;jenkins-hbase4:39339] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/oldWALs 2023-08-27 18:01:51,350 INFO [RS:0;jenkins-hbase4:39339] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39339%2C1693159182679:(num 1693159311015) 2023-08-27 18:01:51,350 DEBUG [RS:0;jenkins-hbase4:39339] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 18:01:51,350 INFO [RS:0;jenkins-hbase4:39339] regionserver.LeaseManager(133): Closed leases 2023-08-27 18:01:51,351 INFO [RS:0;jenkins-hbase4:39339] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-08-27 18:01:51,351 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-27 18:01:51,352 INFO [RS:0;jenkins-hbase4:39339] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39339 2023-08-27 18:01:51,357 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-27 18:01:51,357 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:39339-0x1004ee608bf0001, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39339,1693159182679 2023-08-27 18:01:51,357 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:39339-0x1004ee608bf0001, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-27 18:01:51,359 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39339,1693159182679] 2023-08-27 18:01:51,359 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39339,1693159182679; numProcessing=1 2023-08-27 18:01:51,360 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39339,1693159182679 already deleted, retry=false 2023-08-27 18:01:51,360 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39339,1693159182679 expired; onlineServers=0 2023-08-27 18:01:51,360 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44803,1693159182634' ***** 2023-08-27 18:01:51,360 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-27 18:01:51,360 DEBUG [M:0;jenkins-hbase4:44803] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54dbe791, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-27 18:01:51,360 INFO [M:0;jenkins-hbase4:44803] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44803,1693159182634 2023-08-27 18:01:51,360 INFO [M:0;jenkins-hbase4:44803] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44803,1693159182634; all regions closed. 2023-08-27 18:01:51,360 DEBUG [M:0;jenkins-hbase4:44803] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 18:01:51,361 DEBUG [M:0;jenkins-hbase4:44803] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-27 18:01:51,361 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-27 18:01:51,361 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1693159182836] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1693159182836,5,FailOnTimeoutGroup] 2023-08-27 18:01:51,361 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1693159182836] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1693159182836,5,FailOnTimeoutGroup] 2023-08-27 18:01:51,361 DEBUG [M:0;jenkins-hbase4:44803] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-27 18:01:51,361 INFO [M:0;jenkins-hbase4:44803] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-27 18:01:51,361 INFO [M:0;jenkins-hbase4:44803] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-27 18:01:51,362 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-27 18:01:51,362 INFO [M:0;jenkins-hbase4:44803] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-27 18:01:51,362 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 18:01:51,362 DEBUG [M:0;jenkins-hbase4:44803] master.HMaster(1512): Stopping service threads 2023-08-27 18:01:51,362 INFO [M:0;jenkins-hbase4:44803] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-27 18:01:51,362 ERROR [M:0;jenkins-hbase4:44803] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-08-27 18:01:51,362 INFO [M:0;jenkins-hbase4:44803] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-27 18:01:51,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-27 18:01:51,362 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-27 18:01:51,363 DEBUG [M:0;jenkins-hbase4:44803] zookeeper.ZKUtil(398): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-27 18:01:51,363 WARN [M:0;jenkins-hbase4:44803] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-27 18:01:51,363 INFO [M:0;jenkins-hbase4:44803] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-27 18:01:51,363 INFO [M:0;jenkins-hbase4:44803] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-27 18:01:51,363 DEBUG [M:0;jenkins-hbase4:44803] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-27 18:01:51,363 INFO [M:0;jenkins-hbase4:44803] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 18:01:51,363 DEBUG [M:0;jenkins-hbase4:44803] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 18:01:51,363 DEBUG [M:0;jenkins-hbase4:44803] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-27 18:01:51,363 DEBUG [M:0;jenkins-hbase4:44803] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 18:01:51,363 INFO [M:0;jenkins-hbase4:44803] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=64.70 KB heapSize=78.42 KB 2023-08-27 18:01:51,374 INFO [M:0;jenkins-hbase4:44803] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=64.70 KB at sequenceid=160 (bloomFilter=true), to=hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b66bd380081e41c2b800a2920c01cd2c 2023-08-27 18:01:51,379 INFO [M:0;jenkins-hbase4:44803] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b66bd380081e41c2b800a2920c01cd2c 2023-08-27 18:01:51,380 DEBUG [M:0;jenkins-hbase4:44803] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b66bd380081e41c2b800a2920c01cd2c as hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b66bd380081e41c2b800a2920c01cd2c 2023-08-27 18:01:51,384 INFO [M:0;jenkins-hbase4:44803] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b66bd380081e41c2b800a2920c01cd2c 2023-08-27 18:01:51,384 INFO [M:0;jenkins-hbase4:44803] regionserver.HStore(1080): Added hdfs://localhost:37383/user/jenkins/test-data/7aaf1f03-09d0-62ca-9834-5a3910fc73bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b66bd380081e41c2b800a2920c01cd2c, entries=18, sequenceid=160, filesize=6.9 K 2023-08-27 18:01:51,384 INFO [M:0;jenkins-hbase4:44803] regionserver.HRegion(2948): Finished flush of dataSize ~64.70 KB/66256, heapSize ~78.41 KB/80288, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=160, compaction requested=false 2023-08-27 18:01:51,385 INFO [M:0;jenkins-hbase4:44803] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 18:01:51,386 DEBUG [M:0;jenkins-hbase4:44803] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-27 18:01:51,388 INFO [M:0;jenkins-hbase4:44803] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-27 18:01:51,388 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-27 18:01:51,389 INFO [M:0;jenkins-hbase4:44803] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44803 2023-08-27 18:01:51,391 DEBUG [M:0;jenkins-hbase4:44803] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44803,1693159182634 already deleted, retry=false 2023-08-27 18:01:51,459 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:39339-0x1004ee608bf0001, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 18:01:51,459 INFO [RS:0;jenkins-hbase4:39339] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39339,1693159182679; zookeeper connection closed. 2023-08-27 18:01:51,459 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:39339-0x1004ee608bf0001, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 18:01:51,460 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@cd253fd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@cd253fd 2023-08-27 18:01:51,460 INFO [Listener at localhost/33159] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-27 18:01:51,559 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 18:01:51,559 INFO [M:0;jenkins-hbase4:44803] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44803,1693159182634; zookeeper connection closed. 2023-08-27 18:01:51,559 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:44803-0x1004ee608bf0000, quorum=127.0.0.1:50926, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 18:01:51,560 WARN [Listener at localhost/33159] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-27 18:01:51,564 INFO [Listener at localhost/33159] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 18:01:51,601 WARN [BP-49696862-172.31.14.131-1693159182092 heartbeating to localhost/127.0.0.1:37383] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-49696862-172.31.14.131-1693159182092 (Datanode Uuid 0058aa27-60ac-4e72-90b3-cdffdf0cd975) service to localhost/127.0.0.1:37383 2023-08-27 18:01:51,602 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/cluster_71edce76-d079-d53e-64fa-f0e653260f2f/dfs/data/data3/current/BP-49696862-172.31.14.131-1693159182092] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 18:01:51,602 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/cluster_71edce76-d079-d53e-64fa-f0e653260f2f/dfs/data/data4/current/BP-49696862-172.31.14.131-1693159182092] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 18:01:51,671 WARN [Listener at localhost/33159] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-27 18:01:51,674 INFO [Listener at localhost/33159] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 18:01:51,779 WARN [BP-49696862-172.31.14.131-1693159182092 heartbeating to localhost/127.0.0.1:37383] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-27 18:01:51,779 WARN [BP-49696862-172.31.14.131-1693159182092 heartbeating to localhost/127.0.0.1:37383] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-49696862-172.31.14.131-1693159182092 (Datanode Uuid 04fb033d-22df-4c97-8512-3cfe873b0e22) service to localhost/127.0.0.1:37383 2023-08-27 18:01:51,780 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/cluster_71edce76-d079-d53e-64fa-f0e653260f2f/dfs/data/data1/current/BP-49696862-172.31.14.131-1693159182092] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 18:01:51,780 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/cluster_71edce76-d079-d53e-64fa-f0e653260f2f/dfs/data/data2/current/BP-49696862-172.31.14.131-1693159182092] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 18:01:51,792 INFO [Listener at localhost/33159] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 18:01:51,908 INFO [Listener at localhost/33159] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-27 18:01:51,939 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-27 18:01:51,949 INFO [Listener at localhost/33159] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=76 (was 65) - Thread LEAK? -, OpenFileDescriptor=464 (was 438) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=25 (was 157), ProcessCount=167 (was 166) - ProcessCount LEAK? -, AvailableMemoryMB=12138 (was 12300) 2023-08-27 18:01:51,957 INFO [Listener at localhost/33159] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=77, OpenFileDescriptor=464, MaxFileDescriptor=60000, SystemLoadAverage=25, ProcessCount=167, AvailableMemoryMB=12138 2023-08-27 18:01:51,957 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-27 18:01:51,957 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/hadoop.log.dir so I do NOT create it in target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c 2023-08-27 18:01:51,957 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b60f00a-f03f-16e1-b918-062ca007c5b2/hadoop.tmp.dir so I do NOT create it in target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c 2023-08-27 18:01:51,957 INFO [Listener at localhost/33159] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/cluster_d0e7d414-a1a1-a983-3477-2a1fb6f74cb0, deleteOnExit=true 2023-08-27 18:01:51,957 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-27 18:01:51,957 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/test.cache.data in system properties and HBase conf 2023-08-27 18:01:51,957 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/hadoop.tmp.dir in system properties and HBase conf 2023-08-27 18:01:51,957 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/hadoop.log.dir in system properties and HBase conf 2023-08-27 18:01:51,958 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-27 18:01:51,958 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-27 18:01:51,958 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-27 18:01:51,958 DEBUG [Listener at localhost/33159] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-27 18:01:51,958 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-27 18:01:51,958 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-27 18:01:51,958 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-27 18:01:51,958 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-27 18:01:51,958 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-27 18:01:51,959 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-27 18:01:51,959 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-27 18:01:51,959 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-27 18:01:51,959 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-27 18:01:51,959 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/nfs.dump.dir in system properties and HBase conf 2023-08-27 18:01:51,959 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/java.io.tmpdir in system properties and HBase conf 2023-08-27 18:01:51,959 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-27 18:01:51,959 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-27 18:01:51,959 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-27 18:01:51,963 WARN [Listener at localhost/33159] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-27 18:01:51,963 WARN [Listener at localhost/33159] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-27 18:01:52,004 WARN [Listener at localhost/33159] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 18:01:52,006 INFO [Listener at localhost/33159] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 18:01:52,010 INFO [Listener at localhost/33159] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/java.io.tmpdir/Jetty_localhost_40337_hdfs____kj1w91/webapp 2023-08-27 18:01:52,102 INFO [Listener at localhost/33159] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40337 2023-08-27 18:01:52,106 WARN [Listener at localhost/33159] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-27 18:01:52,106 WARN [Listener at localhost/33159] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-27 18:01:52,149 WARN [Listener at localhost/39741] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 18:01:52,159 WARN [Listener at localhost/39741] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-27 18:01:52,162 WARN [Listener at localhost/39741] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 18:01:52,163 INFO [Listener at localhost/39741] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 18:01:52,168 INFO [Listener at localhost/39741] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/java.io.tmpdir/Jetty_localhost_44949_datanode____.ff5xjv/webapp 2023-08-27 18:01:52,260 INFO [Listener at localhost/39741] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44949 2023-08-27 18:01:52,269 WARN [Listener at localhost/38387] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 18:01:52,281 WARN [Listener at localhost/38387] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-27 18:01:52,283 WARN [Listener at localhost/38387] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-27 18:01:52,285 INFO [Listener at localhost/38387] log.Slf4jLog(67): jetty-6.1.26 2023-08-27 18:01:52,288 INFO [Listener at localhost/38387] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/java.io.tmpdir/Jetty_localhost_43319_datanode____aknx5v/webapp 2023-08-27 18:01:52,362 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4210593cadfb4682: Processing first storage report for DS-9d8ac979-936a-4070-a080-eabeb9631f73 from datanode c6b70f11-3b58-4022-98ae-420887dd8732 2023-08-27 18:01:52,362 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4210593cadfb4682: from storage DS-9d8ac979-936a-4070-a080-eabeb9631f73 node DatanodeRegistration(127.0.0.1:43633, datanodeUuid=c6b70f11-3b58-4022-98ae-420887dd8732, infoPort=43623, infoSecurePort=0, ipcPort=38387, storageInfo=lv=-57;cid=testClusterID;nsid=1213658418;c=1693159311966), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 18:01:52,362 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4210593cadfb4682: Processing first storage report for DS-d36a37be-22a8-4f2d-b59e-40e240b894d2 from datanode c6b70f11-3b58-4022-98ae-420887dd8732 2023-08-27 18:01:52,362 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4210593cadfb4682: from storage DS-d36a37be-22a8-4f2d-b59e-40e240b894d2 node DatanodeRegistration(127.0.0.1:43633, datanodeUuid=c6b70f11-3b58-4022-98ae-420887dd8732, infoPort=43623, infoSecurePort=0, ipcPort=38387, storageInfo=lv=-57;cid=testClusterID;nsid=1213658418;c=1693159311966), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 18:01:52,386 INFO [Listener at localhost/38387] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43319 2023-08-27 18:01:52,394 WARN [Listener at localhost/34937] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-27 18:01:52,484 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa81a7537fa314b11: Processing first storage report for DS-c6569555-83d6-4a97-aaed-2d8878da46ed from datanode 4792bd64-f509-4c96-8de3-9bda0bcf730e 2023-08-27 18:01:52,484 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa81a7537fa314b11: from storage DS-c6569555-83d6-4a97-aaed-2d8878da46ed node DatanodeRegistration(127.0.0.1:32933, datanodeUuid=4792bd64-f509-4c96-8de3-9bda0bcf730e, infoPort=43757, infoSecurePort=0, ipcPort=34937, storageInfo=lv=-57;cid=testClusterID;nsid=1213658418;c=1693159311966), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-27 18:01:52,484 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa81a7537fa314b11: Processing first storage report for DS-508a7cf5-41f3-46e3-8c9d-a34748937bd4 from datanode 4792bd64-f509-4c96-8de3-9bda0bcf730e 2023-08-27 18:01:52,484 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa81a7537fa314b11: from storage DS-508a7cf5-41f3-46e3-8c9d-a34748937bd4 node DatanodeRegistration(127.0.0.1:32933, datanodeUuid=4792bd64-f509-4c96-8de3-9bda0bcf730e, infoPort=43757, infoSecurePort=0, ipcPort=34937, storageInfo=lv=-57;cid=testClusterID;nsid=1213658418;c=1693159311966), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-27 18:01:52,502 DEBUG [Listener at localhost/34937] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c 2023-08-27 18:01:52,504 INFO [Listener at localhost/34937] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/cluster_d0e7d414-a1a1-a983-3477-2a1fb6f74cb0/zookeeper_0, clientPort=49800, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/cluster_d0e7d414-a1a1-a983-3477-2a1fb6f74cb0/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/cluster_d0e7d414-a1a1-a983-3477-2a1fb6f74cb0/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-27 18:01:52,505 INFO [Listener at localhost/34937] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49800 2023-08-27 18:01:52,505 INFO [Listener at localhost/34937] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 18:01:52,506 INFO [Listener at localhost/34937] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 18:01:52,518 INFO [Listener at localhost/34937] util.FSUtils(471): Created version file at hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2 with version=8 2023-08-27 18:01:52,519 INFO [Listener at localhost/34937] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:33667/user/jenkins/test-data/c9c1f95e-c2d2-9975-7f99-738442675f8d/hbase-staging 2023-08-27 18:01:52,520 INFO [Listener at localhost/34937] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-27 18:01:52,520 INFO [Listener at localhost/34937] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 18:01:52,521 INFO [Listener at localhost/34937] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-27 18:01:52,521 INFO [Listener at localhost/34937] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-27 18:01:52,521 INFO [Listener at localhost/34937] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 18:01:52,521 INFO [Listener at localhost/34937] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-27 18:01:52,521 INFO [Listener at localhost/34937] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-27 18:01:52,522 INFO [Listener at localhost/34937] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40283 2023-08-27 18:01:52,523 INFO [Listener at localhost/34937] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 18:01:52,523 INFO [Listener at localhost/34937] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 18:01:52,524 INFO [Listener at localhost/34937] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40283 connecting to ZooKeeper ensemble=127.0.0.1:49800 2023-08-27 18:01:52,531 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:402830x0, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-27 18:01:52,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40283-0x1004ee8041e0000 connected 2023-08-27 18:01:52,544 DEBUG [Listener at localhost/34937] zookeeper.ZKUtil(164): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-27 18:01:52,545 DEBUG [Listener at localhost/34937] zookeeper.ZKUtil(164): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 18:01:52,545 DEBUG [Listener at localhost/34937] zookeeper.ZKUtil(164): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-27 18:01:52,546 DEBUG [Listener at localhost/34937] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40283 2023-08-27 18:01:52,546 DEBUG [Listener at localhost/34937] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40283 2023-08-27 18:01:52,546 DEBUG [Listener at localhost/34937] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40283 2023-08-27 18:01:52,546 DEBUG [Listener at localhost/34937] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40283 2023-08-27 18:01:52,546 DEBUG [Listener at localhost/34937] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40283 2023-08-27 18:01:52,547 INFO [Listener at localhost/34937] master.HMaster(444): hbase.rootdir=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2, hbase.cluster.distributed=false 2023-08-27 18:01:52,559 INFO [Listener at localhost/34937] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-27 18:01:52,559 INFO [Listener at localhost/34937] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 18:01:52,559 INFO [Listener at localhost/34937] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-27 18:01:52,560 INFO [Listener at localhost/34937] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-27 18:01:52,560 INFO [Listener at localhost/34937] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-27 18:01:52,560 INFO [Listener at localhost/34937] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-27 18:01:52,560 INFO [Listener at localhost/34937] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-27 18:01:52,562 INFO [Listener at localhost/34937] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44315 2023-08-27 18:01:52,562 INFO [Listener at localhost/34937] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-27 18:01:52,563 DEBUG [Listener at localhost/34937] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-27 18:01:52,563 INFO [Listener at localhost/34937] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 18:01:52,564 INFO [Listener at localhost/34937] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 18:01:52,565 INFO [Listener at localhost/34937] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44315 connecting to ZooKeeper ensemble=127.0.0.1:49800 2023-08-27 18:01:52,568 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): regionserver:443150x0, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-27 18:01:52,569 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44315-0x1004ee8041e0001 connected 2023-08-27 18:01:52,569 DEBUG [Listener at localhost/34937] zookeeper.ZKUtil(164): regionserver:44315-0x1004ee8041e0001, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-27 18:01:52,570 DEBUG [Listener at localhost/34937] zookeeper.ZKUtil(164): regionserver:44315-0x1004ee8041e0001, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 18:01:52,571 DEBUG [Listener at localhost/34937] zookeeper.ZKUtil(164): regionserver:44315-0x1004ee8041e0001, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-27 18:01:52,571 DEBUG [Listener at localhost/34937] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44315 2023-08-27 18:01:52,571 DEBUG [Listener at localhost/34937] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44315 2023-08-27 18:01:52,571 DEBUG [Listener at localhost/34937] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44315 2023-08-27 18:01:52,572 DEBUG [Listener at localhost/34937] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44315 2023-08-27 18:01:52,572 DEBUG [Listener at localhost/34937] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44315 2023-08-27 18:01:52,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40283,1693159312520 2023-08-27 18:01:52,577 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-27 18:01:52,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40283,1693159312520 2023-08-27 18:01:52,579 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-27 18:01:52,579 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x1004ee8041e0001, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-27 18:01:52,579 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 18:01:52,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-27 18:01:52,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40283,1693159312520 from backup master directory 2023-08-27 18:01:52,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-27 18:01:52,581 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40283,1693159312520 2023-08-27 18:01:52,581 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-27 18:01:52,581 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-27 18:01:52,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40283,1693159312520 2023-08-27 18:01:52,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/hbase.id with ID: 5f87899b-06c5-48f9-9e74-b277058027cb 2023-08-27 18:01:52,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 18:01:52,607 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 18:01:52,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x32eb974c to 127.0.0.1:49800 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-27 18:01:52,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@392259cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-27 18:01:52,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-27 18:01:52,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-27 18:01:52,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-27 18:01:52,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/MasterData/data/master/store-tmp 2023-08-27 18:01:52,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 18:01:52,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-27 18:01:52,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 18:01:52,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 18:01:52,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-27 18:01:52,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 18:01:52,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 18:01:52,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-27 18:01:52,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/MasterData/WALs/jenkins-hbase4.apache.org,40283,1693159312520 2023-08-27 18:01:52,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40283%2C1693159312520, suffix=, logDir=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/MasterData/WALs/jenkins-hbase4.apache.org,40283,1693159312520, archiveDir=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/MasterData/oldWALs, maxLogs=10 2023-08-27 18:01:52,647 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32933,DS-c6569555-83d6-4a97-aaed-2d8878da46ed,DISK] 2023-08-27 18:01:52,648 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43633,DS-9d8ac979-936a-4070-a080-eabeb9631f73,DISK] 2023-08-27 18:01:52,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/MasterData/WALs/jenkins-hbase4.apache.org,40283,1693159312520/jenkins-hbase4.apache.org%2C40283%2C1693159312520.1693159312633 2023-08-27 18:01:52,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32933,DS-c6569555-83d6-4a97-aaed-2d8878da46ed,DISK], DatanodeInfoWithStorage[127.0.0.1:43633,DS-9d8ac979-936a-4070-a080-eabeb9631f73,DISK]] 2023-08-27 18:01:52,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-27 18:01:52,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 18:01:52,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-27 18:01:52,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-27 18:01:52,652 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-27 18:01:52,653 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-27 18:01:52,653 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-27 18:01:52,654 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 18:01:52,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-27 18:01:52,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-27 18:01:52,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-27 18:01:52,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-27 18:01:52,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=729434, jitterRate=-0.07247723639011383}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-27 18:01:52,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-27 18:01:52,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-27 18:01:52,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-27 18:01:52,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-27 18:01:52,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-27 18:01:52,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-27 18:01:52,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-27 18:01:52,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-27 18:01:52,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-27 18:01:52,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-27 18:01:52,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-27 18:01:52,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-27 18:01:52,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-27 18:01:52,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-27 18:01:52,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-27 18:01:52,675 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 18:01:52,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-27 18:01:52,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-27 18:01:52,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-27 18:01:52,678 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-27 18:01:52,678 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x1004ee8041e0001, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-27 18:01:52,678 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 18:01:52,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40283,1693159312520, sessionid=0x1004ee8041e0000, setting cluster-up flag (Was=false) 2023-08-27 18:01:52,683 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 18:01:52,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-27 18:01:52,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40283,1693159312520 2023-08-27 18:01:52,691 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 18:01:52,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-27 18:01:52,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40283,1693159312520 2023-08-27 18:01:52,697 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/.hbase-snapshot/.tmp 2023-08-27 18:01:52,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-27 18:01:52,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 18:01:52,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 18:01:52,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 18:01:52,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-27 18:01:52,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-27 18:01:52,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 18:01:52,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-27 18:01:52,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 18:01:52,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1693159342700 2023-08-27 18:01:52,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-27 18:01:52,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-27 18:01:52,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-27 18:01:52,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-27 18:01:52,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-27 18:01:52,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-27 18:01:52,700 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-27 18:01:52,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-27 18:01:52,701 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-27 18:01:52,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-27 18:01:52,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-27 18:01:52,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-27 18:01:52,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-27 18:01:52,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-27 18:01:52,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1693159312702,5,FailOnTimeoutGroup] 2023-08-27 18:01:52,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1693159312702,5,FailOnTimeoutGroup] 2023-08-27 18:01:52,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-27 18:01:52,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-27 18:01:52,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-27 18:01:52,702 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-27 18:01:52,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-27 18:01:52,711 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-27 18:01:52,711 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-27 18:01:52,711 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2 2023-08-27 18:01:52,718 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 18:01:52,719 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-27 18:01:52,721 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/info 2023-08-27 18:01:52,721 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-27 18:01:52,722 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 18:01:52,722 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-27 18:01:52,723 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/rep_barrier 2023-08-27 18:01:52,723 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-27 18:01:52,724 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 18:01:52,724 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-27 18:01:52,725 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/table 2023-08-27 18:01:52,725 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-27 18:01:52,725 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 18:01:52,726 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740 2023-08-27 18:01:52,727 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740 2023-08-27 18:01:52,729 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-27 18:01:52,730 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-27 18:01:52,732 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-27 18:01:52,732 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=868175, jitterRate=0.1039418876171112}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-27 18:01:52,732 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-27 18:01:52,732 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-27 18:01:52,732 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-27 18:01:52,732 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-27 18:01:52,732 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-27 18:01:52,732 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-27 18:01:52,733 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-27 18:01:52,733 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-27 18:01:52,733 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-27 18:01:52,733 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-27 18:01:52,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-27 18:01:52,735 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-27 18:01:52,736 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-27 18:01:52,774 INFO [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(951): ClusterId : 5f87899b-06c5-48f9-9e74-b277058027cb 2023-08-27 18:01:52,775 DEBUG [RS:0;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-27 18:01:52,777 DEBUG [RS:0;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-27 18:01:52,777 DEBUG [RS:0;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-27 18:01:52,779 DEBUG [RS:0;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-27 18:01:52,779 DEBUG [RS:0;jenkins-hbase4:44315] zookeeper.ReadOnlyZKClient(139): Connect 0x58fdc35e to 127.0.0.1:49800 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-27 18:01:52,783 DEBUG [RS:0;jenkins-hbase4:44315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@563a3631, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-27 18:01:52,783 DEBUG [RS:0;jenkins-hbase4:44315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5205a82e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-27 18:01:52,791 DEBUG [RS:0;jenkins-hbase4:44315] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44315 2023-08-27 18:01:52,791 INFO [RS:0;jenkins-hbase4:44315] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-27 18:01:52,791 INFO [RS:0;jenkins-hbase4:44315] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-27 18:01:52,791 DEBUG [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(1022): About to register with Master. 2023-08-27 18:01:52,792 INFO [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40283,1693159312520 with isa=jenkins-hbase4.apache.org/172.31.14.131:44315, startcode=1693159312559 2023-08-27 18:01:52,792 DEBUG [RS:0;jenkins-hbase4:44315] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-27 18:01:52,794 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51951, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-08-27 18:01:52,795 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40283] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44315,1693159312559 2023-08-27 18:01:52,795 DEBUG [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2 2023-08-27 18:01:52,795 DEBUG [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39741 2023-08-27 18:01:52,795 DEBUG [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-27 18:01:52,801 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-27 18:01:52,802 DEBUG [RS:0;jenkins-hbase4:44315] zookeeper.ZKUtil(162): regionserver:44315-0x1004ee8041e0001, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44315,1693159312559 2023-08-27 18:01:52,802 WARN [RS:0;jenkins-hbase4:44315] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-27 18:01:52,802 INFO [RS:0;jenkins-hbase4:44315] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-27 18:01:52,802 DEBUG [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/WALs/jenkins-hbase4.apache.org,44315,1693159312559 2023-08-27 18:01:52,802 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44315,1693159312559] 2023-08-27 18:01:52,808 DEBUG [RS:0;jenkins-hbase4:44315] zookeeper.ZKUtil(162): regionserver:44315-0x1004ee8041e0001, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44315,1693159312559 2023-08-27 18:01:52,809 DEBUG [RS:0;jenkins-hbase4:44315] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-27 18:01:52,809 INFO [RS:0;jenkins-hbase4:44315] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-27 18:01:52,811 INFO [RS:0;jenkins-hbase4:44315] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-27 18:01:52,811 INFO [RS:0;jenkins-hbase4:44315] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-27 18:01:52,811 INFO [RS:0;jenkins-hbase4:44315] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-27 18:01:52,811 INFO [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-27 18:01:52,813 INFO [RS:0;jenkins-hbase4:44315] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-27 18:01:52,813 DEBUG [RS:0;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 18:01:52,813 DEBUG [RS:0;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 18:01:52,813 DEBUG [RS:0;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 18:01:52,813 DEBUG [RS:0;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 18:01:52,813 DEBUG [RS:0;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 18:01:52,813 DEBUG [RS:0;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-27 18:01:52,813 DEBUG [RS:0;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 18:01:52,813 DEBUG [RS:0;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 18:01:52,813 DEBUG [RS:0;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 18:01:52,813 DEBUG [RS:0;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-27 18:01:52,814 INFO [RS:0;jenkins-hbase4:44315] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-27 18:01:52,814 INFO [RS:0;jenkins-hbase4:44315] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-27 18:01:52,814 INFO [RS:0;jenkins-hbase4:44315] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-27 18:01:52,825 INFO [RS:0;jenkins-hbase4:44315] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-27 18:01:52,825 INFO [RS:0;jenkins-hbase4:44315] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44315,1693159312559-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-27 18:01:52,835 INFO [RS:0;jenkins-hbase4:44315] regionserver.Replication(203): jenkins-hbase4.apache.org,44315,1693159312559 started 2023-08-27 18:01:52,835 INFO [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44315,1693159312559, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44315, sessionid=0x1004ee8041e0001 2023-08-27 18:01:52,835 DEBUG [RS:0;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-27 18:01:52,835 DEBUG [RS:0;jenkins-hbase4:44315] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44315,1693159312559 2023-08-27 18:01:52,835 DEBUG [RS:0;jenkins-hbase4:44315] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44315,1693159312559' 2023-08-27 18:01:52,836 DEBUG [RS:0;jenkins-hbase4:44315] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-27 18:01:52,836 DEBUG [RS:0;jenkins-hbase4:44315] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-27 18:01:52,836 DEBUG [RS:0;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-27 18:01:52,836 DEBUG [RS:0;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-27 18:01:52,836 DEBUG [RS:0;jenkins-hbase4:44315] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44315,1693159312559 2023-08-27 18:01:52,836 DEBUG [RS:0;jenkins-hbase4:44315] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44315,1693159312559' 2023-08-27 18:01:52,836 DEBUG [RS:0;jenkins-hbase4:44315] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-27 18:01:52,837 DEBUG [RS:0;jenkins-hbase4:44315] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-27 18:01:52,837 DEBUG [RS:0;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-27 18:01:52,837 INFO [RS:0;jenkins-hbase4:44315] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-27 18:01:52,837 INFO [RS:0;jenkins-hbase4:44315] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-27 18:01:52,886 DEBUG [jenkins-hbase4:40283] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-27 18:01:52,887 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44315,1693159312559, state=OPENING 2023-08-27 18:01:52,888 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-27 18:01:52,889 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 18:01:52,889 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-27 18:01:52,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44315,1693159312559}] 2023-08-27 18:01:52,931 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-27 18:01:52,939 INFO [RS:0;jenkins-hbase4:44315] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44315%2C1693159312559, suffix=, logDir=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/WALs/jenkins-hbase4.apache.org,44315,1693159312559, archiveDir=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/oldWALs, maxLogs=32 2023-08-27 18:01:52,955 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43633,DS-9d8ac979-936a-4070-a080-eabeb9631f73,DISK] 2023-08-27 18:01:52,955 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32933,DS-c6569555-83d6-4a97-aaed-2d8878da46ed,DISK] 2023-08-27 18:01:52,958 INFO [RS:0;jenkins-hbase4:44315] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/WALs/jenkins-hbase4.apache.org,44315,1693159312559/jenkins-hbase4.apache.org%2C44315%2C1693159312559.1693159312939 2023-08-27 18:01:52,958 DEBUG [RS:0;jenkins-hbase4:44315] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43633,DS-9d8ac979-936a-4070-a080-eabeb9631f73,DISK], DatanodeInfoWithStorage[127.0.0.1:32933,DS-c6569555-83d6-4a97-aaed-2d8878da46ed,DISK]] 2023-08-27 18:01:53,043 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44315,1693159312559 2023-08-27 18:01:53,043 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-27 18:01:53,045 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-27 18:01:53,049 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-27 18:01:53,049 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-27 18:01:53,051 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44315%2C1693159312559.meta, suffix=.meta, logDir=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/WALs/jenkins-hbase4.apache.org,44315,1693159312559, archiveDir=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/oldWALs, maxLogs=32 2023-08-27 18:01:53,071 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43633,DS-9d8ac979-936a-4070-a080-eabeb9631f73,DISK] 2023-08-27 18:01:53,072 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32933,DS-c6569555-83d6-4a97-aaed-2d8878da46ed,DISK] 2023-08-27 18:01:53,077 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/WALs/jenkins-hbase4.apache.org,44315,1693159312559/jenkins-hbase4.apache.org%2C44315%2C1693159312559.meta.1693159313052.meta 2023-08-27 18:01:53,077 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43633,DS-9d8ac979-936a-4070-a080-eabeb9631f73,DISK], DatanodeInfoWithStorage[127.0.0.1:32933,DS-c6569555-83d6-4a97-aaed-2d8878da46ed,DISK]] 2023-08-27 18:01:53,077 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-27 18:01:53,078 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-27 18:01:53,078 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-27 18:01:53,078 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-27 18:01:53,078 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-27 18:01:53,078 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 18:01:53,078 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-27 18:01:53,078 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-27 18:01:53,080 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-27 18:01:53,081 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/info 2023-08-27 18:01:53,081 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/info 2023-08-27 18:01:53,081 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-27 18:01:53,082 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 18:01:53,082 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-27 18:01:53,083 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/rep_barrier 2023-08-27 18:01:53,083 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/rep_barrier 2023-08-27 18:01:53,083 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-27 18:01:53,084 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 18:01:53,084 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-27 18:01:53,085 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/table 2023-08-27 18:01:53,085 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/table 2023-08-27 18:01:53,085 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-27 18:01:53,086 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 18:01:53,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740 2023-08-27 18:01:53,088 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740 2023-08-27 18:01:53,090 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-27 18:01:53,091 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-27 18:01:53,092 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=716813, jitterRate=-0.08852614462375641}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-27 18:01:53,092 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-27 18:01:53,093 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1693159313043 2023-08-27 18:01:53,097 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-27 18:01:53,097 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-27 18:01:53,098 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44315,1693159312559, state=OPEN 2023-08-27 18:01:53,100 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-27 18:01:53,100 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-27 18:01:53,101 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-27 18:01:53,101 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44315,1693159312559 in 211 msec 2023-08-27 18:01:53,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-27 18:01:53,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 367 msec 2023-08-27 18:01:53,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 406 msec 2023-08-27 18:01:53,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1693159313104, completionTime=-1 2023-08-27 18:01:53,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-27 18:01:53,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-27 18:01:53,107 DEBUG [hconnection-0x64d30b39-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-27 18:01:53,109 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-27 18:01:53,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-27 18:01:53,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1693159373110 2023-08-27 18:01:53,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1693159433110 2023-08-27 18:01:53,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-08-27 18:01:53,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40283,1693159312520-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-27 18:01:53,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40283,1693159312520-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-27 18:01:53,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40283,1693159312520-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-27 18:01:53,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40283, period=300000, unit=MILLISECONDS is enabled. 2023-08-27 18:01:53,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-27 18:01:53,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-27 18:01:53,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-27 18:01:53,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-27 18:01:53,118 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-27 18:01:53,119 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-27 18:01:53,120 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-27 18:01:53,122 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/.tmp/data/hbase/namespace/2b167f5766da5700eaaf20b6597374a6 2023-08-27 18:01:53,122 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/.tmp/data/hbase/namespace/2b167f5766da5700eaaf20b6597374a6 empty. 2023-08-27 18:01:53,123 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/.tmp/data/hbase/namespace/2b167f5766da5700eaaf20b6597374a6 2023-08-27 18:01:53,123 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-27 18:01:53,134 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-27 18:01:53,135 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2b167f5766da5700eaaf20b6597374a6, NAME => 'hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/.tmp 2023-08-27 18:01:53,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 18:01:53,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 2b167f5766da5700eaaf20b6597374a6, disabling compactions & flushes 2023-08-27 18:01:53,143 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6. 2023-08-27 18:01:53,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6. 2023-08-27 18:01:53,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6. after waiting 0 ms 2023-08-27 18:01:53,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6. 2023-08-27 18:01:53,143 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6. 2023-08-27 18:01:53,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 2b167f5766da5700eaaf20b6597374a6: 2023-08-27 18:01:53,146 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-27 18:01:53,147 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1693159313147"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1693159313147"}]},"ts":"1693159313147"} 2023-08-27 18:01:53,148 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-27 18:01:53,149 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-27 18:01:53,149 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1693159313149"}]},"ts":"1693159313149"} 2023-08-27 18:01:53,150 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-27 18:01:53,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2b167f5766da5700eaaf20b6597374a6, ASSIGN}] 2023-08-27 18:01:53,159 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2b167f5766da5700eaaf20b6597374a6, ASSIGN 2023-08-27 18:01:53,159 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=2b167f5766da5700eaaf20b6597374a6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44315,1693159312559; forceNewPlan=false, retain=false 2023-08-27 18:01:53,311 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2b167f5766da5700eaaf20b6597374a6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44315,1693159312559 2023-08-27 18:01:53,311 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1693159313310"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1693159313310"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1693159313310"}]},"ts":"1693159313310"} 2023-08-27 18:01:53,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 2b167f5766da5700eaaf20b6597374a6, server=jenkins-hbase4.apache.org,44315,1693159312559}] 2023-08-27 18:01:53,468 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6. 2023-08-27 18:01:53,468 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2b167f5766da5700eaaf20b6597374a6, NAME => 'hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6.', STARTKEY => '', ENDKEY => ''} 2023-08-27 18:01:53,468 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 2b167f5766da5700eaaf20b6597374a6 2023-08-27 18:01:53,468 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-27 18:01:53,468 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2b167f5766da5700eaaf20b6597374a6 2023-08-27 18:01:53,468 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2b167f5766da5700eaaf20b6597374a6 2023-08-27 18:01:53,470 INFO [StoreOpener-2b167f5766da5700eaaf20b6597374a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2b167f5766da5700eaaf20b6597374a6 2023-08-27 18:01:53,471 DEBUG [StoreOpener-2b167f5766da5700eaaf20b6597374a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/namespace/2b167f5766da5700eaaf20b6597374a6/info 2023-08-27 18:01:53,471 DEBUG [StoreOpener-2b167f5766da5700eaaf20b6597374a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/namespace/2b167f5766da5700eaaf20b6597374a6/info 2023-08-27 18:01:53,471 INFO [StoreOpener-2b167f5766da5700eaaf20b6597374a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b167f5766da5700eaaf20b6597374a6 columnFamilyName info 2023-08-27 18:01:53,472 INFO [StoreOpener-2b167f5766da5700eaaf20b6597374a6-1] regionserver.HStore(310): Store=2b167f5766da5700eaaf20b6597374a6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-27 18:01:53,472 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/namespace/2b167f5766da5700eaaf20b6597374a6 2023-08-27 18:01:53,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/namespace/2b167f5766da5700eaaf20b6597374a6 2023-08-27 18:01:53,476 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2b167f5766da5700eaaf20b6597374a6 2023-08-27 18:01:53,478 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/namespace/2b167f5766da5700eaaf20b6597374a6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-27 18:01:53,479 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2b167f5766da5700eaaf20b6597374a6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=853649, jitterRate=0.08547142148017883}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-27 18:01:53,479 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2b167f5766da5700eaaf20b6597374a6: 2023-08-27 18:01:53,479 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6., pid=6, masterSystemTime=1693159313464 2023-08-27 18:01:53,481 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6. 2023-08-27 18:01:53,481 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6. 2023-08-27 18:01:53,481 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2b167f5766da5700eaaf20b6597374a6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44315,1693159312559 2023-08-27 18:01:53,481 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1693159313481"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1693159313481"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1693159313481"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1693159313481"}]},"ts":"1693159313481"} 2023-08-27 18:01:53,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-27 18:01:53,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 2b167f5766da5700eaaf20b6597374a6, server=jenkins-hbase4.apache.org,44315,1693159312559 in 171 msec 2023-08-27 18:01:53,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-27 18:01:53,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=2b167f5766da5700eaaf20b6597374a6, ASSIGN in 327 msec 2023-08-27 18:01:53,487 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-27 18:01:53,487 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1693159313487"}]},"ts":"1693159313487"} 2023-08-27 18:01:53,488 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-27 18:01:53,490 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-27 18:01:53,492 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 374 msec 2023-08-27 18:01:53,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-27 18:01:53,521 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-27 18:01:53,521 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 18:01:53,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-27 18:01:53,531 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-27 18:01:53,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-08-27 18:01:53,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-27 18:01:53,541 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-27 18:01:53,544 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-08-27 18:01:53,550 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-27 18:01:53,552 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-27 18:01:53,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.971sec 2023-08-27 18:01:53,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-27 18:01:53,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-27 18:01:53,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-27 18:01:53,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40283,1693159312520-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-27 18:01:53,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40283,1693159312520-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-27 18:01:53,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-27 18:01:53,575 DEBUG [Listener at localhost/34937] zookeeper.ReadOnlyZKClient(139): Connect 0x5fc4fd4d to 127.0.0.1:49800 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-27 18:01:53,580 DEBUG [Listener at localhost/34937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@265bf5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-27 18:01:53,582 DEBUG [hconnection-0x499ca2a3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-27 18:01:53,583 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-27 18:01:53,585 INFO [Listener at localhost/34937] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40283,1693159312520 2023-08-27 18:01:53,585 INFO [Listener at localhost/34937] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-27 18:01:53,588 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-27 18:01:53,588 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 18:01:53,589 INFO [Listener at localhost/34937] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-27 18:01:53,589 INFO [Listener at localhost/34937] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-27 18:01:53,592 INFO [Listener at localhost/34937] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=test.com%2C8080%2C1, suffix=, logDir=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/WALs/test.com,8080,1, archiveDir=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/oldWALs, maxLogs=32 2023-08-27 18:01:53,607 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43633,DS-9d8ac979-936a-4070-a080-eabeb9631f73,DISK] 2023-08-27 18:01:53,608 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32933,DS-c6569555-83d6-4a97-aaed-2d8878da46ed,DISK] 2023-08-27 18:01:53,610 INFO [Listener at localhost/34937] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/WALs/test.com,8080,1/test.com%2C8080%2C1.1693159313592 2023-08-27 18:01:53,610 DEBUG [Listener at localhost/34937] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43633,DS-9d8ac979-936a-4070-a080-eabeb9631f73,DISK], DatanodeInfoWithStorage[127.0.0.1:32933,DS-c6569555-83d6-4a97-aaed-2d8878da46ed,DISK]] 2023-08-27 18:01:53,623 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32933,DS-c6569555-83d6-4a97-aaed-2d8878da46ed,DISK] 2023-08-27 18:01:53,624 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43633,DS-9d8ac979-936a-4070-a080-eabeb9631f73,DISK] 2023-08-27 18:01:53,625 INFO [Listener at localhost/34937] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/WALs/test.com,8080,1/test.com%2C8080%2C1.1693159313592 with entries=0, filesize=83 B; new WAL /user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/WALs/test.com,8080,1/test.com%2C8080%2C1.1693159313610 2023-08-27 18:01:53,625 DEBUG [Listener at localhost/34937] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32933,DS-c6569555-83d6-4a97-aaed-2d8878da46ed,DISK], DatanodeInfoWithStorage[127.0.0.1:43633,DS-9d8ac979-936a-4070-a080-eabeb9631f73,DISK]] 2023-08-27 18:01:53,625 DEBUG [Listener at localhost/34937] wal.AbstractFSWAL(716): hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/WALs/test.com,8080,1/test.com%2C8080%2C1.1693159313592 is not closed yet, will try archiving it next time 2023-08-27 18:01:53,630 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/WALs/test.com,8080,1/test.com%2C8080%2C1.1693159313592 to hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/oldWALs/test.com%2C8080%2C1.1693159313592 2023-08-27 18:01:53,633 DEBUG [Listener at localhost/34937] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/oldWALs 2023-08-27 18:01:53,633 INFO [Listener at localhost/34937] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL test.com%2C8080%2C1:(num 1693159313610) 2023-08-27 18:01:53,633 INFO [Listener at localhost/34937] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-27 18:01:53,633 DEBUG [Listener at localhost/34937] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fc4fd4d to 127.0.0.1:49800 2023-08-27 18:01:53,633 DEBUG [Listener at localhost/34937] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 18:01:53,634 DEBUG [Listener at localhost/34937] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-27 18:01:53,634 DEBUG [Listener at localhost/34937] util.JVMClusterUtil(257): Found active master hash=592677218, stopped=false 2023-08-27 18:01:53,634 INFO [Listener at localhost/34937] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40283,1693159312520 2023-08-27 18:01:53,636 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x1004ee8041e0001, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-27 18:01:53,636 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-27 18:01:53,636 INFO [Listener at localhost/34937] procedure2.ProcedureExecutor(629): Stopping 2023-08-27 18:01:53,636 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 18:01:53,637 DEBUG [Listener at localhost/34937] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32eb974c to 127.0.0.1:49800 2023-08-27 18:01:53,637 DEBUG [Listener at localhost/34937] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 18:01:53,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x1004ee8041e0001, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 18:01:53,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-27 18:01:53,637 INFO [Listener at localhost/34937] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44315,1693159312559' ***** 2023-08-27 18:01:53,637 INFO [Listener at localhost/34937] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-27 18:01:53,637 INFO [RS:0;jenkins-hbase4:44315] regionserver.HeapMemoryManager(220): Stopping 2023-08-27 18:01:53,638 INFO [RS:0;jenkins-hbase4:44315] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-27 18:01:53,638 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-27 18:01:53,638 INFO [RS:0;jenkins-hbase4:44315] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-27 18:01:53,638 INFO [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(3305): Received CLOSE for 2b167f5766da5700eaaf20b6597374a6 2023-08-27 18:01:53,638 INFO [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44315,1693159312559 2023-08-27 18:01:53,638 DEBUG [RS:0;jenkins-hbase4:44315] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58fdc35e to 127.0.0.1:49800 2023-08-27 18:01:53,638 DEBUG [RS:0;jenkins-hbase4:44315] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 18:01:53,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2b167f5766da5700eaaf20b6597374a6, disabling compactions & flushes 2023-08-27 18:01:53,639 INFO [RS:0;jenkins-hbase4:44315] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-27 18:01:53,639 INFO [RS:0;jenkins-hbase4:44315] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-27 18:01:53,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6. 2023-08-27 18:01:53,639 INFO [RS:0;jenkins-hbase4:44315] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-27 18:01:53,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6. 2023-08-27 18:01:53,639 INFO [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-27 18:01:53,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6. after waiting 0 ms 2023-08-27 18:01:53,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6. 2023-08-27 18:01:53,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2b167f5766da5700eaaf20b6597374a6 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-27 18:01:53,639 INFO [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-08-27 18:01:53,639 DEBUG [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 2b167f5766da5700eaaf20b6597374a6=hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6.} 2023-08-27 18:01:53,640 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-27 18:01:53,640 DEBUG [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(1504): Waiting on 1588230740, 2b167f5766da5700eaaf20b6597374a6 2023-08-27 18:01:53,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-27 18:01:53,640 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-27 18:01:53,640 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-27 18:01:53,640 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-27 18:01:53,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=1.26 KB heapSize=2.89 KB 2023-08-27 18:01:53,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.17 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/.tmp/info/7cdcefcb3d8541a082d38182ed694858 2023-08-27 18:01:53,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/namespace/2b167f5766da5700eaaf20b6597374a6/.tmp/info/069cbe196215467d9ed871ed443c230f 2023-08-27 18:01:53,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/namespace/2b167f5766da5700eaaf20b6597374a6/.tmp/info/069cbe196215467d9ed871ed443c230f as hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/namespace/2b167f5766da5700eaaf20b6597374a6/info/069cbe196215467d9ed871ed443c230f 2023-08-27 18:01:53,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/namespace/2b167f5766da5700eaaf20b6597374a6/info/069cbe196215467d9ed871ed443c230f, entries=2, sequenceid=6, filesize=4.8 K 2023-08-27 18:01:53,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 2b167f5766da5700eaaf20b6597374a6 in 53ms, sequenceid=6, compaction requested=false 2023-08-27 18:01:53,695 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=94 B at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/.tmp/table/3df2747e48f845a68f8a5014ba958779 2023-08-27 18:01:53,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/namespace/2b167f5766da5700eaaf20b6597374a6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-27 18:01:53,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6. 2023-08-27 18:01:53,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2b167f5766da5700eaaf20b6597374a6: 2023-08-27 18:01:53,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1693159313117.2b167f5766da5700eaaf20b6597374a6. 2023-08-27 18:01:53,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/.tmp/info/7cdcefcb3d8541a082d38182ed694858 as hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/info/7cdcefcb3d8541a082d38182ed694858 2023-08-27 18:01:53,708 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/info/7cdcefcb3d8541a082d38182ed694858, entries=10, sequenceid=9, filesize=5.9 K 2023-08-27 18:01:53,708 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/.tmp/table/3df2747e48f845a68f8a5014ba958779 as hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/table/3df2747e48f845a68f8a5014ba958779 2023-08-27 18:01:53,714 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/table/3df2747e48f845a68f8a5014ba958779, entries=2, sequenceid=9, filesize=4.7 K 2023-08-27 18:01:53,715 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.26 KB/1290, heapSize ~2.61 KB/2672, currentSize=0 B/0 for 1588230740 in 75ms, sequenceid=9, compaction requested=false 2023-08-27 18:01:53,720 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/data/hbase/meta/1588230740/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-08-27 18:01:53,721 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-27 18:01:53,721 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-27 18:01:53,721 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-27 18:01:53,721 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-27 18:01:53,840 INFO [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44315,1693159312559; all regions closed. 2023-08-27 18:01:53,847 DEBUG [RS:0;jenkins-hbase4:44315] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/oldWALs 2023-08-27 18:01:53,847 INFO [RS:0;jenkins-hbase4:44315] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44315%2C1693159312559.meta:.meta(num 1693159313052) 2023-08-27 18:01:53,847 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-08-27 18:01:53,847 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-08-27 18:01:53,852 DEBUG [RS:0;jenkins-hbase4:44315] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/oldWALs 2023-08-27 18:01:53,852 INFO [RS:0;jenkins-hbase4:44315] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44315%2C1693159312559:(num 1693159312939) 2023-08-27 18:01:53,852 DEBUG [RS:0;jenkins-hbase4:44315] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 18:01:53,852 INFO [RS:0;jenkins-hbase4:44315] regionserver.LeaseManager(133): Closed leases 2023-08-27 18:01:53,852 INFO [RS:0;jenkins-hbase4:44315] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-08-27 18:01:53,853 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-27 18:01:53,853 INFO [RS:0;jenkins-hbase4:44315] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44315 2023-08-27 18:01:53,856 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x1004ee8041e0001, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44315,1693159312559 2023-08-27 18:01:53,856 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-27 18:01:53,856 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x1004ee8041e0001, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-27 18:01:53,857 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44315,1693159312559] 2023-08-27 18:01:53,857 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44315,1693159312559; numProcessing=1 2023-08-27 18:01:53,859 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44315,1693159312559 already deleted, retry=false 2023-08-27 18:01:53,859 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44315,1693159312559 expired; onlineServers=0 2023-08-27 18:01:53,859 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40283,1693159312520' ***** 2023-08-27 18:01:53,859 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-27 18:01:53,860 DEBUG [M:0;jenkins-hbase4:40283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@276c09d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-27 18:01:53,860 INFO [M:0;jenkins-hbase4:40283] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40283,1693159312520 2023-08-27 18:01:53,860 INFO [M:0;jenkins-hbase4:40283] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40283,1693159312520; all regions closed. 2023-08-27 18:01:53,860 DEBUG [M:0;jenkins-hbase4:40283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-27 18:01:53,860 DEBUG [M:0;jenkins-hbase4:40283] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-27 18:01:53,860 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-27 18:01:53,860 DEBUG [M:0;jenkins-hbase4:40283] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-27 18:01:53,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1693159312702] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1693159312702,5,FailOnTimeoutGroup] 2023-08-27 18:01:53,861 INFO [M:0;jenkins-hbase4:40283] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-27 18:01:53,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1693159312702] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1693159312702,5,FailOnTimeoutGroup] 2023-08-27 18:01:53,862 INFO [M:0;jenkins-hbase4:40283] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-27 18:01:53,862 INFO [M:0;jenkins-hbase4:40283] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-27 18:01:53,862 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-27 18:01:53,862 DEBUG [M:0;jenkins-hbase4:40283] master.HMaster(1512): Stopping service threads 2023-08-27 18:01:53,862 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-27 18:01:53,862 INFO [M:0;jenkins-hbase4:40283] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-27 18:01:53,863 ERROR [M:0;jenkins-hbase4:40283] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-7,5,PEWorkerGroup] 2023-08-27 18:01:53,863 INFO [M:0;jenkins-hbase4:40283] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-27 18:01:53,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-27 18:01:53,863 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-27 18:01:53,863 DEBUG [M:0;jenkins-hbase4:40283] zookeeper.ZKUtil(398): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-27 18:01:53,863 WARN [M:0;jenkins-hbase4:40283] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-27 18:01:53,863 INFO [M:0;jenkins-hbase4:40283] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-27 18:01:53,864 INFO [M:0;jenkins-hbase4:40283] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-27 18:01:53,864 DEBUG [M:0;jenkins-hbase4:40283] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-27 18:01:53,864 INFO [M:0;jenkins-hbase4:40283] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 18:01:53,864 DEBUG [M:0;jenkins-hbase4:40283] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 18:01:53,864 DEBUG [M:0;jenkins-hbase4:40283] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-27 18:01:53,864 DEBUG [M:0;jenkins-hbase4:40283] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 18:01:53,865 INFO [M:0;jenkins-hbase4:40283] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=24.07 KB heapSize=29.55 KB 2023-08-27 18:01:53,875 INFO [M:0;jenkins-hbase4:40283] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24.07 KB at sequenceid=66 (bloomFilter=true), to=hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d12a42995a2f4b3484bc1751e4efd8e1 2023-08-27 18:01:53,879 DEBUG [M:0;jenkins-hbase4:40283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d12a42995a2f4b3484bc1751e4efd8e1 as hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d12a42995a2f4b3484bc1751e4efd8e1 2023-08-27 18:01:53,883 INFO [M:0;jenkins-hbase4:40283] regionserver.HStore(1080): Added hdfs://localhost:39741/user/jenkins/test-data/cd75a321-bcba-2f7c-f011-6e6842ce49e2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d12a42995a2f4b3484bc1751e4efd8e1, entries=8, sequenceid=66, filesize=6.3 K 2023-08-27 18:01:53,884 INFO [M:0;jenkins-hbase4:40283] regionserver.HRegion(2948): Finished flush of dataSize ~24.07 KB/24646, heapSize ~29.54 KB/30248, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=66, compaction requested=false 2023-08-27 18:01:53,885 INFO [M:0;jenkins-hbase4:40283] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-27 18:01:53,885 DEBUG [M:0;jenkins-hbase4:40283] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-27 18:01:53,888 INFO [M:0;jenkins-hbase4:40283] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-27 18:01:53,888 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-27 18:01:53,888 INFO [M:0;jenkins-hbase4:40283] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40283 2023-08-27 18:01:53,891 DEBUG [M:0;jenkins-hbase4:40283] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40283,1693159312520 already deleted, retry=false 2023-08-27 18:01:54,036 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 18:01:54,036 INFO [M:0;jenkins-hbase4:40283] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40283,1693159312520; zookeeper connection closed. 2023-08-27 18:01:54,037 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): master:40283-0x1004ee8041e0000, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 18:01:54,137 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x1004ee8041e0001, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 18:01:54,137 INFO [RS:0;jenkins-hbase4:44315] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44315,1693159312559; zookeeper connection closed. 2023-08-27 18:01:54,137 DEBUG [Listener at localhost/34937-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x1004ee8041e0001, quorum=127.0.0.1:49800, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-27 18:01:54,138 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@79023fda] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@79023fda 2023-08-27 18:01:54,138 INFO [Listener at localhost/34937] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-27 18:01:54,138 WARN [Listener at localhost/34937] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-27 18:01:54,142 INFO [Listener at localhost/34937] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 18:01:54,150 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-27 18:01:54,244 WARN [BP-1927083287-172.31.14.131-1693159311966 heartbeating to localhost/127.0.0.1:39741] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-27 18:01:54,245 WARN [BP-1927083287-172.31.14.131-1693159311966 heartbeating to localhost/127.0.0.1:39741] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1927083287-172.31.14.131-1693159311966 (Datanode Uuid 4792bd64-f509-4c96-8de3-9bda0bcf730e) service to localhost/127.0.0.1:39741 2023-08-27 18:01:54,245 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/cluster_d0e7d414-a1a1-a983-3477-2a1fb6f74cb0/dfs/data/data3/current/BP-1927083287-172.31.14.131-1693159311966] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 18:01:54,246 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/cluster_d0e7d414-a1a1-a983-3477-2a1fb6f74cb0/dfs/data/data4/current/BP-1927083287-172.31.14.131-1693159311966] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 18:01:54,246 WARN [Listener at localhost/34937] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-27 18:01:54,249 INFO [Listener at localhost/34937] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 18:01:54,353 WARN [BP-1927083287-172.31.14.131-1693159311966 heartbeating to localhost/127.0.0.1:39741] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-27 18:01:54,353 WARN [BP-1927083287-172.31.14.131-1693159311966 heartbeating to localhost/127.0.0.1:39741] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1927083287-172.31.14.131-1693159311966 (Datanode Uuid c6b70f11-3b58-4022-98ae-420887dd8732) service to localhost/127.0.0.1:39741 2023-08-27 18:01:54,353 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/cluster_d0e7d414-a1a1-a983-3477-2a1fb6f74cb0/dfs/data/data1/current/BP-1927083287-172.31.14.131-1693159311966] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 18:01:54,354 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/30c22495-cc95-c233-36dd-6858d3ed798c/cluster_d0e7d414-a1a1-a983-3477-2a1fb6f74cb0/dfs/data/data2/current/BP-1927083287-172.31.14.131-1693159311966] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-27 18:01:54,364 INFO [Listener at localhost/34937] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-27 18:01:54,475 INFO [Listener at localhost/34937] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-27 18:01:54,486 INFO [Listener at localhost/34937] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-27 18:01:54,497 INFO [Listener at localhost/34937] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=102 (was 77) - Thread LEAK? -, OpenFileDescriptor=486 (was 464) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=31 (was 25) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=12129 (was 12138)