2023-08-18 21:52:40,283 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4 2023-08-18 21:52:40,296 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRolling timeout: 13 mins 2023-08-18 21:52:40,331 INFO [Time-limited test] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=316, ProcessCount=171, AvailableMemoryMB=4566 2023-08-18 21:52:40,340 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-18 21:52:40,340 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de, deleteOnExit=true 2023-08-18 21:52:40,341 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-18 21:52:40,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/test.cache.data in system properties and HBase conf 2023-08-18 21:52:40,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/hadoop.tmp.dir in system properties and HBase conf 2023-08-18 21:52:40,343 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/hadoop.log.dir in system properties and HBase conf 2023-08-18 21:52:40,344 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-18 21:52:40,344 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-18 21:52:40,345 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-18 21:52:40,457 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-08-18 21:52:40,820 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-18 21:52:40,826 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-18 21:52:40,826 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-18 21:52:40,827 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-18 21:52:40,827 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-18 21:52:40,828 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-18 21:52:40,828 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-18 21:52:40,829 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-18 21:52:40,829 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-18 21:52:40,830 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-18 21:52:40,830 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/nfs.dump.dir in system properties and HBase conf 2023-08-18 21:52:40,831 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/java.io.tmpdir in system properties and HBase conf 2023-08-18 21:52:40,831 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-18 21:52:40,831 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-18 21:52:40,832 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-18 21:52:41,368 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-18 21:52:41,371 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-18 21:52:41,792 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-08-18 21:52:41,954 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-08-18 21:52:41,973 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:52:42,014 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:52:42,050 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/java.io.tmpdir/Jetty_localhost_33883_hdfs____.dhjngj/webapp 2023-08-18 21:52:42,202 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33883 2023-08-18 21:52:42,213 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-18 21:52:42,214 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-18 21:52:42,787 WARN [Listener at localhost/35033] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:52:42,902 WARN [Listener at localhost/35033] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-18 21:52:42,925 WARN [Listener at localhost/35033] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:52:42,933 INFO [Listener at localhost/35033] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:52:42,944 INFO [Listener at localhost/35033] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/java.io.tmpdir/Jetty_localhost_38647_datanode____5e72cb/webapp 2023-08-18 21:52:43,052 INFO [Listener at localhost/35033] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38647 2023-08-18 21:52:43,454 WARN [Listener at localhost/40621] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:52:43,472 WARN [Listener at localhost/40621] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-18 21:52:43,486 WARN [Listener at localhost/40621] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:52:43,489 INFO [Listener at localhost/40621] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:52:43,504 INFO [Listener at localhost/40621] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/java.io.tmpdir/Jetty_localhost_46225_datanode____.sn1012/webapp 2023-08-18 21:52:43,608 INFO [Listener at localhost/40621] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46225 2023-08-18 21:52:43,622 WARN [Listener at localhost/45463] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:52:44,124 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfd2a6df5aabbd11: Processing first storage report for DS-4368ed8d-fe43-4c6d-97fb-42ad21764b21 from datanode 909a1899-aa8e-4790-a382-6fccbb9b6666 2023-08-18 21:52:44,126 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfd2a6df5aabbd11: from storage DS-4368ed8d-fe43-4c6d-97fb-42ad21764b21 node DatanodeRegistration(127.0.0.1:37027, datanodeUuid=909a1899-aa8e-4790-a382-6fccbb9b6666, infoPort=35905, infoSecurePort=0, ipcPort=40621, storageInfo=lv=-57;cid=testClusterID;nsid=471510740;c=1692395561429), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-08-18 21:52:44,126 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8ff50f86db80fb0c: Processing first storage report for DS-cdc5c719-d871-4b3b-9893-ad129ee42e70 from datanode c7d721b6-b27e-4d16-9576-e1cc508e9aea 2023-08-18 21:52:44,126 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8ff50f86db80fb0c: from storage DS-cdc5c719-d871-4b3b-9893-ad129ee42e70 node DatanodeRegistration(127.0.0.1:40339, datanodeUuid=c7d721b6-b27e-4d16-9576-e1cc508e9aea, infoPort=45055, infoSecurePort=0, ipcPort=45463, storageInfo=lv=-57;cid=testClusterID;nsid=471510740;c=1692395561429), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-18 21:52:44,127 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8ff50f86db80fb0c: Processing first storage report for DS-24b1fcc2-938d-4ca0-81c6-76ee908b80f6 from datanode c7d721b6-b27e-4d16-9576-e1cc508e9aea 2023-08-18 21:52:44,127 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8ff50f86db80fb0c: from storage DS-24b1fcc2-938d-4ca0-81c6-76ee908b80f6 node DatanodeRegistration(127.0.0.1:40339, datanodeUuid=c7d721b6-b27e-4d16-9576-e1cc508e9aea, infoPort=45055, infoSecurePort=0, ipcPort=45463, storageInfo=lv=-57;cid=testClusterID;nsid=471510740;c=1692395561429), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:52:44,127 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfd2a6df5aabbd11: Processing first storage report for DS-47a13752-1744-4c1e-a1be-81abf13b6059 from datanode 909a1899-aa8e-4790-a382-6fccbb9b6666 2023-08-18 21:52:44,127 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfd2a6df5aabbd11: from storage DS-47a13752-1744-4c1e-a1be-81abf13b6059 node DatanodeRegistration(127.0.0.1:37027, datanodeUuid=909a1899-aa8e-4790-a382-6fccbb9b6666, infoPort=35905, infoSecurePort=0, ipcPort=40621, storageInfo=lv=-57;cid=testClusterID;nsid=471510740;c=1692395561429), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-18 21:52:44,240 DEBUG [Listener at localhost/45463] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4 2023-08-18 21:52:44,332 INFO [Listener at localhost/45463] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de/zookeeper_0, clientPort=55402, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-18 21:52:44,355 INFO [Listener at localhost/45463] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55402 2023-08-18 21:52:44,363 INFO [Listener at localhost/45463] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:52:44,365 INFO [Listener at localhost/45463] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:52:45,103 INFO [Listener at localhost/45463] util.FSUtils(471): Created version file at hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d with version=8 2023-08-18 21:52:45,103 INFO [Listener at localhost/45463] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/hbase-staging 2023-08-18 21:52:45,518 INFO [Listener at localhost/45463] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-08-18 21:52:46,115 INFO [Listener at localhost/45463] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-08-18 21:52:46,160 INFO [Listener at localhost/45463] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:52:46,161 INFO [Listener at localhost/45463] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-18 21:52:46,162 INFO [Listener at localhost/45463] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-18 21:52:46,162 INFO [Listener at localhost/45463] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:52:46,163 INFO [Listener at localhost/45463] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-18 21:52:46,358 INFO [Listener at localhost/45463] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-18 21:52:46,451 DEBUG [Listener at localhost/45463] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-08-18 21:52:46,587 INFO [Listener at localhost/45463] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44051 2023-08-18 21:52:46,601 INFO [Listener at localhost/45463] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:52:46,604 INFO [Listener at localhost/45463] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:52:46,646 INFO [Listener at localhost/45463] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44051 connecting to ZooKeeper ensemble=127.0.0.1:55402 2023-08-18 21:52:46,869 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:440510x0, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-18 21:52:46,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44051-0x1000ce5be360000 connected 2023-08-18 21:52:47,014 DEBUG [Listener at localhost/45463] zookeeper.ZKUtil(164): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-18 21:52:47,015 DEBUG [Listener at localhost/45463] zookeeper.ZKUtil(164): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:52:47,018 DEBUG [Listener at localhost/45463] zookeeper.ZKUtil(164): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-18 21:52:47,026 DEBUG [Listener at localhost/45463] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44051 2023-08-18 21:52:47,027 DEBUG [Listener at localhost/45463] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44051 2023-08-18 21:52:47,027 DEBUG [Listener at localhost/45463] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44051 2023-08-18 21:52:47,028 DEBUG [Listener at localhost/45463] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44051 2023-08-18 21:52:47,028 DEBUG [Listener at localhost/45463] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44051 2023-08-18 21:52:47,033 INFO [Listener at localhost/45463] master.HMaster(444): hbase.rootdir=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d, hbase.cluster.distributed=false 2023-08-18 21:52:47,121 INFO [Listener at localhost/45463] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-08-18 21:52:47,121 INFO [Listener at localhost/45463] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:52:47,122 INFO [Listener at localhost/45463] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-18 21:52:47,122 INFO [Listener at localhost/45463] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-18 21:52:47,122 INFO [Listener at localhost/45463] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:52:47,122 INFO [Listener at localhost/45463] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-18 21:52:47,126 INFO [Listener at localhost/45463] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-18 21:52:47,130 INFO [Listener at localhost/45463] ipc.NettyRpcServer(120): Bind to /148.251.75.209:40499 2023-08-18 21:52:47,132 INFO [Listener at localhost/45463] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-18 21:52:47,140 DEBUG [Listener at localhost/45463] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-18 21:52:47,141 INFO [Listener at localhost/45463] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:52:47,143 INFO [Listener at localhost/45463] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:52:47,145 INFO [Listener at localhost/45463] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40499 connecting to ZooKeeper ensemble=127.0.0.1:55402 2023-08-18 21:52:47,148 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): regionserver:404990x0, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-18 21:52:47,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40499-0x1000ce5be360001 connected 2023-08-18 21:52:47,149 DEBUG [Listener at localhost/45463] zookeeper.ZKUtil(164): regionserver:40499-0x1000ce5be360001, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-18 21:52:47,151 DEBUG [Listener at localhost/45463] zookeeper.ZKUtil(164): regionserver:40499-0x1000ce5be360001, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:52:47,152 DEBUG [Listener at localhost/45463] zookeeper.ZKUtil(164): regionserver:40499-0x1000ce5be360001, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-18 21:52:47,153 DEBUG [Listener at localhost/45463] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40499 2023-08-18 21:52:47,153 DEBUG [Listener at localhost/45463] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40499 2023-08-18 21:52:47,153 DEBUG [Listener at localhost/45463] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40499 2023-08-18 21:52:47,154 DEBUG [Listener at localhost/45463] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40499 2023-08-18 21:52:47,154 DEBUG [Listener at localhost/45463] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40499 2023-08-18 21:52:47,156 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,44051,1692395565280 2023-08-18 21:52:47,173 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-18 21:52:47,174 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,44051,1692395565280 2023-08-18 21:52:47,196 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): regionserver:40499-0x1000ce5be360001, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-18 21:52:47,196 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-18 21:52:47,197 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:52:47,197 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-18 21:52:47,199 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,44051,1692395565280 from backup master directory 2023-08-18 21:52:47,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-18 21:52:47,201 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,44051,1692395565280 2023-08-18 21:52:47,201 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-18 21:52:47,202 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-18 21:52:47,202 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,44051,1692395565280 2023-08-18 21:52:47,204 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-08-18 21:52:47,205 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-08-18 21:52:47,292 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/hbase.id with ID: 6f9c1aee-2ae0-458a-ad09-5019a79d4247 2023-08-18 21:52:47,341 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:52:47,359 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:52:47,402 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1db0b14b to 127.0.0.1:55402 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-18 21:52:47,432 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72bfe2c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-18 21:52:47,461 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-18 21:52:47,463 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-18 21:52:47,476 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-18 21:52:47,526 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/data/master/store-tmp 2023-08-18 21:52:47,566 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:52:47,566 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-18 21:52:47,566 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:52:47,566 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:52:47,567 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-18 21:52:47,567 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:52:47,567 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:52:47,567 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-18 21:52:47,569 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/WALs/jenkins-hbase20.apache.org,44051,1692395565280 2023-08-18 21:52:47,607 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44051%2C1692395565280, suffix=, logDir=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/WALs/jenkins-hbase20.apache.org,44051,1692395565280, archiveDir=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/oldWALs, maxLogs=10 2023-08-18 21:52:47,649 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-08-18 21:52:47,649 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-08-18 21:52:47,652 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:53) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:190) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:116) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:719) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:128) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:881) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:574) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.init(AbstractFSWAL.java:515) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:160) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:295) at org.apache.hadoop.hbase.master.region.MasterRegion.createWAL(MasterRegion.java:200) at org.apache.hadoop.hbase.master.region.MasterRegion.bootstrap(MasterRegion.java:220) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:348) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:52:47,688 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:417) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:52:47,691 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37027,DS-4368ed8d-fe43-4c6d-97fb-42ad21764b21,DISK] 2023-08-18 21:52:47,691 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40339,DS-cdc5c719-d871-4b3b-9893-ad129ee42e70,DISK] 2023-08-18 21:52:47,697 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:52:47,775 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/WALs/jenkins-hbase20.apache.org,44051,1692395565280/jenkins-hbase20.apache.org%2C44051%2C1692395565280.1692395567620 2023-08-18 21:52:47,775 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37027,DS-4368ed8d-fe43-4c6d-97fb-42ad21764b21,DISK], DatanodeInfoWithStorage[127.0.0.1:40339,DS-cdc5c719-d871-4b3b-9893-ad129ee42e70,DISK]] 2023-08-18 21:52:47,776 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-18 21:52:47,776 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:52:47,780 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:52:47,781 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:52:47,855 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:52:47,862 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-18 21:52:47,886 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-18 21:52:47,898 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:52:47,904 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:52:47,905 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:52:47,919 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:52:47,925 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-18 21:52:47,926 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=775265, jitterRate=-0.014199748635292053}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-18 21:52:47,927 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-18 21:52:47,928 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-18 21:52:47,945 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-18 21:52:47,945 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-18 21:52:47,947 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-18 21:52:47,949 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-08-18 21:52:47,992 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 42 msec 2023-08-18 21:52:47,992 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-18 21:52:48,026 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-18 21:52:48,032 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-18 21:52:48,060 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-18 21:52:48,064 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-18 21:52:48,067 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-18 21:52:48,072 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-18 21:52:48,077 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-18 21:52:48,080 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:52:48,081 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-18 21:52:48,081 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-18 21:52:48,095 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-18 21:52:48,101 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-18 21:52:48,101 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:52:48,101 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): regionserver:40499-0x1000ce5be360001, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-18 21:52:48,103 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,44051,1692395565280, sessionid=0x1000ce5be360000, setting cluster-up flag (Was=false) 2023-08-18 21:52:48,116 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:52:48,120 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-18 21:52:48,122 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44051,1692395565280 2023-08-18 21:52:48,126 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:52:48,130 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-18 21:52:48,131 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44051,1692395565280 2023-08-18 21:52:48,134 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/.hbase-snapshot/.tmp 2023-08-18 21:52:48,159 INFO [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(951): ClusterId : 6f9c1aee-2ae0-458a-ad09-5019a79d4247 2023-08-18 21:52:48,164 DEBUG [RS:0;jenkins-hbase20:40499] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-18 21:52:48,172 DEBUG [RS:0;jenkins-hbase20:40499] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-18 21:52:48,172 DEBUG [RS:0;jenkins-hbase20:40499] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-18 21:52:48,180 DEBUG [RS:0;jenkins-hbase20:40499] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-18 21:52:48,181 DEBUG [RS:0;jenkins-hbase20:40499] zookeeper.ReadOnlyZKClient(139): Connect 0x7c479fcf to 127.0.0.1:55402 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-18 21:52:48,195 DEBUG [RS:0;jenkins-hbase20:40499] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72806e37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-18 21:52:48,196 DEBUG [RS:0;jenkins-hbase20:40499] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76bff4bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-08-18 21:52:48,226 DEBUG [RS:0;jenkins-hbase20:40499] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:40499 2023-08-18 21:52:48,231 INFO [RS:0;jenkins-hbase20:40499] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-18 21:52:48,231 INFO [RS:0;jenkins-hbase20:40499] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-18 21:52:48,231 DEBUG [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(1022): About to register with Master. 2023-08-18 21:52:48,234 INFO [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,44051,1692395565280 with isa=jenkins-hbase20.apache.org/148.251.75.209:40499, startcode=1692395567120 2023-08-18 21:52:48,253 DEBUG [RS:0;jenkins-hbase20:40499] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-18 21:52:48,273 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-18 21:52:48,282 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:52:48,282 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:52:48,282 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:52:48,283 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:52:48,283 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-08-18 21:52:48,283 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:52:48,283 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-08-18 21:52:48,283 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:52:48,287 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1692395598287 2023-08-18 21:52:48,290 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-18 21:52:48,293 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-18 21:52:48,293 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-18 21:52:48,298 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-18 21:52:48,304 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-18 21:52:48,310 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47999, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-08-18 21:52:48,313 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-18 21:52:48,314 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-18 21:52:48,315 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-18 21:52:48,315 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-18 21:52:48,316 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-18 21:52:48,317 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-18 21:52:48,319 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-18 21:52:48,319 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-18 21:52:48,320 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44051] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-18 21:52:48,321 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-18 21:52:48,321 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-18 21:52:48,328 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1692395568323,5,FailOnTimeoutGroup] 2023-08-18 21:52:48,329 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1692395568329,5,FailOnTimeoutGroup] 2023-08-18 21:52:48,329 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-18 21:52:48,330 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-18 21:52:48,332 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-18 21:52:48,333 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-18 21:52:48,348 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-18 21:52:48,349 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-18 21:52:48,350 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d 2023-08-18 21:52:48,360 DEBUG [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(2830): Master is not running yet 2023-08-18 21:52:48,360 WARN [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-08-18 21:52:48,370 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:52:48,373 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-18 21:52:48,375 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/info 2023-08-18 21:52:48,376 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-18 21:52:48,382 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:52:48,382 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-18 21:52:48,385 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/rep_barrier 2023-08-18 21:52:48,386 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-18 21:52:48,387 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:52:48,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-18 21:52:48,390 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/table 2023-08-18 21:52:48,391 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-18 21:52:48,392 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:52:48,394 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740 2023-08-18 21:52:48,395 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740 2023-08-18 21:52:48,402 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-18 21:52:48,404 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-18 21:52:48,408 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-18 21:52:48,409 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=743654, jitterRate=-0.0543961226940155}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-18 21:52:48,410 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-18 21:52:48,410 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-18 21:52:48,410 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-18 21:52:48,410 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-18 21:52:48,410 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-18 21:52:48,410 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-18 21:52:48,411 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-18 21:52:48,412 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-18 21:52:48,417 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-18 21:52:48,417 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-18 21:52:48,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-18 21:52:48,436 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-18 21:52:48,439 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-18 21:52:48,461 INFO [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,44051,1692395565280 with isa=jenkins-hbase20.apache.org/148.251.75.209:40499, startcode=1692395567120 2023-08-18 21:52:48,466 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44051] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,40499,1692395567120 2023-08-18 21:52:48,473 DEBUG [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d 2023-08-18 21:52:48,473 DEBUG [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35033 2023-08-18 21:52:48,473 DEBUG [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-18 21:52:48,479 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-18 21:52:48,481 DEBUG [RS:0;jenkins-hbase20:40499] zookeeper.ZKUtil(162): regionserver:40499-0x1000ce5be360001, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,40499,1692395567120 2023-08-18 21:52:48,481 WARN [RS:0;jenkins-hbase20:40499] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-18 21:52:48,482 INFO [RS:0;jenkins-hbase20:40499] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-18 21:52:48,482 DEBUG [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120 2023-08-18 21:52:48,482 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,40499,1692395567120] 2023-08-18 21:52:48,495 DEBUG [RS:0;jenkins-hbase20:40499] zookeeper.ZKUtil(162): regionserver:40499-0x1000ce5be360001, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,40499,1692395567120 2023-08-18 21:52:48,505 DEBUG [RS:0;jenkins-hbase20:40499] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-18 21:52:48,513 INFO [RS:0;jenkins-hbase20:40499] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-18 21:52:48,531 INFO [RS:0;jenkins-hbase20:40499] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-18 21:52:48,534 INFO [RS:0;jenkins-hbase20:40499] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-18 21:52:48,534 INFO [RS:0;jenkins-hbase20:40499] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-18 21:52:48,535 INFO [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-18 21:52:48,541 INFO [RS:0;jenkins-hbase20:40499] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-18 21:52:48,541 DEBUG [RS:0;jenkins-hbase20:40499] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:52:48,542 DEBUG [RS:0;jenkins-hbase20:40499] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:52:48,542 DEBUG [RS:0;jenkins-hbase20:40499] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:52:48,542 DEBUG [RS:0;jenkins-hbase20:40499] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:52:48,542 DEBUG [RS:0;jenkins-hbase20:40499] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:52:48,543 DEBUG [RS:0;jenkins-hbase20:40499] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-08-18 21:52:48,543 DEBUG [RS:0;jenkins-hbase20:40499] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:52:48,543 DEBUG [RS:0;jenkins-hbase20:40499] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:52:48,543 DEBUG [RS:0;jenkins-hbase20:40499] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:52:48,543 DEBUG [RS:0;jenkins-hbase20:40499] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:52:48,544 INFO [RS:0;jenkins-hbase20:40499] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-18 21:52:48,544 INFO [RS:0;jenkins-hbase20:40499] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-18 21:52:48,544 INFO [RS:0;jenkins-hbase20:40499] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-18 21:52:48,559 INFO [RS:0;jenkins-hbase20:40499] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-18 21:52:48,562 INFO [RS:0;jenkins-hbase20:40499] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40499,1692395567120-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-18 21:52:48,577 INFO [RS:0;jenkins-hbase20:40499] regionserver.Replication(203): jenkins-hbase20.apache.org,40499,1692395567120 started 2023-08-18 21:52:48,577 INFO [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,40499,1692395567120, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:40499, sessionid=0x1000ce5be360001 2023-08-18 21:52:48,578 DEBUG [RS:0;jenkins-hbase20:40499] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-18 21:52:48,578 DEBUG [RS:0;jenkins-hbase20:40499] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,40499,1692395567120 2023-08-18 21:52:48,578 DEBUG [RS:0;jenkins-hbase20:40499] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,40499,1692395567120' 2023-08-18 21:52:48,578 DEBUG [RS:0;jenkins-hbase20:40499] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-18 21:52:48,579 DEBUG [RS:0;jenkins-hbase20:40499] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-18 21:52:48,579 DEBUG [RS:0;jenkins-hbase20:40499] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-18 21:52:48,579 DEBUG [RS:0;jenkins-hbase20:40499] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-18 21:52:48,579 DEBUG [RS:0;jenkins-hbase20:40499] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,40499,1692395567120 2023-08-18 21:52:48,579 DEBUG [RS:0;jenkins-hbase20:40499] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,40499,1692395567120' 2023-08-18 21:52:48,579 DEBUG [RS:0;jenkins-hbase20:40499] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-18 21:52:48,580 DEBUG [RS:0;jenkins-hbase20:40499] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-18 21:52:48,580 DEBUG [RS:0;jenkins-hbase20:40499] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-18 21:52:48,580 INFO [RS:0;jenkins-hbase20:40499] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-18 21:52:48,580 INFO [RS:0;jenkins-hbase20:40499] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-18 21:52:48,591 DEBUG [jenkins-hbase20:44051] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-18 21:52:48,594 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,40499,1692395567120, state=OPENING 2023-08-18 21:52:48,600 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-18 21:52:48,601 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:52:48,602 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-18 21:52:48,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,40499,1692395567120}] 2023-08-18 21:52:48,693 INFO [RS:0;jenkins-hbase20:40499] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C40499%2C1692395567120, suffix=, logDir=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120, archiveDir=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/oldWALs, maxLogs=32 2023-08-18 21:52:48,718 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40339,DS-cdc5c719-d871-4b3b-9893-ad129ee42e70,DISK] 2023-08-18 21:52:48,718 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37027,DS-4368ed8d-fe43-4c6d-97fb-42ad21764b21,DISK] 2023-08-18 21:52:48,723 INFO [RS:0;jenkins-hbase20:40499] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.1692395568696 2023-08-18 21:52:48,724 DEBUG [RS:0;jenkins-hbase20:40499] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40339,DS-cdc5c719-d871-4b3b-9893-ad129ee42e70,DISK], DatanodeInfoWithStorage[127.0.0.1:37027,DS-4368ed8d-fe43-4c6d-97fb-42ad21764b21,DISK]] 2023-08-18 21:52:48,788 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,40499,1692395567120 2023-08-18 21:52:48,790 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-18 21:52:48,793 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-18 21:52:48,805 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-18 21:52:48,806 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-18 21:52:48,810 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C40499%2C1692395567120.meta, suffix=.meta, logDir=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120, archiveDir=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/oldWALs, maxLogs=32 2023-08-18 21:52:48,828 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40339,DS-cdc5c719-d871-4b3b-9893-ad129ee42e70,DISK] 2023-08-18 21:52:48,828 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37027,DS-4368ed8d-fe43-4c6d-97fb-42ad21764b21,DISK] 2023-08-18 21:52:48,833 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.meta.1692395568812.meta 2023-08-18 21:52:48,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40339,DS-cdc5c719-d871-4b3b-9893-ad129ee42e70,DISK], DatanodeInfoWithStorage[127.0.0.1:37027,DS-4368ed8d-fe43-4c6d-97fb-42ad21764b21,DISK]] 2023-08-18 21:52:48,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-18 21:52:48,836 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-18 21:52:48,854 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-18 21:52:48,859 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-18 21:52:48,864 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-18 21:52:48,865 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:52:48,865 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-18 21:52:48,865 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-18 21:52:48,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-18 21:52:48,870 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/info 2023-08-18 21:52:48,870 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/info 2023-08-18 21:52:48,871 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-18 21:52:48,873 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:52:48,873 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-18 21:52:48,875 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/rep_barrier 2023-08-18 21:52:48,875 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/rep_barrier 2023-08-18 21:52:48,876 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-18 21:52:48,878 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:52:48,878 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-18 21:52:48,880 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/table 2023-08-18 21:52:48,880 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/table 2023-08-18 21:52:48,880 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-18 21:52:48,882 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:52:48,884 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740 2023-08-18 21:52:48,888 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740 2023-08-18 21:52:48,892 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-18 21:52:48,895 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-18 21:52:48,896 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=870853, jitterRate=0.10734747350215912}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-18 21:52:48,897 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-18 21:52:48,906 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1692395568781 2023-08-18 21:52:48,924 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-18 21:52:48,926 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-18 21:52:48,926 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,40499,1692395567120, state=OPEN 2023-08-18 21:52:48,929 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-18 21:52:48,929 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-18 21:52:48,934 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-18 21:52:48,934 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,40499,1692395567120 in 323 msec 2023-08-18 21:52:48,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-18 21:52:48,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 511 msec 2023-08-18 21:52:48,949 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 746 msec 2023-08-18 21:52:48,949 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1692395568949, completionTime=-1 2023-08-18 21:52:48,949 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-18 21:52:48,950 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-18 21:52:49,025 DEBUG [hconnection-0x52599c40-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-18 21:52:49,029 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-18 21:52:49,048 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-18 21:52:49,048 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1692395629048 2023-08-18 21:52:49,048 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1692395689048 2023-08-18 21:52:49,048 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 97 msec 2023-08-18 21:52:49,075 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44051,1692395565280-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-18 21:52:49,075 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44051,1692395565280-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-18 21:52:49,075 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44051,1692395565280-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-18 21:52:49,077 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:44051, period=300000, unit=MILLISECONDS is enabled. 2023-08-18 21:52:49,077 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-18 21:52:49,086 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-18 21:52:49,093 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-18 21:52:49,094 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-18 21:52:49,105 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-18 21:52:49,108 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-18 21:52:49,112 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-18 21:52:49,137 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/.tmp/data/hbase/namespace/740f72a9deb37a233d8f74ce0024c298 2023-08-18 21:52:49,140 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/.tmp/data/hbase/namespace/740f72a9deb37a233d8f74ce0024c298 empty. 2023-08-18 21:52:49,141 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/.tmp/data/hbase/namespace/740f72a9deb37a233d8f74ce0024c298 2023-08-18 21:52:49,141 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-18 21:52:49,173 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-18 21:52:49,176 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 740f72a9deb37a233d8f74ce0024c298, NAME => 'hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/.tmp 2023-08-18 21:52:49,198 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:52:49,198 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 740f72a9deb37a233d8f74ce0024c298, disabling compactions & flushes 2023-08-18 21:52:49,198 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298. 2023-08-18 21:52:49,198 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298. 2023-08-18 21:52:49,199 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298. after waiting 0 ms 2023-08-18 21:52:49,199 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298. 2023-08-18 21:52:49,199 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298. 2023-08-18 21:52:49,199 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 740f72a9deb37a233d8f74ce0024c298: 2023-08-18 21:52:49,204 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-18 21:52:49,220 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692395569207"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692395569207"}]},"ts":"1692395569207"} 2023-08-18 21:52:49,250 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-18 21:52:49,253 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-18 21:52:49,257 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692395569253"}]},"ts":"1692395569253"} 2023-08-18 21:52:49,263 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-18 21:52:49,271 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=740f72a9deb37a233d8f74ce0024c298, ASSIGN}] 2023-08-18 21:52:49,276 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=740f72a9deb37a233d8f74ce0024c298, ASSIGN 2023-08-18 21:52:49,278 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=740f72a9deb37a233d8f74ce0024c298, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40499,1692395567120; forceNewPlan=false, retain=false 2023-08-18 21:52:49,429 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=740f72a9deb37a233d8f74ce0024c298, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40499,1692395567120 2023-08-18 21:52:49,430 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692395569429"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1692395569429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692395569429"}]},"ts":"1692395569429"} 2023-08-18 21:52:49,435 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 740f72a9deb37a233d8f74ce0024c298, server=jenkins-hbase20.apache.org,40499,1692395567120}] 2023-08-18 21:52:49,596 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298. 2023-08-18 21:52:49,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 740f72a9deb37a233d8f74ce0024c298, NAME => 'hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298.', STARTKEY => '', ENDKEY => ''} 2023-08-18 21:52:49,598 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 740f72a9deb37a233d8f74ce0024c298 2023-08-18 21:52:49,598 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:52:49,598 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 740f72a9deb37a233d8f74ce0024c298 2023-08-18 21:52:49,598 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 740f72a9deb37a233d8f74ce0024c298 2023-08-18 21:52:49,601 INFO [StoreOpener-740f72a9deb37a233d8f74ce0024c298-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 740f72a9deb37a233d8f74ce0024c298 2023-08-18 21:52:49,603 DEBUG [StoreOpener-740f72a9deb37a233d8f74ce0024c298-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/namespace/740f72a9deb37a233d8f74ce0024c298/info 2023-08-18 21:52:49,603 DEBUG [StoreOpener-740f72a9deb37a233d8f74ce0024c298-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/namespace/740f72a9deb37a233d8f74ce0024c298/info 2023-08-18 21:52:49,604 INFO [StoreOpener-740f72a9deb37a233d8f74ce0024c298-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 740f72a9deb37a233d8f74ce0024c298 columnFamilyName info 2023-08-18 21:52:49,605 INFO [StoreOpener-740f72a9deb37a233d8f74ce0024c298-1] regionserver.HStore(310): Store=740f72a9deb37a233d8f74ce0024c298/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:52:49,608 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/namespace/740f72a9deb37a233d8f74ce0024c298 2023-08-18 21:52:49,609 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/namespace/740f72a9deb37a233d8f74ce0024c298 2023-08-18 21:52:49,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 740f72a9deb37a233d8f74ce0024c298 2023-08-18 21:52:49,618 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/namespace/740f72a9deb37a233d8f74ce0024c298/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-18 21:52:49,620 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 740f72a9deb37a233d8f74ce0024c298; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=875408, jitterRate=0.11313885450363159}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-18 21:52:49,620 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 740f72a9deb37a233d8f74ce0024c298: 2023-08-18 21:52:49,622 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298., pid=6, masterSystemTime=1692395569589 2023-08-18 21:52:49,627 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298. 2023-08-18 21:52:49,627 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298. 2023-08-18 21:52:49,629 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=740f72a9deb37a233d8f74ce0024c298, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40499,1692395567120 2023-08-18 21:52:49,630 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692395569628"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1692395569628"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692395569628"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692395569628"}]},"ts":"1692395569628"} 2023-08-18 21:52:49,639 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-18 21:52:49,639 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 740f72a9deb37a233d8f74ce0024c298, server=jenkins-hbase20.apache.org,40499,1692395567120 in 199 msec 2023-08-18 21:52:49,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-18 21:52:49,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=740f72a9deb37a233d8f74ce0024c298, ASSIGN in 368 msec 2023-08-18 21:52:49,647 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-18 21:52:49,648 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692395569648"}]},"ts":"1692395569648"} 2023-08-18 21:52:49,652 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-18 21:52:49,655 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-18 21:52:49,659 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 561 msec 2023-08-18 21:52:49,708 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-18 21:52:49,709 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-18 21:52:49,709 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:52:49,749 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-18 21:52:49,773 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-18 21:52:49,782 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 41 msec 2023-08-18 21:52:49,795 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-18 21:52:49,808 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-18 21:52:49,814 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-08-18 21:52:49,822 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-18 21:52:49,824 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-18 21:52:49,826 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.624sec 2023-08-18 21:52:49,828 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-18 21:52:49,830 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-18 21:52:49,830 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-18 21:52:49,831 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44051,1692395565280-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-18 21:52:49,832 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44051,1692395565280-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-18 21:52:49,849 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-18 21:52:49,865 DEBUG [Listener at localhost/45463] zookeeper.ReadOnlyZKClient(139): Connect 0x4e199077 to 127.0.0.1:55402 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-18 21:52:49,870 DEBUG [Listener at localhost/45463] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b34f850, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-18 21:52:49,909 DEBUG [hconnection-0x5a203706-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-18 21:52:49,923 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35618, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-18 21:52:49,937 INFO [Listener at localhost/45463] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,44051,1692395565280 2023-08-18 21:52:49,937 INFO [Listener at localhost/45463] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:52:49,946 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-18 21:52:49,946 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:52:49,948 INFO [Listener at localhost/45463] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-18 21:52:49,972 WARN [Listener at localhost/45463] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-18 21:52:49,975 WARN [Listener at localhost/45463] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:52:49,977 INFO [Listener at localhost/45463] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:52:49,983 INFO [Listener at localhost/45463] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/java.io.tmpdir/Jetty_localhost_40317_datanode____.pf7abg/webapp 2023-08-18 21:52:50,092 INFO [Listener at localhost/45463] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40317 2023-08-18 21:52:50,107 WARN [Listener at localhost/40885] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:52:50,200 WARN [Listener at localhost/40885] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-18 21:52:50,206 WARN [Listener at localhost/40885] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:52:50,209 INFO [Listener at localhost/40885] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:52:50,217 INFO [Listener at localhost/40885] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/java.io.tmpdir/Jetty_localhost_37495_datanode____2wjexf/webapp 2023-08-18 21:52:50,290 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7539c7e918ce41fe: Processing first storage report for DS-24abf9bb-2e8f-41a0-91ff-ad8a76be8aa5 from datanode 994aa4c5-540c-4f53-a3f7-d020567bb865 2023-08-18 21:52:50,291 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7539c7e918ce41fe: from storage DS-24abf9bb-2e8f-41a0-91ff-ad8a76be8aa5 node DatanodeRegistration(127.0.0.1:39599, datanodeUuid=994aa4c5-540c-4f53-a3f7-d020567bb865, infoPort=43341, infoSecurePort=0, ipcPort=40885, storageInfo=lv=-57;cid=testClusterID;nsid=471510740;c=1692395561429), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:52:50,291 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7539c7e918ce41fe: Processing first storage report for DS-910b657f-05a9-41ab-a7d4-903ef6d5c6e1 from datanode 994aa4c5-540c-4f53-a3f7-d020567bb865 2023-08-18 21:52:50,291 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7539c7e918ce41fe: from storage DS-910b657f-05a9-41ab-a7d4-903ef6d5c6e1 node DatanodeRegistration(127.0.0.1:39599, datanodeUuid=994aa4c5-540c-4f53-a3f7-d020567bb865, infoPort=43341, infoSecurePort=0, ipcPort=40885, storageInfo=lv=-57;cid=testClusterID;nsid=471510740;c=1692395561429), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:52:50,355 INFO [Listener at localhost/40885] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37495 2023-08-18 21:52:50,434 WARN [Listener at localhost/41111] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:52:50,465 WARN [Listener at localhost/41111] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-18 21:52:50,468 WARN [Listener at localhost/41111] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:52:50,470 INFO [Listener at localhost/41111] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:52:50,485 INFO [Listener at localhost/41111] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/java.io.tmpdir/Jetty_localhost_36375_datanode____34xm9h/webapp 2023-08-18 21:52:50,553 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x40c675adb5948cb0: Processing first storage report for DS-f6037dd6-39d2-4618-8e12-530a762bd514 from datanode 79844d72-76af-49a5-85ac-6ed0d501b4d7 2023-08-18 21:52:50,553 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x40c675adb5948cb0: from storage DS-f6037dd6-39d2-4618-8e12-530a762bd514 node DatanodeRegistration(127.0.0.1:41421, datanodeUuid=79844d72-76af-49a5-85ac-6ed0d501b4d7, infoPort=36077, infoSecurePort=0, ipcPort=41111, storageInfo=lv=-57;cid=testClusterID;nsid=471510740;c=1692395561429), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:52:50,554 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x40c675adb5948cb0: Processing first storage report for DS-04ff34d7-e38e-4960-b641-e05249fd77d8 from datanode 79844d72-76af-49a5-85ac-6ed0d501b4d7 2023-08-18 21:52:50,554 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x40c675adb5948cb0: from storage DS-04ff34d7-e38e-4960-b641-e05249fd77d8 node DatanodeRegistration(127.0.0.1:41421, datanodeUuid=79844d72-76af-49a5-85ac-6ed0d501b4d7, infoPort=36077, infoSecurePort=0, ipcPort=41111, storageInfo=lv=-57;cid=testClusterID;nsid=471510740;c=1692395561429), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:52:50,578 INFO [Listener at localhost/41111] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36375 2023-08-18 21:52:50,590 WARN [Listener at localhost/40483] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:52:50,667 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5e3bc8d836015484: Processing first storage report for DS-3078144f-b3bb-4688-b441-9c2ba41a5089 from datanode 878c545f-0f9f-471a-b4ce-8c13aff3f07a 2023-08-18 21:52:50,667 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5e3bc8d836015484: from storage DS-3078144f-b3bb-4688-b441-9c2ba41a5089 node DatanodeRegistration(127.0.0.1:41079, datanodeUuid=878c545f-0f9f-471a-b4ce-8c13aff3f07a, infoPort=36185, infoSecurePort=0, ipcPort=40483, storageInfo=lv=-57;cid=testClusterID;nsid=471510740;c=1692395561429), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:52:50,667 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5e3bc8d836015484: Processing first storage report for DS-f0a44856-a3dc-49e6-8b80-b553c6560ccd from datanode 878c545f-0f9f-471a-b4ce-8c13aff3f07a 2023-08-18 21:52:50,667 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5e3bc8d836015484: from storage DS-f0a44856-a3dc-49e6-8b80-b553c6560ccd node DatanodeRegistration(127.0.0.1:41079, datanodeUuid=878c545f-0f9f-471a-b4ce-8c13aff3f07a, infoPort=36185, infoSecurePort=0, ipcPort=40483, storageInfo=lv=-57;cid=testClusterID;nsid=471510740;c=1692395561429), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:52:50,709 DEBUG [Listener at localhost/40483] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-18 21:52:50,712 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-18 21:52:50,719 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44051] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-18 21:52:50,719 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44051] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-18 21:52:50,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44051] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-18 21:52:50,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44051] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath 2023-08-18 21:52:50,726 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_PRE_OPERATION 2023-08-18 21:52:50,728 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-18 21:52:50,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44051] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRollOnDatanodeDeath" procId is: 9 2023-08-18 21:52:50,731 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/3f8f47c86c4dbf1bebede016e41cc73c 2023-08-18 21:52:50,732 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/3f8f47c86c4dbf1bebede016e41cc73c empty. 2023-08-18 21:52:50,734 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/3f8f47c86c4dbf1bebede016e41cc73c 2023-08-18 21:52:50,734 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRollOnDatanodeDeath regions 2023-08-18 21:52:50,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44051] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-18 21:52:50,757 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/.tabledesc/.tableinfo.0000000001 2023-08-18 21:52:50,758 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3f8f47c86c4dbf1bebede016e41cc73c, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/.tmp 2023-08-18 21:52:50,774 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:52:50,774 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1604): Closing 3f8f47c86c4dbf1bebede016e41cc73c, disabling compactions & flushes 2023-08-18 21:52:50,774 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c. 2023-08-18 21:52:50,774 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c. 2023-08-18 21:52:50,774 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c. after waiting 0 ms 2023-08-18 21:52:50,774 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c. 2023-08-18 21:52:50,774 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c. 2023-08-18 21:52:50,774 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1558): Region close journal for 3f8f47c86c4dbf1bebede016e41cc73c: 2023-08-18 21:52:50,778 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ADD_TO_META 2023-08-18 21:52:50,780 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1692395570779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692395570779"}]},"ts":"1692395570779"} 2023-08-18 21:52:50,782 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-18 21:52:50,784 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-18 21:52:50,784 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692395570784"}]},"ts":"1692395570784"} 2023-08-18 21:52:50,786 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLING in hbase:meta 2023-08-18 21:52:50,789 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=3f8f47c86c4dbf1bebede016e41cc73c, ASSIGN}] 2023-08-18 21:52:50,791 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=3f8f47c86c4dbf1bebede016e41cc73c, ASSIGN 2023-08-18 21:52:50,795 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=3f8f47c86c4dbf1bebede016e41cc73c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40499,1692395567120; forceNewPlan=false, retain=false 2023-08-18 21:52:50,947 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=3f8f47c86c4dbf1bebede016e41cc73c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40499,1692395567120 2023-08-18 21:52:50,947 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1692395570946"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1692395570946"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692395570946"}]},"ts":"1692395570946"} 2023-08-18 21:52:50,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 3f8f47c86c4dbf1bebede016e41cc73c, server=jenkins-hbase20.apache.org,40499,1692395567120}] 2023-08-18 21:52:51,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c. 2023-08-18 21:52:51,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3f8f47c86c4dbf1bebede016e41cc73c, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c.', STARTKEY => '', ENDKEY => ''} 2023-08-18 21:52:51,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRollOnDatanodeDeath 3f8f47c86c4dbf1bebede016e41cc73c 2023-08-18 21:52:51,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:52:51,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3f8f47c86c4dbf1bebede016e41cc73c 2023-08-18 21:52:51,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3f8f47c86c4dbf1bebede016e41cc73c 2023-08-18 21:52:51,114 INFO [StoreOpener-3f8f47c86c4dbf1bebede016e41cc73c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3f8f47c86c4dbf1bebede016e41cc73c 2023-08-18 21:52:51,116 DEBUG [StoreOpener-3f8f47c86c4dbf1bebede016e41cc73c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/3f8f47c86c4dbf1bebede016e41cc73c/info 2023-08-18 21:52:51,116 DEBUG [StoreOpener-3f8f47c86c4dbf1bebede016e41cc73c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/3f8f47c86c4dbf1bebede016e41cc73c/info 2023-08-18 21:52:51,117 INFO [StoreOpener-3f8f47c86c4dbf1bebede016e41cc73c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f8f47c86c4dbf1bebede016e41cc73c columnFamilyName info 2023-08-18 21:52:51,117 INFO [StoreOpener-3f8f47c86c4dbf1bebede016e41cc73c-1] regionserver.HStore(310): Store=3f8f47c86c4dbf1bebede016e41cc73c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:52:51,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/3f8f47c86c4dbf1bebede016e41cc73c 2023-08-18 21:52:51,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/3f8f47c86c4dbf1bebede016e41cc73c 2023-08-18 21:52:51,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3f8f47c86c4dbf1bebede016e41cc73c 2023-08-18 21:52:51,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/3f8f47c86c4dbf1bebede016e41cc73c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-18 21:52:51,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3f8f47c86c4dbf1bebede016e41cc73c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=726376, jitterRate=-0.07636533677577972}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-18 21:52:51,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3f8f47c86c4dbf1bebede016e41cc73c: 2023-08-18 21:52:51,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c., pid=11, masterSystemTime=1692395571103 2023-08-18 21:52:51,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c. 2023-08-18 21:52:51,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c. 2023-08-18 21:52:51,131 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=3f8f47c86c4dbf1bebede016e41cc73c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40499,1692395567120 2023-08-18 21:52:51,131 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1692395571131"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1692395571131"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692395571131"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692395571131"}]},"ts":"1692395571131"} 2023-08-18 21:52:51,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-18 21:52:51,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 3f8f47c86c4dbf1bebede016e41cc73c, server=jenkins-hbase20.apache.org,40499,1692395567120 in 184 msec 2023-08-18 21:52:51,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-18 21:52:51,141 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=3f8f47c86c4dbf1bebede016e41cc73c, ASSIGN in 348 msec 2023-08-18 21:52:51,142 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-18 21:52:51,142 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692395571142"}]},"ts":"1692395571142"} 2023-08-18 21:52:51,144 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLED in hbase:meta 2023-08-18 21:52:51,146 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_POST_OPERATION 2023-08-18 21:52:51,149 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath in 425 msec 2023-08-18 21:52:54,418 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-18 21:52:54,523 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-18 21:52:54,524 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-18 21:52:54,525 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRollOnDatanodeDeath' 2023-08-18 21:52:55,499 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-18 21:52:55,500 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-08-18 21:53:00,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44051] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-18 21:53:00,747 INFO [Listener at localhost/40483] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRollOnDatanodeDeath, procId: 9 completed 2023-08-18 21:53:00,747 DEBUG [Listener at localhost/40483] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestLogRolling-testLogRollOnDatanodeDeath get assigned. Timeout = 60000ms 2023-08-18 21:53:00,749 INFO [Listener at localhost/40483] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-08-18 21:53:00,754 INFO [Listener at localhost/40483] hbase.HBaseTestingUtility(3484): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned to meta. Checking AM states. 2023-08-18 21:53:00,754 INFO [Listener at localhost/40483] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-08-18 21:53:00,754 INFO [Listener at localhost/40483] hbase.HBaseTestingUtility(3504): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned. 2023-08-18 21:53:00,767 DEBUG [Listener at localhost/40483] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRollOnDatanodeDeath 2023-08-18 21:53:00,768 DEBUG [Listener at localhost/40483] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c. 2023-08-18 21:53:00,768 WARN [Listener at localhost/40483] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-18 21:53:00,771 INFO [Listener at localhost/40483] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:53:00,776 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-2027390183_17 at /127.0.0.1:60088 [Receiving block BP-296827425-148.251.75.209-1692395561429:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:37027:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:60088 dst: /127.0.0.1:37027 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:53:00,776 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-2027390183_17 at /127.0.0.1:60094 [Receiving block BP-296827425-148.251.75.209-1692395561429:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:37027:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:60094 dst: /127.0.0.1:37027 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:53:00,776 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_581977794_17 at /127.0.0.1:60050 [Receiving block BP-296827425-148.251.75.209-1692395561429:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:37027:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:60050 dst: /127.0.0.1:37027 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:53:00,875 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_581977794_17 at /127.0.0.1:57120 [Receiving block BP-296827425-148.251.75.209-1692395561429:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:40339:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:57120 dst: /127.0.0.1:40339 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:53:00,876 WARN [BP-296827425-148.251.75.209-1692395561429 heartbeating to localhost/127.0.0.1:35033] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-18 21:53:00,876 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-2027390183_17 at /127.0.0.1:57168 [Receiving block BP-296827425-148.251.75.209-1692395561429:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:40339:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:57168 dst: /127.0.0.1:40339 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:53:00,876 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-2027390183_17 at /127.0.0.1:57154 [Receiving block BP-296827425-148.251.75.209-1692395561429:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:40339:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:57154 dst: /127.0.0.1:40339 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:53:00,877 WARN [BP-296827425-148.251.75.209-1692395561429 heartbeating to localhost/127.0.0.1:35033] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-296827425-148.251.75.209-1692395561429 (Datanode Uuid c7d721b6-b27e-4d16-9576-e1cc508e9aea) service to localhost/127.0.0.1:35033 2023-08-18 21:53:00,882 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de/dfs/data/data3/current/BP-296827425-148.251.75.209-1692395561429] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:53:00,883 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de/dfs/data/data4/current/BP-296827425-148.251.75.209-1692395561429] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:53:00,894 WARN [Listener at localhost/40483] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-18 21:53:00,897 WARN [Listener at localhost/40483] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:53:00,899 INFO [Listener at localhost/40483] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:53:00,903 INFO [Listener at localhost/40483] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/java.io.tmpdir/Jetty_localhost_38983_datanode____.4vhpnu/webapp 2023-08-18 21:53:00,979 INFO [Listener at localhost/40483] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38983 2023-08-18 21:53:00,988 WARN [Listener at localhost/43807] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:53:00,993 WARN [AsyncFSWAL-0-hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d-prefix:jenkins-hbase20.apache.org,40499,1692395567120] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:53:00,995 DEBUG [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase20.apache.org%2C40499%2C1692395567120:(num 1692395568696) roll requested 2023-08-18 21:53:01,019 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39599,DS-24abf9bb-2e8f-41a0-91ff-ad8a76be8aa5,DISK] 2023-08-18 21:53:01,019 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41079,DS-3078144f-b3bb-4688-b441-9c2ba41a5089,DISK] 2023-08-18 21:53:01,025 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.1692395568696 with entries=6, filesize=3.20 KB; new WAL /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.1692395580995 2023-08-18 21:53:01,026 DEBUG [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41079,DS-3078144f-b3bb-4688-b441-9c2ba41a5089,DISK], DatanodeInfoWithStorage[127.0.0.1:39599,DS-24abf9bb-2e8f-41a0-91ff-ad8a76be8aa5,DISK]] 2023-08-18 21:53:01,026 DEBUG [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.1692395568696 is not closed yet, will try archiving it next time 2023-08-18 21:53:01,028 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-18 21:53:01,028 INFO [Listener at localhost/43807] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-18 21:53:01,030 DEBUG [Listener at localhost/43807] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e199077 to 127.0.0.1:55402 2023-08-18 21:53:01,030 DEBUG [Listener at localhost/43807] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:53:01,030 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:53:01,030 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:53:01,031 DEBUG [Listener at localhost/43807] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-18 21:53:01,031 DEBUG [Listener at localhost/43807] util.JVMClusterUtil(257): Found active master hash=1439279266, stopped=false 2023-08-18 21:53:01,031 INFO [Listener at localhost/43807] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,44051,1692395565280 2023-08-18 21:53:01,033 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-18 21:53:01,033 INFO [Listener at localhost/43807] procedure2.ProcedureExecutor(629): Stopping 2023-08-18 21:53:01,033 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:53:01,033 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): regionserver:40499-0x1000ce5be360001, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-18 21:53:01,034 DEBUG [Listener at localhost/43807] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1db0b14b to 127.0.0.1:55402 2023-08-18 21:53:01,034 DEBUG [Listener at localhost/43807] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:53:01,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:53:01,035 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.1692395568696 2023-08-18 21:53:01,035 INFO [Listener at localhost/43807] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,40499,1692395567120' ***** 2023-08-18 21:53:01,035 INFO [Listener at localhost/43807] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-18 21:53:01,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40499-0x1000ce5be360001, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:53:01,035 INFO [RS:0;jenkins-hbase20:40499] regionserver.HeapMemoryManager(220): Stopping 2023-08-18 21:53:01,036 INFO [RS:0;jenkins-hbase20:40499] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-18 21:53:01,036 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-18 21:53:01,036 INFO [RS:0;jenkins-hbase20:40499] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-18 21:53:01,037 INFO [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(3305): Received CLOSE for 740f72a9deb37a233d8f74ce0024c298 2023-08-18 21:53:01,038 INFO [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(3305): Received CLOSE for 3f8f47c86c4dbf1bebede016e41cc73c 2023-08-18 21:53:01,038 INFO [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,40499,1692395567120 2023-08-18 21:53:01,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 740f72a9deb37a233d8f74ce0024c298, disabling compactions & flushes 2023-08-18 21:53:01,039 DEBUG [RS:0;jenkins-hbase20:40499] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c479fcf to 127.0.0.1:55402 2023-08-18 21:53:01,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298. 2023-08-18 21:53:01,039 DEBUG [RS:0;jenkins-hbase20:40499] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:53:01,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298. 2023-08-18 21:53:01,039 INFO [RS:0;jenkins-hbase20:40499] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-18 21:53:01,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298. after waiting 0 ms 2023-08-18 21:53:01,039 INFO [RS:0;jenkins-hbase20:40499] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-18 21:53:01,039 INFO [RS:0;jenkins-hbase20:40499] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-18 21:53:01,040 INFO [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-18 21:53:01,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298. 2023-08-18 21:53:01,040 INFO [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-08-18 21:53:01,041 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-18 21:53:01,041 DEBUG [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(1478): Online Regions={740f72a9deb37a233d8f74ce0024c298=hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298., 1588230740=hbase:meta,,1.1588230740, 3f8f47c86c4dbf1bebede016e41cc73c=TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c.} 2023-08-18 21:53:01,041 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-18 21:53:01,041 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-18 21:53:01,041 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-18 21:53:01,041 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-18 21:53:01,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 740f72a9deb37a233d8f74ce0024c298 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-18 21:53:01,042 WARN [IPC Server handler 1 on default port 35033] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.1692395568696 has not been closed. Lease recovery is in progress. RecoveryId = 1015 for block blk_1073741832_1008 2023-08-18 21:53:01,042 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.93 KB heapSize=5.45 KB 2023-08-18 21:53:01,042 DEBUG [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(1504): Waiting on 1588230740, 3f8f47c86c4dbf1bebede016e41cc73c, 740f72a9deb37a233d8f74ce0024c298 2023-08-18 21:53:01,045 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.1692395568696 after 10ms 2023-08-18 21:53:01,052 WARN [AsyncFSWAL-0-hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d-prefix:jenkins-hbase20.apache.org,40499,1692395567120.meta] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:53:01,054 DEBUG [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase20.apache.org%2C40499%2C1692395567120.meta:.meta(num 1692395568812) roll requested 2023-08-18 21:53:01,078 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37027,DS-4368ed8d-fe43-4c6d-97fb-42ad21764b21,DISK] 2023-08-18 21:53:01,091 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41421,DS-f6037dd6-39d2-4618-8e12-530a762bd514,DISK] 2023-08-18 21:53:01,104 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.meta.1692395568812.meta with entries=12, filesize=3.87 KB; new WAL /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.meta.1692395581054.meta 2023-08-18 21:53:01,107 DEBUG [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37027,DS-4368ed8d-fe43-4c6d-97fb-42ad21764b21,DISK], DatanodeInfoWithStorage[127.0.0.1:41421,DS-f6037dd6-39d2-4618-8e12-530a762bd514,DISK]] 2023-08-18 21:53:01,108 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:53:01,109 DEBUG [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.meta.1692395568812.meta is not closed yet, will try archiving it next time 2023-08-18 21:53:01,110 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:53:01,111 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.meta.1692395568812.meta 2023-08-18 21:53:01,112 WARN [IPC Server handler 0 on default port 35033] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.meta.1692395568812.meta has not been closed. Lease recovery is in progress. RecoveryId = 1017 for block blk_1073741833_1009 2023-08-18 21:53:01,113 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.meta.1692395568812.meta after 2ms 2023-08-18 21:53:01,125 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4fe6b4cc6e05c205: Processing first storage report for DS-cdc5c719-d871-4b3b-9893-ad129ee42e70 from datanode c7d721b6-b27e-4d16-9576-e1cc508e9aea 2023-08-18 21:53:01,126 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4fe6b4cc6e05c205: from storage DS-cdc5c719-d871-4b3b-9893-ad129ee42e70 node DatanodeRegistration(127.0.0.1:46265, datanodeUuid=c7d721b6-b27e-4d16-9576-e1cc508e9aea, infoPort=36319, infoSecurePort=0, ipcPort=43807, storageInfo=lv=-57;cid=testClusterID;nsid=471510740;c=1692395561429), blocks: 6, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-18 21:53:01,127 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4fe6b4cc6e05c205: Processing first storage report for DS-24b1fcc2-938d-4ca0-81c6-76ee908b80f6 from datanode c7d721b6-b27e-4d16-9576-e1cc508e9aea 2023-08-18 21:53:01,128 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4fe6b4cc6e05c205: from storage DS-24b1fcc2-938d-4ca0-81c6-76ee908b80f6 node DatanodeRegistration(127.0.0.1:46265, datanodeUuid=c7d721b6-b27e-4d16-9576-e1cc508e9aea, infoPort=36319, infoSecurePort=0, ipcPort=43807, storageInfo=lv=-57;cid=testClusterID;nsid=471510740;c=1692395561429), blocks: 6, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:53:01,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/namespace/740f72a9deb37a233d8f74ce0024c298/.tmp/info/106adeaaeacf4d9093912324bfe8a77c 2023-08-18 21:53:01,174 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.69 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/.tmp/info/6af046e99605422ea9e2103ec6cebdb1 2023-08-18 21:53:01,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/namespace/740f72a9deb37a233d8f74ce0024c298/.tmp/info/106adeaaeacf4d9093912324bfe8a77c as hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/namespace/740f72a9deb37a233d8f74ce0024c298/info/106adeaaeacf4d9093912324bfe8a77c 2023-08-18 21:53:01,243 DEBUG [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(1504): Waiting on 1588230740, 3f8f47c86c4dbf1bebede016e41cc73c, 740f72a9deb37a233d8f74ce0024c298 2023-08-18 21:53:01,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/namespace/740f72a9deb37a233d8f74ce0024c298/info/106adeaaeacf4d9093912324bfe8a77c, entries=2, sequenceid=6, filesize=4.8 K 2023-08-18 21:53:01,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 740f72a9deb37a233d8f74ce0024c298 in 217ms, sequenceid=6, compaction requested=false 2023-08-18 21:53:01,276 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=240 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/.tmp/table/e1aa3223463340dfa99913857aa6de6a 2023-08-18 21:53:01,287 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/.tmp/info/6af046e99605422ea9e2103ec6cebdb1 as hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/info/6af046e99605422ea9e2103ec6cebdb1 2023-08-18 21:53:01,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/namespace/740f72a9deb37a233d8f74ce0024c298/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-18 21:53:01,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298. 2023-08-18 21:53:01,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 740f72a9deb37a233d8f74ce0024c298: 2023-08-18 21:53:01,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1692395569093.740f72a9deb37a233d8f74ce0024c298. 2023-08-18 21:53:01,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3f8f47c86c4dbf1bebede016e41cc73c, disabling compactions & flushes 2023-08-18 21:53:01,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c. 2023-08-18 21:53:01,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c. 2023-08-18 21:53:01,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c. after waiting 0 ms 2023-08-18 21:53:01,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c. 2023-08-18 21:53:01,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 3f8f47c86c4dbf1bebede016e41cc73c 1/1 column families, dataSize=2.05 KB heapSize=2.45 KB 2023-08-18 21:53:01,300 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/info/6af046e99605422ea9e2103ec6cebdb1, entries=20, sequenceid=14, filesize=7.4 K 2023-08-18 21:53:01,302 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/.tmp/table/e1aa3223463340dfa99913857aa6de6a as hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/table/e1aa3223463340dfa99913857aa6de6a 2023-08-18 21:53:01,312 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/table/e1aa3223463340dfa99913857aa6de6a, entries=4, sequenceid=14, filesize=4.8 K 2023-08-18 21:53:01,316 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/2998, heapSize ~5.16 KB/5288, currentSize=0 B/0 for 1588230740 in 275ms, sequenceid=14, compaction requested=false 2023-08-18 21:53:01,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.05 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/3f8f47c86c4dbf1bebede016e41cc73c/.tmp/info/bc19264179364be2b062496882a0acf5 2023-08-18 21:53:01,348 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-08-18 21:53:01,349 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-18 21:53:01,350 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-18 21:53:01,351 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-18 21:53:01,351 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-18 21:53:01,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/3f8f47c86c4dbf1bebede016e41cc73c/.tmp/info/bc19264179364be2b062496882a0acf5 as hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/3f8f47c86c4dbf1bebede016e41cc73c/info/bc19264179364be2b062496882a0acf5 2023-08-18 21:53:01,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/3f8f47c86c4dbf1bebede016e41cc73c/info/bc19264179364be2b062496882a0acf5, entries=2, sequenceid=6, filesize=6.8 K 2023-08-18 21:53:01,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.05 KB/2102, heapSize ~2.44 KB/2496, currentSize=0 B/0 for 3f8f47c86c4dbf1bebede016e41cc73c in 77ms, sequenceid=6, compaction requested=false 2023-08-18 21:53:01,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/data/default/TestLogRolling-testLogRollOnDatanodeDeath/3f8f47c86c4dbf1bebede016e41cc73c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-18 21:53:01,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c. 2023-08-18 21:53:01,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3f8f47c86c4dbf1bebede016e41cc73c: 2023-08-18 21:53:01,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1692395570718.3f8f47c86c4dbf1bebede016e41cc73c. 2023-08-18 21:53:01,443 INFO [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,40499,1692395567120; all regions closed. 2023-08-18 21:53:01,544 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-08-18 21:53:01,545 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-08-18 21:53:02,545 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-18 21:53:05,047 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.1692395568696 after 4012ms 2023-08-18 21:53:05,050 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.1692395568696 to hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/oldWALs/jenkins-hbase20.apache.org%2C40499%2C1692395567120.1692395568696 2023-08-18 21:53:05,114 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.meta.1692395568812.meta after 4003ms 2023-08-18 21:53:05,115 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.meta.1692395568812.meta to hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/oldWALs/jenkins-hbase20.apache.org%2C40499%2C1692395567120.meta.1692395568812.meta 2023-08-18 21:53:05,122 DEBUG [RS:0;jenkins-hbase20:40499] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/oldWALs 2023-08-18 21:53:05,122 INFO [RS:0;jenkins-hbase20:40499] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C40499%2C1692395567120.meta:.meta(num 1692395581054) 2023-08-18 21:53:05,126 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/WALs/jenkins-hbase20.apache.org,40499,1692395567120/jenkins-hbase20.apache.org%2C40499%2C1692395567120.1692395580995 not finished, retry = 0 2023-08-18 21:53:05,239 DEBUG [RS:0;jenkins-hbase20:40499] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/oldWALs 2023-08-18 21:53:05,239 INFO [RS:0;jenkins-hbase20:40499] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C40499%2C1692395567120:(num 1692395580995) 2023-08-18 21:53:05,239 DEBUG [RS:0;jenkins-hbase20:40499] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:53:05,239 INFO [RS:0;jenkins-hbase20:40499] regionserver.LeaseManager(133): Closed leases 2023-08-18 21:53:05,240 INFO [RS:0;jenkins-hbase20:40499] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-08-18 21:53:05,240 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-18 21:53:05,241 INFO [RS:0;jenkins-hbase20:40499] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:40499 2023-08-18 21:53:05,248 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): regionserver:40499-0x1000ce5be360001, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,40499,1692395567120 2023-08-18 21:53:05,248 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-18 21:53:05,248 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): regionserver:40499-0x1000ce5be360001, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-18 21:53:05,249 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,40499,1692395567120] 2023-08-18 21:53:05,250 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,40499,1692395567120; numProcessing=1 2023-08-18 21:53:05,251 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,40499,1692395567120 already deleted, retry=false 2023-08-18 21:53:05,251 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,40499,1692395567120 expired; onlineServers=0 2023-08-18 21:53:05,251 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,44051,1692395565280' ***** 2023-08-18 21:53:05,251 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-18 21:53:05,252 DEBUG [M:0;jenkins-hbase20:44051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14f4a299, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-08-18 21:53:05,252 INFO [M:0;jenkins-hbase20:44051] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,44051,1692395565280 2023-08-18 21:53:05,252 INFO [M:0;jenkins-hbase20:44051] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,44051,1692395565280; all regions closed. 2023-08-18 21:53:05,252 DEBUG [M:0;jenkins-hbase20:44051] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:53:05,252 DEBUG [M:0;jenkins-hbase20:44051] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-18 21:53:05,252 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-18 21:53:05,252 DEBUG [M:0;jenkins-hbase20:44051] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-18 21:53:05,252 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1692395568323] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1692395568323,5,FailOnTimeoutGroup] 2023-08-18 21:53:05,252 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1692395568329] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1692395568329,5,FailOnTimeoutGroup] 2023-08-18 21:53:05,253 INFO [M:0;jenkins-hbase20:44051] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-18 21:53:05,253 INFO [M:0;jenkins-hbase20:44051] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-18 21:53:05,254 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-18 21:53:05,254 INFO [M:0;jenkins-hbase20:44051] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-08-18 21:53:05,254 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:53:05,254 DEBUG [M:0;jenkins-hbase20:44051] master.HMaster(1512): Stopping service threads 2023-08-18 21:53:05,254 INFO [M:0;jenkins-hbase20:44051] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-18 21:53:05,255 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-18 21:53:05,255 ERROR [M:0;jenkins-hbase20:44051] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] 2023-08-18 21:53:05,255 INFO [M:0;jenkins-hbase20:44051] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-18 21:53:05,255 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-18 21:53:05,256 DEBUG [M:0;jenkins-hbase20:44051] zookeeper.ZKUtil(398): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-18 21:53:05,256 WARN [M:0;jenkins-hbase20:44051] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-18 21:53:05,256 INFO [M:0;jenkins-hbase20:44051] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-18 21:53:05,256 INFO [M:0;jenkins-hbase20:44051] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-18 21:53:05,256 DEBUG [M:0;jenkins-hbase20:44051] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-18 21:53:05,256 INFO [M:0;jenkins-hbase20:44051] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:53:05,256 DEBUG [M:0;jenkins-hbase20:44051] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:53:05,257 DEBUG [M:0;jenkins-hbase20:44051] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-18 21:53:05,257 DEBUG [M:0;jenkins-hbase20:44051] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:53:05,257 INFO [M:0;jenkins-hbase20:44051] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.13 KB heapSize=45.77 KB 2023-08-18 21:53:05,257 WARN [AsyncFSWAL-0-hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData-prefix:jenkins-hbase20.apache.org,44051,1692395565280] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:53:05,258 DEBUG [master:store-WAL-Roller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase20.apache.org%2C44051%2C1692395565280:(num 1692395567620) roll requested 2023-08-18 21:53:05,274 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39599,DS-24abf9bb-2e8f-41a0-91ff-ad8a76be8aa5,DISK] 2023-08-18 21:53:05,274 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41421,DS-f6037dd6-39d2-4618-8e12-530a762bd514,DISK] 2023-08-18 21:53:05,282 INFO [master:store-WAL-Roller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/WALs/jenkins-hbase20.apache.org,44051,1692395565280/jenkins-hbase20.apache.org%2C44051%2C1692395565280.1692395567620 with entries=89, filesize=43.98 KB; new WAL /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/WALs/jenkins-hbase20.apache.org,44051,1692395565280/jenkins-hbase20.apache.org%2C44051%2C1692395565280.1692395585258 2023-08-18 21:53:05,282 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39599,DS-24abf9bb-2e8f-41a0-91ff-ad8a76be8aa5,DISK], DatanodeInfoWithStorage[127.0.0.1:41421,DS-f6037dd6-39d2-4618-8e12-530a762bd514,DISK]] 2023-08-18 21:53:05,282 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(716): hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/WALs/jenkins-hbase20.apache.org,44051,1692395565280/jenkins-hbase20.apache.org%2C44051%2C1692395565280.1692395567620 is not closed yet, will try archiving it next time 2023-08-18 21:53:05,282 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:53:05,282 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-18 21:53:05,283 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/WALs/jenkins-hbase20.apache.org,44051,1692395565280/jenkins-hbase20.apache.org%2C44051%2C1692395565280.1692395567620 2023-08-18 21:53:05,284 WARN [IPC Server handler 1 on default port 35033] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/WALs/jenkins-hbase20.apache.org,44051,1692395565280/jenkins-hbase20.apache.org%2C44051%2C1692395565280.1692395567620 has not been closed. Lease recovery is in progress. RecoveryId = 1023 for block blk_1073741829_1005 2023-08-18 21:53:05,284 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/WALs/jenkins-hbase20.apache.org,44051,1692395565280/jenkins-hbase20.apache.org%2C44051%2C1692395565280.1692395567620 after 1ms 2023-08-18 21:53:05,300 INFO [M:0;jenkins-hbase20:44051] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.13 KB at sequenceid=91 (bloomFilter=true), to=hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/444c620d544d4750bb4fdc56e0187d9d 2023-08-18 21:53:05,308 DEBUG [M:0;jenkins-hbase20:44051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/444c620d544d4750bb4fdc56e0187d9d as hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/444c620d544d4750bb4fdc56e0187d9d 2023-08-18 21:53:05,315 INFO [M:0;jenkins-hbase20:44051] regionserver.HStore(1080): Added hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/444c620d544d4750bb4fdc56e0187d9d, entries=11, sequenceid=91, filesize=7.0 K 2023-08-18 21:53:05,317 INFO [M:0;jenkins-hbase20:44051] regionserver.HRegion(2948): Finished flush of dataSize ~38.13 KB/39047, heapSize ~45.75 KB/46848, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 59ms, sequenceid=91, compaction requested=false 2023-08-18 21:53:05,318 INFO [M:0;jenkins-hbase20:44051] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:53:05,318 DEBUG [M:0;jenkins-hbase20:44051] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-18 21:53:05,350 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): regionserver:40499-0x1000ce5be360001, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:53:05,350 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): regionserver:40499-0x1000ce5be360001, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:53:05,350 INFO [RS:0;jenkins-hbase20:40499] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,40499,1692395567120; zookeeper connection closed. 2023-08-18 21:53:05,351 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4b57efb7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4b57efb7 2023-08-18 21:53:05,351 INFO [Listener at localhost/43807] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-18 21:53:05,499 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-18 21:53:06,833 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-18 21:53:09,287 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/WALs/jenkins-hbase20.apache.org,44051,1692395565280/jenkins-hbase20.apache.org%2C44051%2C1692395565280.1692395567620 after 4004ms 2023-08-18 21:53:09,288 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/WALs/jenkins-hbase20.apache.org,44051,1692395565280/jenkins-hbase20.apache.org%2C44051%2C1692395565280.1692395567620 to hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/oldWALs/jenkins-hbase20.apache.org%2C44051%2C1692395565280.1692395567620 2023-08-18 21:53:09,299 INFO [WAL-Archive-0] region.MasterRegionUtils(50): Moved hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/MasterData/oldWALs/jenkins-hbase20.apache.org%2C44051%2C1692395565280.1692395567620 to hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/oldWALs/jenkins-hbase20.apache.org%2C44051%2C1692395565280.1692395567620$masterlocalwal$ 2023-08-18 21:53:09,299 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-18 21:53:09,299 INFO [M:0;jenkins-hbase20:44051] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-18 21:53:09,300 INFO [M:0;jenkins-hbase20:44051] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44051 2023-08-18 21:53:09,302 DEBUG [M:0;jenkins-hbase20:44051] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,44051,1692395565280 already deleted, retry=false 2023-08-18 21:53:09,404 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:53:09,404 DEBUG [Listener at localhost/45463-EventThread] zookeeper.ZKWatcher(600): master:44051-0x1000ce5be360000, quorum=127.0.0.1:55402, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:53:09,404 INFO [M:0;jenkins-hbase20:44051] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,44051,1692395565280; zookeeper connection closed. 2023-08-18 21:53:09,407 WARN [Listener at localhost/43807] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-18 21:53:09,417 INFO [Listener at localhost/43807] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:53:09,525 WARN [BP-296827425-148.251.75.209-1692395561429 heartbeating to localhost/127.0.0.1:35033] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-18 21:53:09,525 WARN [BP-296827425-148.251.75.209-1692395561429 heartbeating to localhost/127.0.0.1:35033] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-296827425-148.251.75.209-1692395561429 (Datanode Uuid c7d721b6-b27e-4d16-9576-e1cc508e9aea) service to localhost/127.0.0.1:35033 2023-08-18 21:53:09,527 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de/dfs/data/data3/current/BP-296827425-148.251.75.209-1692395561429] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:53:09,528 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de/dfs/data/data4/current/BP-296827425-148.251.75.209-1692395561429] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:53:09,530 WARN [Listener at localhost/43807] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-18 21:53:09,534 INFO [Listener at localhost/43807] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:53:09,641 WARN [BP-296827425-148.251.75.209-1692395561429 heartbeating to localhost/127.0.0.1:35033] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-18 21:53:09,641 WARN [BP-296827425-148.251.75.209-1692395561429 heartbeating to localhost/127.0.0.1:35033] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-296827425-148.251.75.209-1692395561429 (Datanode Uuid 878c545f-0f9f-471a-b4ce-8c13aff3f07a) service to localhost/127.0.0.1:35033 2023-08-18 21:53:09,642 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de/dfs/data/data9/current/BP-296827425-148.251.75.209-1692395561429] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:53:09,643 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de/dfs/data/data10/current/BP-296827425-148.251.75.209-1692395561429] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:53:09,645 WARN [Listener at localhost/43807] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-18 21:53:09,650 INFO [Listener at localhost/43807] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:53:09,756 WARN [BP-296827425-148.251.75.209-1692395561429 heartbeating to localhost/127.0.0.1:35033] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-18 21:53:09,756 WARN [BP-296827425-148.251.75.209-1692395561429 heartbeating to localhost/127.0.0.1:35033] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-296827425-148.251.75.209-1692395561429 (Datanode Uuid 79844d72-76af-49a5-85ac-6ed0d501b4d7) service to localhost/127.0.0.1:35033 2023-08-18 21:53:09,757 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de/dfs/data/data7/current/BP-296827425-148.251.75.209-1692395561429] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:53:09,758 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de/dfs/data/data8/current/BP-296827425-148.251.75.209-1692395561429] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:53:09,761 WARN [Listener at localhost/43807] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-18 21:53:09,765 INFO [Listener at localhost/43807] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:53:09,873 WARN [BP-296827425-148.251.75.209-1692395561429 heartbeating to localhost/127.0.0.1:35033] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-18 21:53:09,873 WARN [BP-296827425-148.251.75.209-1692395561429 heartbeating to localhost/127.0.0.1:35033] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-296827425-148.251.75.209-1692395561429 (Datanode Uuid 994aa4c5-540c-4f53-a3f7-d020567bb865) service to localhost/127.0.0.1:35033 2023-08-18 21:53:09,874 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de/dfs/data/data5/current/BP-296827425-148.251.75.209-1692395561429] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:53:09,875 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de/dfs/data/data6/current/BP-296827425-148.251.75.209-1692395561429] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:53:09,877 WARN [Listener at localhost/43807] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-18 21:53:09,882 INFO [Listener at localhost/43807] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:53:09,985 WARN [BP-296827425-148.251.75.209-1692395561429 heartbeating to localhost/127.0.0.1:35033] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-18 21:53:09,985 WARN [BP-296827425-148.251.75.209-1692395561429 heartbeating to localhost/127.0.0.1:35033] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-296827425-148.251.75.209-1692395561429 (Datanode Uuid 909a1899-aa8e-4790-a382-6fccbb9b6666) service to localhost/127.0.0.1:35033 2023-08-18 21:53:09,987 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de/dfs/data/data1/current/BP-296827425-148.251.75.209-1692395561429] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:53:09,988 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/cluster_a4429e06-9258-b1ab-322d-d5e7d53a60de/dfs/data/data2/current/BP-296827425-148.251.75.209-1692395561429] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:53:10,021 INFO [Listener at localhost/43807] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:53:10,144 INFO [Listener at localhost/43807] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-18 21:53:10,184 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-18 21:53:10,194 INFO [Listener at localhost/43807] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=78 (was 10) Potentially hanging thread: IPC Client (189195492) connection to localhost/127.0.0.1:35033 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (189195492) connection to localhost/127.0.0.1:35033 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@288f8580 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (189195492) connection to localhost/127.0.0.1:35033 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43807 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35033 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:35033 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=465 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=286 (was 316), ProcessCount=168 (was 171), AvailableMemoryMB=3167 (was 4566) 2023-08-18 21:53:10,204 INFO [Listener at localhost/43807] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=78, OpenFileDescriptor=465, MaxFileDescriptor=60000, SystemLoadAverage=286, ProcessCount=168, AvailableMemoryMB=3166 2023-08-18 21:53:10,205 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-18 21:53:10,205 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/hadoop.log.dir so I do NOT create it in target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9 2023-08-18 21:53:10,205 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/de7778b2-48bb-65d8-2369-a707dfeb0ac4/hadoop.tmp.dir so I do NOT create it in target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9 2023-08-18 21:53:10,205 INFO [Listener at localhost/43807] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/cluster_b6998cf1-c11b-3dae-3265-3fe426ebc45a, deleteOnExit=true 2023-08-18 21:53:10,205 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-18 21:53:10,206 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/test.cache.data in system properties and HBase conf 2023-08-18 21:53:10,206 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/hadoop.tmp.dir in system properties and HBase conf 2023-08-18 21:53:10,206 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/hadoop.log.dir in system properties and HBase conf 2023-08-18 21:53:10,206 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-18 21:53:10,206 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-18 21:53:10,206 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-18 21:53:10,206 DEBUG [Listener at localhost/43807] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-18 21:53:10,207 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-18 21:53:10,207 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-18 21:53:10,207 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-18 21:53:10,207 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-18 21:53:10,207 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-18 21:53:10,208 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-18 21:53:10,208 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-18 21:53:10,208 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-18 21:53:10,208 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-18 21:53:10,208 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/nfs.dump.dir in system properties and HBase conf 2023-08-18 21:53:10,208 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/java.io.tmpdir in system properties and HBase conf 2023-08-18 21:53:10,208 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-18 21:53:10,208 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-18 21:53:10,209 INFO [Listener at localhost/43807] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-18 21:53:10,215 WARN [Listener at localhost/43807] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-18 21:53:10,215 WARN [Listener at localhost/43807] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-18 21:53:10,246 WARN [Listener at localhost/43807] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:53:10,248 INFO [Listener at localhost/43807] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:53:10,253 INFO [Listener at localhost/43807] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/java.io.tmpdir/Jetty_localhost_41201_hdfs____se3cu8/webapp 2023-08-18 21:53:10,328 INFO [Listener at localhost/43807] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41201 2023-08-18 21:53:10,331 WARN [Listener at localhost/43807] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-18 21:53:10,331 WARN [Listener at localhost/43807] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-18 21:53:10,358 WARN [Listener at localhost/42425] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:53:10,369 WARN [Listener at localhost/42425] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-18 21:53:10,372 WARN [Listener at localhost/42425] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:53:10,373 INFO [Listener at localhost/42425] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:53:10,378 INFO [Listener at localhost/42425] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/java.io.tmpdir/Jetty_localhost_38913_datanode____.hdmmwz/webapp 2023-08-18 21:53:10,456 INFO [Listener at localhost/42425] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38913 2023-08-18 21:53:10,461 WARN [Listener at localhost/37087] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:53:10,470 WARN [Listener at localhost/37087] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-18 21:53:10,473 WARN [Listener at localhost/37087] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:53:10,474 INFO [Listener at localhost/37087] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:53:10,479 INFO [Listener at localhost/37087] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/java.io.tmpdir/Jetty_localhost_35579_datanode____.szud0k/webapp 2023-08-18 21:53:10,527 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xefd1d27e2941321c: Processing first storage report for DS-bbb67da9-9879-4923-8d2f-fe7f55c84ce6 from datanode d7c4321c-84ab-4d1c-822c-1aff422cbbea 2023-08-18 21:53:10,527 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xefd1d27e2941321c: from storage DS-bbb67da9-9879-4923-8d2f-fe7f55c84ce6 node DatanodeRegistration(127.0.0.1:35721, datanodeUuid=d7c4321c-84ab-4d1c-822c-1aff422cbbea, infoPort=37695, infoSecurePort=0, ipcPort=37087, storageInfo=lv=-57;cid=testClusterID;nsid=968136448;c=1692395590218), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-18 21:53:10,527 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xefd1d27e2941321c: Processing first storage report for DS-747ce617-76e5-4f6a-b7cf-3791cc76430c from datanode d7c4321c-84ab-4d1c-822c-1aff422cbbea 2023-08-18 21:53:10,528 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xefd1d27e2941321c: from storage DS-747ce617-76e5-4f6a-b7cf-3791cc76430c node DatanodeRegistration(127.0.0.1:35721, datanodeUuid=d7c4321c-84ab-4d1c-822c-1aff422cbbea, infoPort=37695, infoSecurePort=0, ipcPort=37087, storageInfo=lv=-57;cid=testClusterID;nsid=968136448;c=1692395590218), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:53:10,566 INFO [Listener at localhost/37087] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35579 2023-08-18 21:53:10,573 WARN [Listener at localhost/35549] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:53:10,633 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd48f0316dbd2d08e: Processing first storage report for DS-326f75c9-c7bc-446e-a6a4-693543faaa59 from datanode 9b89b740-d3f2-439f-b20f-0d78d50394b8 2023-08-18 21:53:10,633 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd48f0316dbd2d08e: from storage DS-326f75c9-c7bc-446e-a6a4-693543faaa59 node DatanodeRegistration(127.0.0.1:32795, datanodeUuid=9b89b740-d3f2-439f-b20f-0d78d50394b8, infoPort=40855, infoSecurePort=0, ipcPort=35549, storageInfo=lv=-57;cid=testClusterID;nsid=968136448;c=1692395590218), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:53:10,634 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd48f0316dbd2d08e: Processing first storage report for DS-8798fb2e-1aca-48c5-a7de-e5d175c868e1 from datanode 9b89b740-d3f2-439f-b20f-0d78d50394b8 2023-08-18 21:53:10,634 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd48f0316dbd2d08e: from storage DS-8798fb2e-1aca-48c5-a7de-e5d175c868e1 node DatanodeRegistration(127.0.0.1:32795, datanodeUuid=9b89b740-d3f2-439f-b20f-0d78d50394b8, infoPort=40855, infoSecurePort=0, ipcPort=35549, storageInfo=lv=-57;cid=testClusterID;nsid=968136448;c=1692395590218), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:53:10,683 DEBUG [Listener at localhost/35549] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9 2023-08-18 21:53:10,688 INFO [Listener at localhost/35549] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/cluster_b6998cf1-c11b-3dae-3265-3fe426ebc45a/zookeeper_0, clientPort=63726, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/cluster_b6998cf1-c11b-3dae-3265-3fe426ebc45a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/cluster_b6998cf1-c11b-3dae-3265-3fe426ebc45a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-18 21:53:10,690 INFO [Listener at localhost/35549] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63726 2023-08-18 21:53:10,690 INFO [Listener at localhost/35549] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:53:10,691 INFO [Listener at localhost/35549] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:53:10,709 INFO [Listener at localhost/35549] util.FSUtils(471): Created version file at hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3 with version=8 2023-08-18 21:53:10,709 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/hbase-staging 2023-08-18 21:53:10,711 INFO [Listener at localhost/35549] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-08-18 21:53:10,711 INFO [Listener at localhost/35549] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:53:10,711 INFO [Listener at localhost/35549] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-18 21:53:10,712 INFO [Listener at localhost/35549] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-18 21:53:10,712 INFO [Listener at localhost/35549] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:53:10,712 INFO [Listener at localhost/35549] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-18 21:53:10,712 INFO [Listener at localhost/35549] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-18 21:53:10,713 INFO [Listener at localhost/35549] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41155 2023-08-18 21:53:10,714 INFO [Listener at localhost/35549] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:53:10,715 INFO [Listener at localhost/35549] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:53:10,716 INFO [Listener at localhost/35549] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41155 connecting to ZooKeeper ensemble=127.0.0.1:63726 2023-08-18 21:53:10,721 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:411550x0, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-18 21:53:10,722 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41155-0x1000ce625420000 connected 2023-08-18 21:53:10,737 DEBUG [Listener at localhost/35549] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-18 21:53:10,737 DEBUG [Listener at localhost/35549] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:53:10,738 DEBUG [Listener at localhost/35549] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-18 21:53:10,738 DEBUG [Listener at localhost/35549] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41155 2023-08-18 21:53:10,739 DEBUG [Listener at localhost/35549] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41155 2023-08-18 21:53:10,739 DEBUG [Listener at localhost/35549] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41155 2023-08-18 21:53:10,739 DEBUG [Listener at localhost/35549] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41155 2023-08-18 21:53:10,739 DEBUG [Listener at localhost/35549] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41155 2023-08-18 21:53:10,739 INFO [Listener at localhost/35549] master.HMaster(444): hbase.rootdir=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3, hbase.cluster.distributed=false 2023-08-18 21:53:10,757 INFO [Listener at localhost/35549] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-08-18 21:53:10,757 INFO [Listener at localhost/35549] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:53:10,757 INFO [Listener at localhost/35549] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-18 21:53:10,757 INFO [Listener at localhost/35549] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-18 21:53:10,757 INFO [Listener at localhost/35549] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:53:10,757 INFO [Listener at localhost/35549] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-18 21:53:10,758 INFO [Listener at localhost/35549] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-18 21:53:10,760 INFO [Listener at localhost/35549] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38777 2023-08-18 21:53:10,760 INFO [Listener at localhost/35549] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-18 21:53:10,761 DEBUG [Listener at localhost/35549] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-18 21:53:10,762 INFO [Listener at localhost/35549] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:53:10,763 INFO [Listener at localhost/35549] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:53:10,764 INFO [Listener at localhost/35549] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38777 connecting to ZooKeeper ensemble=127.0.0.1:63726 2023-08-18 21:53:10,769 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:387770x0, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-18 21:53:10,770 DEBUG [Listener at localhost/35549] zookeeper.ZKUtil(164): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-18 21:53:10,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38777-0x1000ce625420001 connected 2023-08-18 21:53:10,771 DEBUG [Listener at localhost/35549] zookeeper.ZKUtil(164): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:53:10,771 DEBUG [Listener at localhost/35549] zookeeper.ZKUtil(164): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-18 21:53:10,772 DEBUG [Listener at localhost/35549] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38777 2023-08-18 21:53:10,772 DEBUG [Listener at localhost/35549] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38777 2023-08-18 21:53:10,772 DEBUG [Listener at localhost/35549] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38777 2023-08-18 21:53:10,773 DEBUG [Listener at localhost/35549] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38777 2023-08-18 21:53:10,773 DEBUG [Listener at localhost/35549] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38777 2023-08-18 21:53:10,774 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,41155,1692395590711 2023-08-18 21:53:10,783 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-18 21:53:10,784 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,41155,1692395590711 2023-08-18 21:53:10,785 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-18 21:53:10,785 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-18 21:53:10,785 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:53:10,786 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-18 21:53:10,788 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,41155,1692395590711 from backup master directory 2023-08-18 21:53:10,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-18 21:53:10,789 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,41155,1692395590711 2023-08-18 21:53:10,789 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-18 21:53:10,789 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-18 21:53:10,789 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,41155,1692395590711 2023-08-18 21:53:10,807 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/hbase.id with ID: fed830ed-8b89-4555-93a5-1a76b134197b 2023-08-18 21:53:10,821 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:53:10,823 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:53:10,833 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x788988e3 to 127.0.0.1:63726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-18 21:53:10,836 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1215b6c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-18 21:53:10,836 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-18 21:53:10,837 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-18 21:53:10,837 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-18 21:53:10,839 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/MasterData/data/master/store-tmp 2023-08-18 21:53:10,852 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:53:10,852 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-18 21:53:10,852 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:53:10,852 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:53:10,852 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-18 21:53:10,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:53:10,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:53:10,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-18 21:53:10,854 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/MasterData/WALs/jenkins-hbase20.apache.org,41155,1692395590711 2023-08-18 21:53:10,857 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41155%2C1692395590711, suffix=, logDir=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/MasterData/WALs/jenkins-hbase20.apache.org,41155,1692395590711, archiveDir=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/MasterData/oldWALs, maxLogs=10 2023-08-18 21:53:10,871 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32795,DS-326f75c9-c7bc-446e-a6a4-693543faaa59,DISK] 2023-08-18 21:53:10,871 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35721,DS-bbb67da9-9879-4923-8d2f-fe7f55c84ce6,DISK] 2023-08-18 21:53:10,873 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/MasterData/WALs/jenkins-hbase20.apache.org,41155,1692395590711/jenkins-hbase20.apache.org%2C41155%2C1692395590711.1692395590857 2023-08-18 21:53:10,873 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35721,DS-bbb67da9-9879-4923-8d2f-fe7f55c84ce6,DISK], DatanodeInfoWithStorage[127.0.0.1:32795,DS-326f75c9-c7bc-446e-a6a4-693543faaa59,DISK]] 2023-08-18 21:53:10,873 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-18 21:53:10,873 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:53:10,873 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:53:10,873 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:53:10,876 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:53:10,877 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-18 21:53:10,878 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-18 21:53:10,879 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:53:10,879 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:53:10,881 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:53:10,884 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:53:10,887 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-18 21:53:10,887 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=878809, jitterRate=0.117464080452919}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-18 21:53:10,888 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-18 21:53:10,888 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-18 21:53:10,889 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-18 21:53:10,889 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-18 21:53:10,889 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-18 21:53:10,890 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-18 21:53:10,890 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-18 21:53:10,891 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-18 21:53:10,891 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-18 21:53:10,893 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-18 21:53:10,906 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-18 21:53:10,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-18 21:53:10,908 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-18 21:53:10,908 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-18 21:53:10,908 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-18 21:53:10,910 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:53:10,911 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-18 21:53:10,912 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-18 21:53:10,913 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-18 21:53:10,913 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-18 21:53:10,913 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-18 21:53:10,914 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:53:10,914 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,41155,1692395590711, sessionid=0x1000ce625420000, setting cluster-up flag (Was=false) 2023-08-18 21:53:10,917 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:53:10,920 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-18 21:53:10,921 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,41155,1692395590711 2023-08-18 21:53:10,923 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:53:10,926 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-18 21:53:10,927 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,41155,1692395590711 2023-08-18 21:53:10,928 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/.hbase-snapshot/.tmp 2023-08-18 21:53:10,930 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-18 21:53:10,930 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:53:10,930 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:53:10,930 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:53:10,931 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:53:10,931 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-08-18 21:53:10,931 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:53:10,931 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-08-18 21:53:10,931 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:53:10,932 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1692395620932 2023-08-18 21:53:10,932 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-18 21:53:10,932 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-18 21:53:10,933 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-18 21:53:10,933 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-18 21:53:10,933 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-18 21:53:10,933 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-18 21:53:10,933 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-18 21:53:10,933 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-18 21:53:10,933 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-18 21:53:10,934 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-18 21:53:10,934 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-18 21:53:10,934 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-18 21:53:10,934 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-18 21:53:10,934 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-18 21:53:10,935 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-18 21:53:10,936 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1692395590934,5,FailOnTimeoutGroup] 2023-08-18 21:53:10,936 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1692395590936,5,FailOnTimeoutGroup] 2023-08-18 21:53:10,936 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-18 21:53:10,936 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-18 21:53:10,936 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-18 21:53:10,936 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-18 21:53:10,949 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-18 21:53:10,951 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-18 21:53:10,951 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3 2023-08-18 21:53:10,962 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:53:10,964 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-18 21:53:10,966 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/info 2023-08-18 21:53:10,967 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-18 21:53:10,968 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:53:10,968 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-18 21:53:10,969 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/rep_barrier 2023-08-18 21:53:10,970 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-18 21:53:10,971 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:53:10,971 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-18 21:53:10,972 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/table 2023-08-18 21:53:10,973 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-18 21:53:10,974 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:53:10,975 INFO [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(951): ClusterId : fed830ed-8b89-4555-93a5-1a76b134197b 2023-08-18 21:53:10,976 DEBUG [RS:0;jenkins-hbase20:38777] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-18 21:53:10,976 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740 2023-08-18 21:53:10,977 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740 2023-08-18 21:53:10,978 DEBUG [RS:0;jenkins-hbase20:38777] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-18 21:53:10,979 DEBUG [RS:0;jenkins-hbase20:38777] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-18 21:53:10,981 DEBUG [RS:0;jenkins-hbase20:38777] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-18 21:53:10,981 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-18 21:53:10,981 DEBUG [RS:0;jenkins-hbase20:38777] zookeeper.ReadOnlyZKClient(139): Connect 0x70bee9be to 127.0.0.1:63726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-18 21:53:10,984 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-18 21:53:10,988 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-18 21:53:10,989 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=779457, jitterRate=-0.008870035409927368}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-18 21:53:10,989 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-18 21:53:10,989 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-18 21:53:10,989 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-18 21:53:10,990 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-18 21:53:10,990 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-18 21:53:10,990 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-18 21:53:10,990 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-18 21:53:10,990 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-18 21:53:10,991 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-18 21:53:10,991 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-18 21:53:10,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-18 21:53:10,993 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-18 21:53:10,994 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-18 21:53:10,995 DEBUG [RS:0;jenkins-hbase20:38777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e7919d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-18 21:53:10,995 DEBUG [RS:0;jenkins-hbase20:38777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a4682ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-08-18 21:53:11,002 DEBUG [RS:0;jenkins-hbase20:38777] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:38777 2023-08-18 21:53:11,002 INFO [RS:0;jenkins-hbase20:38777] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-18 21:53:11,002 INFO [RS:0;jenkins-hbase20:38777] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-18 21:53:11,002 DEBUG [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(1022): About to register with Master. 2023-08-18 21:53:11,003 INFO [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,41155,1692395590711 with isa=jenkins-hbase20.apache.org/148.251.75.209:38777, startcode=1692395590756 2023-08-18 21:53:11,003 DEBUG [RS:0;jenkins-hbase20:38777] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-18 21:53:11,006 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60601, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-08-18 21:53:11,007 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41155] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:11,008 DEBUG [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3 2023-08-18 21:53:11,008 DEBUG [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42425 2023-08-18 21:53:11,008 DEBUG [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-18 21:53:11,010 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-18 21:53:11,010 DEBUG [RS:0;jenkins-hbase20:38777] zookeeper.ZKUtil(162): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:11,010 WARN [RS:0;jenkins-hbase20:38777] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-18 21:53:11,010 INFO [RS:0;jenkins-hbase20:38777] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-18 21:53:11,011 DEBUG [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:11,011 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,38777,1692395590756] 2023-08-18 21:53:11,016 DEBUG [RS:0;jenkins-hbase20:38777] zookeeper.ZKUtil(162): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:11,017 DEBUG [RS:0;jenkins-hbase20:38777] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-18 21:53:11,017 INFO [RS:0;jenkins-hbase20:38777] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-18 21:53:11,019 INFO [RS:0;jenkins-hbase20:38777] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-18 21:53:11,020 INFO [RS:0;jenkins-hbase20:38777] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-18 21:53:11,020 INFO [RS:0;jenkins-hbase20:38777] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-18 21:53:11,020 INFO [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-18 21:53:11,022 INFO [RS:0;jenkins-hbase20:38777] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-18 21:53:11,022 DEBUG [RS:0;jenkins-hbase20:38777] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:53:11,022 DEBUG [RS:0;jenkins-hbase20:38777] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:53:11,022 DEBUG [RS:0;jenkins-hbase20:38777] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:53:11,022 DEBUG [RS:0;jenkins-hbase20:38777] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:53:11,023 DEBUG [RS:0;jenkins-hbase20:38777] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:53:11,023 DEBUG [RS:0;jenkins-hbase20:38777] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-08-18 21:53:11,023 DEBUG [RS:0;jenkins-hbase20:38777] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:53:11,023 DEBUG [RS:0;jenkins-hbase20:38777] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:53:11,023 DEBUG [RS:0;jenkins-hbase20:38777] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:53:11,023 DEBUG [RS:0;jenkins-hbase20:38777] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:53:11,026 INFO [RS:0;jenkins-hbase20:38777] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-18 21:53:11,026 INFO [RS:0;jenkins-hbase20:38777] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-18 21:53:11,026 INFO [RS:0;jenkins-hbase20:38777] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-18 21:53:11,036 INFO [RS:0;jenkins-hbase20:38777] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-18 21:53:11,036 INFO [RS:0;jenkins-hbase20:38777] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38777,1692395590756-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-18 21:53:11,046 INFO [RS:0;jenkins-hbase20:38777] regionserver.Replication(203): jenkins-hbase20.apache.org,38777,1692395590756 started 2023-08-18 21:53:11,047 INFO [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,38777,1692395590756, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:38777, sessionid=0x1000ce625420001 2023-08-18 21:53:11,047 DEBUG [RS:0;jenkins-hbase20:38777] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-18 21:53:11,047 DEBUG [RS:0;jenkins-hbase20:38777] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:11,047 DEBUG [RS:0;jenkins-hbase20:38777] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38777,1692395590756' 2023-08-18 21:53:11,047 DEBUG [RS:0;jenkins-hbase20:38777] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-18 21:53:11,048 DEBUG [RS:0;jenkins-hbase20:38777] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-18 21:53:11,048 DEBUG [RS:0;jenkins-hbase20:38777] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-18 21:53:11,048 DEBUG [RS:0;jenkins-hbase20:38777] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-18 21:53:11,048 DEBUG [RS:0;jenkins-hbase20:38777] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:11,048 DEBUG [RS:0;jenkins-hbase20:38777] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38777,1692395590756' 2023-08-18 21:53:11,048 DEBUG [RS:0;jenkins-hbase20:38777] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-18 21:53:11,049 DEBUG [RS:0;jenkins-hbase20:38777] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-18 21:53:11,049 DEBUG [RS:0;jenkins-hbase20:38777] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-18 21:53:11,049 INFO [RS:0;jenkins-hbase20:38777] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-18 21:53:11,049 INFO [RS:0;jenkins-hbase20:38777] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-18 21:53:11,144 DEBUG [jenkins-hbase20:41155] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-18 21:53:11,145 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38777,1692395590756, state=OPENING 2023-08-18 21:53:11,146 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-18 21:53:11,148 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:53:11,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38777,1692395590756}] 2023-08-18 21:53:11,148 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-18 21:53:11,153 INFO [RS:0;jenkins-hbase20:38777] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38777%2C1692395590756, suffix=, logDir=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756, archiveDir=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/oldWALs, maxLogs=32 2023-08-18 21:53:11,174 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32795,DS-326f75c9-c7bc-446e-a6a4-693543faaa59,DISK] 2023-08-18 21:53:11,174 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35721,DS-bbb67da9-9879-4923-8d2f-fe7f55c84ce6,DISK] 2023-08-18 21:53:11,176 INFO [RS:0;jenkins-hbase20:38777] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756/jenkins-hbase20.apache.org%2C38777%2C1692395590756.1692395591156 2023-08-18 21:53:11,177 DEBUG [RS:0;jenkins-hbase20:38777] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35721,DS-bbb67da9-9879-4923-8d2f-fe7f55c84ce6,DISK], DatanodeInfoWithStorage[127.0.0.1:32795,DS-326f75c9-c7bc-446e-a6a4-693543faaa59,DISK]] 2023-08-18 21:53:11,305 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:11,305 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-18 21:53:11,311 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-18 21:53:11,320 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-18 21:53:11,320 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-18 21:53:11,325 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38777%2C1692395590756.meta, suffix=.meta, logDir=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756, archiveDir=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/oldWALs, maxLogs=32 2023-08-18 21:53:11,344 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32795,DS-326f75c9-c7bc-446e-a6a4-693543faaa59,DISK] 2023-08-18 21:53:11,345 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35721,DS-bbb67da9-9879-4923-8d2f-fe7f55c84ce6,DISK] 2023-08-18 21:53:11,347 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756/jenkins-hbase20.apache.org%2C38777%2C1692395590756.meta.1692395591328.meta 2023-08-18 21:53:11,347 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32795,DS-326f75c9-c7bc-446e-a6a4-693543faaa59,DISK], DatanodeInfoWithStorage[127.0.0.1:35721,DS-bbb67da9-9879-4923-8d2f-fe7f55c84ce6,DISK]] 2023-08-18 21:53:11,347 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-18 21:53:11,347 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-18 21:53:11,347 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-18 21:53:11,348 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-18 21:53:11,348 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-18 21:53:11,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:53:11,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-18 21:53:11,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-18 21:53:11,350 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-18 21:53:11,351 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/info 2023-08-18 21:53:11,351 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/info 2023-08-18 21:53:11,352 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-18 21:53:11,352 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:53:11,352 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-18 21:53:11,353 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/rep_barrier 2023-08-18 21:53:11,353 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/rep_barrier 2023-08-18 21:53:11,353 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-18 21:53:11,354 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:53:11,354 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-18 21:53:11,356 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/table 2023-08-18 21:53:11,356 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/table 2023-08-18 21:53:11,357 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-18 21:53:11,357 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:53:11,358 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740 2023-08-18 21:53:11,360 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740 2023-08-18 21:53:11,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-18 21:53:11,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-18 21:53:11,366 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=746811, jitterRate=-0.0503808856010437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-18 21:53:11,366 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-18 21:53:11,367 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1692395591305 2023-08-18 21:53:11,371 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-18 21:53:11,372 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-18 21:53:11,373 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38777,1692395590756, state=OPEN 2023-08-18 21:53:11,374 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-18 21:53:11,374 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-18 21:53:11,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-18 21:53:11,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38777,1692395590756 in 226 msec 2023-08-18 21:53:11,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-18 21:53:11,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 386 msec 2023-08-18 21:53:11,384 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 454 msec 2023-08-18 21:53:11,385 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1692395591384, completionTime=-1 2023-08-18 21:53:11,385 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-18 21:53:11,385 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-18 21:53:11,387 DEBUG [hconnection-0x573c8c2d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-18 21:53:11,389 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-18 21:53:11,390 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-18 21:53:11,391 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1692395651391 2023-08-18 21:53:11,391 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1692395711391 2023-08-18 21:53:11,391 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-08-18 21:53:11,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41155,1692395590711-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-18 21:53:11,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41155,1692395590711-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-18 21:53:11,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41155,1692395590711-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-18 21:53:11,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:41155, period=300000, unit=MILLISECONDS is enabled. 2023-08-18 21:53:11,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-18 21:53:11,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-18 21:53:11,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-18 21:53:11,399 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-18 21:53:11,399 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-18 21:53:11,401 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-18 21:53:11,402 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-18 21:53:11,404 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/.tmp/data/hbase/namespace/b29b788841828f0d9e898f3cac7fc50b 2023-08-18 21:53:11,405 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/.tmp/data/hbase/namespace/b29b788841828f0d9e898f3cac7fc50b empty. 2023-08-18 21:53:11,405 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/.tmp/data/hbase/namespace/b29b788841828f0d9e898f3cac7fc50b 2023-08-18 21:53:11,405 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-18 21:53:11,427 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-18 21:53:11,467 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => b29b788841828f0d9e898f3cac7fc50b, NAME => 'hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/.tmp 2023-08-18 21:53:11,478 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:53:11,478 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing b29b788841828f0d9e898f3cac7fc50b, disabling compactions & flushes 2023-08-18 21:53:11,478 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. 2023-08-18 21:53:11,478 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. 2023-08-18 21:53:11,478 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. after waiting 0 ms 2023-08-18 21:53:11,478 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. 2023-08-18 21:53:11,478 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. 2023-08-18 21:53:11,478 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for b29b788841828f0d9e898f3cac7fc50b: 2023-08-18 21:53:11,481 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-18 21:53:11,482 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692395591482"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692395591482"}]},"ts":"1692395591482"} 2023-08-18 21:53:11,485 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-18 21:53:11,486 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-18 21:53:11,486 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692395591486"}]},"ts":"1692395591486"} 2023-08-18 21:53:11,488 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-18 21:53:11,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b29b788841828f0d9e898f3cac7fc50b, ASSIGN}] 2023-08-18 21:53:11,494 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b29b788841828f0d9e898f3cac7fc50b, ASSIGN 2023-08-18 21:53:11,496 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b29b788841828f0d9e898f3cac7fc50b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38777,1692395590756; forceNewPlan=false, retain=false 2023-08-18 21:53:11,647 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b29b788841828f0d9e898f3cac7fc50b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:11,647 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692395591646"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1692395591646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692395591646"}]},"ts":"1692395591646"} 2023-08-18 21:53:11,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b29b788841828f0d9e898f3cac7fc50b, server=jenkins-hbase20.apache.org,38777,1692395590756}] 2023-08-18 21:53:11,807 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. 2023-08-18 21:53:11,807 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b29b788841828f0d9e898f3cac7fc50b, NAME => 'hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b.', STARTKEY => '', ENDKEY => ''} 2023-08-18 21:53:11,807 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b29b788841828f0d9e898f3cac7fc50b 2023-08-18 21:53:11,807 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:53:11,807 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b29b788841828f0d9e898f3cac7fc50b 2023-08-18 21:53:11,807 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b29b788841828f0d9e898f3cac7fc50b 2023-08-18 21:53:11,809 INFO [StoreOpener-b29b788841828f0d9e898f3cac7fc50b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b29b788841828f0d9e898f3cac7fc50b 2023-08-18 21:53:11,811 DEBUG [StoreOpener-b29b788841828f0d9e898f3cac7fc50b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/namespace/b29b788841828f0d9e898f3cac7fc50b/info 2023-08-18 21:53:11,811 DEBUG [StoreOpener-b29b788841828f0d9e898f3cac7fc50b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/namespace/b29b788841828f0d9e898f3cac7fc50b/info 2023-08-18 21:53:11,812 INFO [StoreOpener-b29b788841828f0d9e898f3cac7fc50b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b29b788841828f0d9e898f3cac7fc50b columnFamilyName info 2023-08-18 21:53:11,813 INFO [StoreOpener-b29b788841828f0d9e898f3cac7fc50b-1] regionserver.HStore(310): Store=b29b788841828f0d9e898f3cac7fc50b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:53:11,814 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/namespace/b29b788841828f0d9e898f3cac7fc50b 2023-08-18 21:53:11,815 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/namespace/b29b788841828f0d9e898f3cac7fc50b 2023-08-18 21:53:11,818 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b29b788841828f0d9e898f3cac7fc50b 2023-08-18 21:53:11,821 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/namespace/b29b788841828f0d9e898f3cac7fc50b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-18 21:53:11,822 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b29b788841828f0d9e898f3cac7fc50b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=700141, jitterRate=-0.10972470045089722}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-18 21:53:11,822 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b29b788841828f0d9e898f3cac7fc50b: 2023-08-18 21:53:11,824 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b., pid=6, masterSystemTime=1692395591802 2023-08-18 21:53:11,827 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. 2023-08-18 21:53:11,827 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. 2023-08-18 21:53:11,828 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b29b788841828f0d9e898f3cac7fc50b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:11,828 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692395591827"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1692395591827"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692395591827"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692395591827"}]},"ts":"1692395591827"} 2023-08-18 21:53:11,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-18 21:53:11,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b29b788841828f0d9e898f3cac7fc50b, server=jenkins-hbase20.apache.org,38777,1692395590756 in 181 msec 2023-08-18 21:53:11,839 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-18 21:53:11,839 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b29b788841828f0d9e898f3cac7fc50b, ASSIGN in 343 msec 2023-08-18 21:53:11,841 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-18 21:53:11,841 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692395591841"}]},"ts":"1692395591841"} 2023-08-18 21:53:11,843 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-18 21:53:11,846 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-18 21:53:11,849 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 449 msec 2023-08-18 21:53:11,900 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-18 21:53:11,901 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-18 21:53:11,901 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:53:11,906 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-18 21:53:11,918 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-18 21:53:11,922 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 16 msec 2023-08-18 21:53:11,928 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-18 21:53:11,938 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-18 21:53:11,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-08-18 21:53:11,953 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-18 21:53:11,954 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-18 21:53:11,954 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.165sec 2023-08-18 21:53:11,955 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-18 21:53:11,955 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-18 21:53:11,955 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-18 21:53:11,955 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41155,1692395590711-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-18 21:53:11,955 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41155,1692395590711-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-18 21:53:11,957 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-18 21:53:11,976 DEBUG [Listener at localhost/35549] zookeeper.ReadOnlyZKClient(139): Connect 0x7ca8ec10 to 127.0.0.1:63726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-18 21:53:11,981 DEBUG [Listener at localhost/35549] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3820d4d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-18 21:53:11,983 DEBUG [hconnection-0x477418a7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-18 21:53:11,985 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-18 21:53:11,988 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,41155,1692395590711 2023-08-18 21:53:11,989 INFO [Listener at localhost/35549] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:53:11,992 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-18 21:53:11,993 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:53:11,994 INFO [Listener at localhost/35549] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-18 21:53:11,996 DEBUG [Listener at localhost/35549] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-18 21:53:12,000 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-18 21:53:12,002 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-18 21:53:12,002 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-18 21:53:12,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-18 21:53:12,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:12,008 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-08-18 21:53:12,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testCompactionRecordDoesntBlockRolling" procId is: 9 2023-08-18 21:53:12,009 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-18 21:53:12,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-18 21:53:12,014 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab 2023-08-18 21:53:12,015 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab empty. 2023-08-18 21:53:12,015 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab 2023-08-18 21:53:12,016 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testCompactionRecordDoesntBlockRolling regions 2023-08-18 21:53:12,040 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/.tabledesc/.tableinfo.0000000001 2023-08-18 21:53:12,041 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => 987ec7e5cfb6a05b07d965311ee352ab, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/.tmp 2023-08-18 21:53:12,052 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:53:12,052 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1604): Closing 987ec7e5cfb6a05b07d965311ee352ab, disabling compactions & flushes 2023-08-18 21:53:12,052 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:53:12,053 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:53:12,053 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. after waiting 0 ms 2023-08-18 21:53:12,053 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:53:12,053 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:53:12,053 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1558): Region close journal for 987ec7e5cfb6a05b07d965311ee352ab: 2023-08-18 21:53:12,056 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ADD_TO_META 2023-08-18 21:53:12,058 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1692395592057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692395592057"}]},"ts":"1692395592057"} 2023-08-18 21:53:12,060 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-18 21:53:12,061 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-18 21:53:12,062 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692395592062"}]},"ts":"1692395592062"} 2023-08-18 21:53:12,064 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLING in hbase:meta 2023-08-18 21:53:12,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=987ec7e5cfb6a05b07d965311ee352ab, ASSIGN}] 2023-08-18 21:53:12,069 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=987ec7e5cfb6a05b07d965311ee352ab, ASSIGN 2023-08-18 21:53:12,070 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=987ec7e5cfb6a05b07d965311ee352ab, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38777,1692395590756; forceNewPlan=false, retain=false 2023-08-18 21:53:12,221 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=987ec7e5cfb6a05b07d965311ee352ab, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:12,222 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1692395592221"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1692395592221"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692395592221"}]},"ts":"1692395592221"} 2023-08-18 21:53:12,224 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 987ec7e5cfb6a05b07d965311ee352ab, server=jenkins-hbase20.apache.org,38777,1692395590756}] 2023-08-18 21:53:12,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:53:12,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 987ec7e5cfb6a05b07d965311ee352ab, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab.', STARTKEY => '', ENDKEY => ''} 2023-08-18 21:53:12,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testCompactionRecordDoesntBlockRolling 987ec7e5cfb6a05b07d965311ee352ab 2023-08-18 21:53:12,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:53:12,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 987ec7e5cfb6a05b07d965311ee352ab 2023-08-18 21:53:12,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 987ec7e5cfb6a05b07d965311ee352ab 2023-08-18 21:53:12,384 INFO [StoreOpener-987ec7e5cfb6a05b07d965311ee352ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 987ec7e5cfb6a05b07d965311ee352ab 2023-08-18 21:53:12,386 DEBUG [StoreOpener-987ec7e5cfb6a05b07d965311ee352ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info 2023-08-18 21:53:12,386 DEBUG [StoreOpener-987ec7e5cfb6a05b07d965311ee352ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info 2023-08-18 21:53:12,386 INFO [StoreOpener-987ec7e5cfb6a05b07d965311ee352ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 987ec7e5cfb6a05b07d965311ee352ab columnFamilyName info 2023-08-18 21:53:12,387 INFO [StoreOpener-987ec7e5cfb6a05b07d965311ee352ab-1] regionserver.HStore(310): Store=987ec7e5cfb6a05b07d965311ee352ab/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:53:12,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab 2023-08-18 21:53:12,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab 2023-08-18 21:53:12,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 987ec7e5cfb6a05b07d965311ee352ab 2023-08-18 21:53:12,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-18 21:53:12,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 987ec7e5cfb6a05b07d965311ee352ab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=822954, jitterRate=0.046441227197647095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-18 21:53:12,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 987ec7e5cfb6a05b07d965311ee352ab: 2023-08-18 21:53:12,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab., pid=11, masterSystemTime=1692395592376 2023-08-18 21:53:12,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:53:12,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:53:12,402 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=987ec7e5cfb6a05b07d965311ee352ab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:12,403 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1692395592402"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1692395592402"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692395592402"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692395592402"}]},"ts":"1692395592402"} 2023-08-18 21:53:12,409 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-18 21:53:12,409 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 987ec7e5cfb6a05b07d965311ee352ab, server=jenkins-hbase20.apache.org,38777,1692395590756 in 181 msec 2023-08-18 21:53:12,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-18 21:53:12,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=987ec7e5cfb6a05b07d965311ee352ab, ASSIGN in 342 msec 2023-08-18 21:53:12,413 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-18 21:53:12,413 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692395592413"}]},"ts":"1692395592413"} 2023-08-18 21:53:12,416 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLED in hbase:meta 2023-08-18 21:53:12,418 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_POST_OPERATION 2023-08-18 21:53:12,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling in 416 msec 2023-08-18 21:53:15,499 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-18 21:53:15,499 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-08-18 21:53:16,855 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-18 21:53:17,017 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-18 21:53:17,018 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-18 21:53:17,018 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-18 21:53:22,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-18 21:53:22,012 INFO [Listener at localhost/35549] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testCompactionRecordDoesntBlockRolling, procId: 9 completed 2023-08-18 21:53:22,014 DEBUG [Listener at localhost/35549] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:22,014 DEBUG [Listener at localhost/35549] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:53:22,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-08-18 21:53:22,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] procedure.ProcedureCoordinator(165): Submitting procedure hbase:namespace 2023-08-18 21:53:22,033 INFO [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase:namespace' 2023-08-18 21:53:22,033 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-18 21:53:22,034 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase:namespace' starting 'acquire' 2023-08-18 21:53:22,034 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase:namespace', kicking off acquire phase on members. 2023-08-18 21:53:22,034 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-08-18 21:53:22,034 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-18 21:53:22,035 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-18 21:53:22,035 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-18 21:53:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-18 21:53:22,036 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,036 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-18 21:53:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase:namespace 2023-08-18 21:53:22,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-08-18 21:53:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-18 21:53:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-18 21:53:22,037 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase:namespace 2023-08-18 21:53:22,039 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase:namespace 2023-08-18 21:53:22,039 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase:namespace' with timeout 60000ms 2023-08-18 21:53:22,039 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-18 21:53:22,040 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase:namespace' starting 'acquire' stage 2023-08-18 21:53:22,040 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-18 21:53:22,040 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-18 21:53:22,040 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. 2023-08-18 21:53:22,040 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. started... 2023-08-18 21:53:22,041 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b29b788841828f0d9e898f3cac7fc50b 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-18 21:53:22,054 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/namespace/b29b788841828f0d9e898f3cac7fc50b/.tmp/info/ad93b3ae23f046a48566c3a2d07f3d3c 2023-08-18 21:53:22,065 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/namespace/b29b788841828f0d9e898f3cac7fc50b/.tmp/info/ad93b3ae23f046a48566c3a2d07f3d3c as hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/namespace/b29b788841828f0d9e898f3cac7fc50b/info/ad93b3ae23f046a48566c3a2d07f3d3c 2023-08-18 21:53:22,073 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/namespace/b29b788841828f0d9e898f3cac7fc50b/info/ad93b3ae23f046a48566c3a2d07f3d3c, entries=2, sequenceid=6, filesize=4.8 K 2023-08-18 21:53:22,074 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b29b788841828f0d9e898f3cac7fc50b in 33ms, sequenceid=6, compaction requested=false 2023-08-18 21:53:22,075 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b29b788841828f0d9e898f3cac7fc50b: 2023-08-18 21:53:22,075 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. 2023-08-18 21:53:22,075 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-18 21:53:22,075 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-18 21:53:22,075 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,075 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase:namespace' locally acquired 2023-08-18 21:53:22,075 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38777,1692395590756' joining acquired barrier for procedure (hbase:namespace) in zk 2023-08-18 21:53:22,077 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,077 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-18 21:53:22,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-18 21:53:22,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-18 21:53:22,078 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace 2023-08-18 21:53:22,078 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase:namespace' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-18 21:53:22,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-18 21:53:22,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-18 21:53:22,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-18 21:53:22,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-18 21:53:22,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38777,1692395590756' joining acquired barrier for procedure 'hbase:namespace' on coordinator 2023-08-18 21:53:22,079 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase:namespace' starting 'in-barrier' execution. 2023-08-18 21:53:22,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bbb479f[Count = 0] remaining members to acquire global barrier 2023-08-18 21:53:22,079 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-18 21:53:22,081 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-18 21:53:22,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-18 21:53:22,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-18 21:53:22,081 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase:namespace' received 'reached' from coordinator. 2023-08-18 21:53:22,081 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,081 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase:namespace' locally completed 2023-08-18 21:53:22,081 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-18 21:53:22,082 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase:namespace' completed for member 'jenkins-hbase20.apache.org,38777,1692395590756' in zk 2023-08-18 21:53:22,083 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase:namespace' has notified controller of completion 2023-08-18 21:53:22,083 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,083 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-18 21:53:22,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-18 21:53:22,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-18 21:53:22,083 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase:namespace' completed. 2023-08-18 21:53:22,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-18 21:53:22,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-18 21:53:22,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-18 21:53:22,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-18 21:53:22,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-18 21:53:22,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase:namespace' member 'jenkins-hbase20.apache.org,38777,1692395590756': 2023-08-18 21:53:22,087 INFO [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase:namespace' execution completed 2023-08-18 21:53:22,087 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-18 21:53:22,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38777,1692395590756' released barrier for procedure'hbase:namespace', counting down latch. Waiting for 0 more 2023-08-18 21:53:22,087 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-18 21:53:22,087 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase:namespace 2023-08-18 21:53:22,087 INFO [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase:namespaceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-18 21:53:22,089 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-18 21:53:22,089 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-18 21:53:22,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase:namespace 2023-08-18 21:53:22,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase:namespace 2023-08-18 21:53:22,089 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-18 21:53:22,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-08-18 21:53:22,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-18 21:53:22,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-18 21:53:22,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-18 21:53:22,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-18 21:53:22,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-18 21:53:22,090 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-08-18 21:53:22,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-18 21:53:22,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-18 21:53:22,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-18 21:53:22,091 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-18 21:53:22,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-18 21:53:22,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,099 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-18 21:53:22,099 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-18 21:53:22,099 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-18 21:53:22,099 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-18 21:53:22,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase:namespace' 2023-08-18 21:53:22,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-18 21:53:22,099 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-18 21:53:22,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-18 21:53:22,100 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-18 21:53:22,100 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:22,100 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-18 21:53:22,100 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-18 21:53:22,100 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-18 21:53:22,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-18 21:53:22,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-18 21:53:22,102 DEBUG [Listener at localhost/35549] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase:namespace'' to complete. (max 20000 ms per retry) 2023-08-18 21:53:22,102 DEBUG [Listener at localhost/35549] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-18 21:53:32,102 DEBUG [Listener at localhost/35549] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-18 21:53:32,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-18 21:53:32,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-08-18 21:53:32,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,125 INFO [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-18 21:53:32,125 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-18 21:53:32,126 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-18 21:53:32,126 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-18 21:53:32,127 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,127 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,128 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-18 21:53:32,128 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-18 21:53:32,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-18 21:53:32,128 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,128 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-18 21:53:32,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-18 21:53:32,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,129 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,130 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-18 21:53:32,130 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-18 21:53:32,131 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-18 21:53:32,131 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-18 21:53:32,131 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-18 21:53:32,131 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:53:32,131 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. started... 2023-08-18 21:53:32,131 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 987ec7e5cfb6a05b07d965311ee352ab 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-18 21:53:32,154 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/.tmp/info/0e7c4319d31b4c96b25baa0491050b85 2023-08-18 21:53:32,167 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/.tmp/info/0e7c4319d31b4c96b25baa0491050b85 as hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/0e7c4319d31b4c96b25baa0491050b85 2023-08-18 21:53:32,175 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/0e7c4319d31b4c96b25baa0491050b85, entries=1, sequenceid=5, filesize=5.8 K 2023-08-18 21:53:32,176 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 987ec7e5cfb6a05b07d965311ee352ab in 45ms, sequenceid=5, compaction requested=false 2023-08-18 21:53:32,177 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 987ec7e5cfb6a05b07d965311ee352ab: 2023-08-18 21:53:32,177 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:53:32,177 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-18 21:53:32,177 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-18 21:53:32,177 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,177 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-18 21:53:32,177 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38777,1692395590756' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-18 21:53:32,179 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,179 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-18 21:53:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-18 21:53:32,179 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,179 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-18 21:53:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-18 21:53:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-18 21:53:32,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-18 21:53:32,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38777,1692395590756' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-18 21:53:32,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f84d030[Count = 0] remaining members to acquire global barrier 2023-08-18 21:53:32,180 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-18 21:53:32,181 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,181 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,181 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-18 21:53:32,182 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-18 21:53:32,182 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase20.apache.org,38777,1692395590756' in zk 2023-08-18 21:53:32,182 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,182 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-18 21:53:32,183 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-18 21:53:32,183 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,183 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-18 21:53:32,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,183 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-18 21:53:32,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-18 21:53:32,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-18 21:53:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-18 21:53:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-18 21:53:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-18 21:53:32,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase20.apache.org,38777,1692395590756': 2023-08-18 21:53:32,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38777,1692395590756' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-18 21:53:32,186 INFO [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-18 21:53:32,186 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-18 21:53:32,186 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-18 21:53:32,186 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,186 INFO [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-18 21:53:32,194 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,194 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-18 21:53:32,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,195 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-18 21:53:32,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-18 21:53:32,196 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-18 21:53:32,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-18 21:53:32,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-18 21:53:32,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-18 21:53:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,198 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-18 21:53:32,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,201 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,201 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,201 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-18 21:53:32,201 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-18 21:53:32,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-18 21:53:32,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-18 21:53:32,201 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:32,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-18 21:53:32,201 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-18 21:53:32,201 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-18 21:53:32,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-18 21:53:32,201 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,202 DEBUG [Listener at localhost/35549] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-18 21:53:32,202 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,202 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:32,202 DEBUG [Listener at localhost/35549] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-18 21:53:32,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-18 21:53:32,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-18 21:53:42,202 DEBUG [Listener at localhost/35549] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-18 21:53:42,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-18 21:53:42,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-08-18 21:53:42,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-18 21:53:42,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,221 INFO [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-18 21:53:42,221 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-18 21:53:42,222 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-18 21:53:42,222 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-18 21:53:42,222 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,223 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,224 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,224 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-18 21:53:42,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-18 21:53:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-18 21:53:42,224 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,224 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-18 21:53:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-18 21:53:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,225 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,225 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-18 21:53:42,225 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,226 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-18 21:53:42,226 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-18 21:53:42,226 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-18 21:53:42,226 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-18 21:53:42,226 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-18 21:53:42,226 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:53:42,226 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. started... 2023-08-18 21:53:42,227 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 987ec7e5cfb6a05b07d965311ee352ab 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-18 21:53:42,240 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/.tmp/info/a4a5f15f9f9040f9a44835ac9b2025a0 2023-08-18 21:53:42,249 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/.tmp/info/a4a5f15f9f9040f9a44835ac9b2025a0 as hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/a4a5f15f9f9040f9a44835ac9b2025a0 2023-08-18 21:53:42,258 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/a4a5f15f9f9040f9a44835ac9b2025a0, entries=1, sequenceid=9, filesize=5.8 K 2023-08-18 21:53:42,259 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 987ec7e5cfb6a05b07d965311ee352ab in 32ms, sequenceid=9, compaction requested=false 2023-08-18 21:53:42,259 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 987ec7e5cfb6a05b07d965311ee352ab: 2023-08-18 21:53:42,259 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:53:42,259 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-18 21:53:42,260 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-18 21:53:42,260 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,260 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-18 21:53:42,260 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38777,1692395590756' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-18 21:53:42,261 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,261 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-18 21:53:42,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-18 21:53:42,262 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,262 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-18 21:53:42,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-18 21:53:42,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-18 21:53:42,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-18 21:53:42,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38777,1692395590756' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-18 21:53:42,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a864da4[Count = 0] remaining members to acquire global barrier 2023-08-18 21:53:42,263 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-18 21:53:42,264 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,264 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,264 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-18 21:53:42,264 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-18 21:53:42,265 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,265 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-18 21:53:42,265 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase20.apache.org,38777,1692395590756' in zk 2023-08-18 21:53:42,266 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,266 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-18 21:53:42,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-18 21:53:42,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-18 21:53:42,266 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-18 21:53:42,266 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-18 21:53:42,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-18 21:53:42,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-18 21:53:42,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-18 21:53:42,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase20.apache.org,38777,1692395590756': 2023-08-18 21:53:42,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38777,1692395590756' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-18 21:53:42,269 INFO [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-18 21:53:42,269 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-18 21:53:42,269 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-18 21:53:42,269 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,269 INFO [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-18 21:53:42,270 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,270 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,271 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-18 21:53:42,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-18 21:53:42,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-18 21:53:42,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-18 21:53:42,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-18 21:53:42,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-18 21:53:42,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,271 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-18 21:53:42,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,273 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-18 21:53:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,275 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,275 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,275 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,275 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-18 21:53:42,275 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:42,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-18 21:53:42,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-18 21:53:42,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-18 21:53:42,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-18 21:53:42,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-18 21:53:42,275 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,275 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-18 21:53:42,275 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-18 21:53:42,275 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:42,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-18 21:53:42,276 DEBUG [Listener at localhost/35549] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-18 21:53:42,276 DEBUG [Listener at localhost/35549] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-18 21:53:42,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-18 21:53:42,276 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,276 DEBUG [Listener at localhost/35549] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-18 21:53:52,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-18 21:53:52,297 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32795,DS-326f75c9-c7bc-446e-a6a4-693543faaa59,DISK] 2023-08-18 21:53:52,297 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35721,DS-bbb67da9-9879-4923-8d2f-fe7f55c84ce6,DISK] 2023-08-18 21:53:52,348 INFO [Listener at localhost/35549] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756/jenkins-hbase20.apache.org%2C38777%2C1692395590756.1692395591156 with entries=13, filesize=6.36 KB; new WAL /user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756/jenkins-hbase20.apache.org%2C38777%2C1692395590756.1692395632283 2023-08-18 21:53:52,349 DEBUG [Listener at localhost/35549] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32795,DS-326f75c9-c7bc-446e-a6a4-693543faaa59,DISK], DatanodeInfoWithStorage[127.0.0.1:35721,DS-bbb67da9-9879-4923-8d2f-fe7f55c84ce6,DISK]] 2023-08-18 21:53:52,349 DEBUG [Listener at localhost/35549] wal.AbstractFSWAL(716): hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756/jenkins-hbase20.apache.org%2C38777%2C1692395590756.1692395591156 is not closed yet, will try archiving it next time 2023-08-18 21:53:52,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-08-18 21:53:52,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-18 21:53:52,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,358 INFO [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-18 21:53:52,358 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-18 21:53:52,359 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-18 21:53:52,359 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-18 21:53:52,359 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,360 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,361 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,361 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-18 21:53:52,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-18 21:53:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-18 21:53:52,361 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,361 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-18 21:53:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-18 21:53:52,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,362 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,362 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-18 21:53:52,362 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,362 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-18 21:53:52,362 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-18 21:53:52,363 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-18 21:53:52,363 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-18 21:53:52,363 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-18 21:53:52,363 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:53:52,363 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. started... 2023-08-18 21:53:52,363 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 987ec7e5cfb6a05b07d965311ee352ab 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-18 21:53:52,376 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=13 (bloomFilter=true), to=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/.tmp/info/e09a0d9ea23842a9a89a7f7490edc486 2023-08-18 21:53:52,388 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/.tmp/info/e09a0d9ea23842a9a89a7f7490edc486 as hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/e09a0d9ea23842a9a89a7f7490edc486 2023-08-18 21:53:52,396 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/e09a0d9ea23842a9a89a7f7490edc486, entries=1, sequenceid=13, filesize=5.8 K 2023-08-18 21:53:52,397 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 987ec7e5cfb6a05b07d965311ee352ab in 34ms, sequenceid=13, compaction requested=true 2023-08-18 21:53:52,397 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 987ec7e5cfb6a05b07d965311ee352ab: 2023-08-18 21:53:52,397 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:53:52,397 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-18 21:53:52,398 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-18 21:53:52,398 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,398 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-18 21:53:52,398 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38777,1692395590756' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-18 21:53:52,400 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,400 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-18 21:53:52,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-18 21:53:52,401 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,401 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-18 21:53:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-18 21:53:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-18 21:53:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-18 21:53:52,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38777,1692395590756' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-18 21:53:52,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ad04b0f[Count = 0] remaining members to acquire global barrier 2023-08-18 21:53:52,402 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-18 21:53:52,402 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,403 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,403 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-18 21:53:52,403 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-18 21:53:52,403 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase20.apache.org,38777,1692395590756' in zk 2023-08-18 21:53:52,403 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,403 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-18 21:53:52,404 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-18 21:53:52,404 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-18 21:53:52,404 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-18 21:53:52,404 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-18 21:53:52,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-18 21:53:52,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-18 21:53:52,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-18 21:53:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-18 21:53:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase20.apache.org,38777,1692395590756': 2023-08-18 21:53:52,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38777,1692395590756' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-18 21:53:52,407 INFO [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-18 21:53:52,407 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-18 21:53:52,407 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-18 21:53:52,407 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,407 INFO [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-18 21:53:52,408 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,408 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-18 21:53:52,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-18 21:53:52,408 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-18 21:53:52,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-18 21:53:52,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-18 21:53:52,409 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-18 21:53:52,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-18 21:53:52,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,410 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-18 21:53:52,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,412 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-18 21:53:52,412 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-18 21:53:52,412 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-18 21:53:52,412 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-18 21:53:52,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-18 21:53:52,412 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-18 21:53:52,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-18 21:53:52,412 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,413 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:53:52,413 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-18 21:53:52,413 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-18 21:53:52,413 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:53:52,413 DEBUG [Listener at localhost/35549] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-18 21:53:52,413 DEBUG [Listener at localhost/35549] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-18 21:54:02,413 DEBUG [Listener at localhost/35549] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-18 21:54:02,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-18 21:54:02,421 DEBUG [Listener at localhost/35549] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-18 21:54:02,429 DEBUG [Listener at localhost/35549] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 17694 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-18 21:54:02,431 DEBUG [Listener at localhost/35549] regionserver.HStore(1912): 987ec7e5cfb6a05b07d965311ee352ab/info is initiating minor compaction (all files) 2023-08-18 21:54:02,431 INFO [Listener at localhost/35549] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-18 21:54:02,431 INFO [Listener at localhost/35549] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:02,431 INFO [Listener at localhost/35549] regionserver.HRegion(2259): Starting compaction of 987ec7e5cfb6a05b07d965311ee352ab/info in TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:54:02,431 INFO [Listener at localhost/35549] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/0e7c4319d31b4c96b25baa0491050b85, hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/a4a5f15f9f9040f9a44835ac9b2025a0, hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/e09a0d9ea23842a9a89a7f7490edc486] into tmpdir=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/.tmp, totalSize=17.3 K 2023-08-18 21:54:02,432 DEBUG [Listener at localhost/35549] compactions.Compactor(207): Compacting 0e7c4319d31b4c96b25baa0491050b85, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1692395612113 2023-08-18 21:54:02,433 DEBUG [Listener at localhost/35549] compactions.Compactor(207): Compacting a4a5f15f9f9040f9a44835ac9b2025a0, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1692395622207 2023-08-18 21:54:02,433 DEBUG [Listener at localhost/35549] compactions.Compactor(207): Compacting e09a0d9ea23842a9a89a7f7490edc486, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1692395632280 2023-08-18 21:54:02,451 INFO [Listener at localhost/35549] throttle.PressureAwareThroughputController(145): 987ec7e5cfb6a05b07d965311ee352ab#info#compaction#9 average throughput is unlimited, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-18 21:54:02,471 DEBUG [Listener at localhost/35549] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/.tmp/info/efd87950df224d25b6871ec9ee0b48a7 as hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/efd87950df224d25b6871ec9ee0b48a7 2023-08-18 21:54:02,484 INFO [Listener at localhost/35549] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 987ec7e5cfb6a05b07d965311ee352ab/info of 987ec7e5cfb6a05b07d965311ee352ab into efd87950df224d25b6871ec9ee0b48a7(size=7.9 K), total size for store is 7.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-18 21:54:02,484 DEBUG [Listener at localhost/35549] regionserver.HRegion(2289): Compaction status journal for 987ec7e5cfb6a05b07d965311ee352ab: 2023-08-18 21:54:02,499 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35721,DS-bbb67da9-9879-4923-8d2f-fe7f55c84ce6,DISK] 2023-08-18 21:54:02,499 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32795,DS-326f75c9-c7bc-446e-a6a4-693543faaa59,DISK] 2023-08-18 21:54:02,502 INFO [Listener at localhost/35549] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756/jenkins-hbase20.apache.org%2C38777%2C1692395590756.1692395632283 with entries=4, filesize=2.43 KB; new WAL /user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756/jenkins-hbase20.apache.org%2C38777%2C1692395590756.1692395642486 2023-08-18 21:54:02,502 DEBUG [Listener at localhost/35549] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32795,DS-326f75c9-c7bc-446e-a6a4-693543faaa59,DISK], DatanodeInfoWithStorage[127.0.0.1:35721,DS-bbb67da9-9879-4923-8d2f-fe7f55c84ce6,DISK]] 2023-08-18 21:54:02,502 DEBUG [Listener at localhost/35549] wal.AbstractFSWAL(716): hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756/jenkins-hbase20.apache.org%2C38777%2C1692395590756.1692395632283 is not closed yet, will try archiving it next time 2023-08-18 21:54:02,502 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756/jenkins-hbase20.apache.org%2C38777%2C1692395590756.1692395591156 to hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/oldWALs/jenkins-hbase20.apache.org%2C38777%2C1692395590756.1692395591156 2023-08-18 21:54:02,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-08-18 21:54:02,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-18 21:54:02,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,510 INFO [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-18 21:54:02,511 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-18 21:54:02,511 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-18 21:54:02,511 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-18 21:54:02,512 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,512 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,513 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,513 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-18 21:54:02,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-18 21:54:02,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-18 21:54:02,514 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,514 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-18 21:54:02,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-18 21:54:02,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,515 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,515 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-18 21:54:02,515 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,515 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-18 21:54:02,515 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-18 21:54:02,515 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-18 21:54:02,515 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-18 21:54:02,515 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-18 21:54:02,516 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:54:02,516 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. started... 2023-08-18 21:54:02,516 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 987ec7e5cfb6a05b07d965311ee352ab 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-18 21:54:02,532 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=18 (bloomFilter=true), to=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/.tmp/info/9be01a748e984ce4bf043e3bbeec5a2e 2023-08-18 21:54:02,542 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/.tmp/info/9be01a748e984ce4bf043e3bbeec5a2e as hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/9be01a748e984ce4bf043e3bbeec5a2e 2023-08-18 21:54:02,550 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/9be01a748e984ce4bf043e3bbeec5a2e, entries=1, sequenceid=18, filesize=5.8 K 2023-08-18 21:54:02,551 INFO [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 987ec7e5cfb6a05b07d965311ee352ab in 35ms, sequenceid=18, compaction requested=false 2023-08-18 21:54:02,551 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 987ec7e5cfb6a05b07d965311ee352ab: 2023-08-18 21:54:02,551 DEBUG [rs(jenkins-hbase20.apache.org,38777,1692395590756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:54:02,551 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-18 21:54:02,552 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-18 21:54:02,552 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,552 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-18 21:54:02,552 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38777,1692395590756' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-18 21:54:02,553 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,553 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-18 21:54:02,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-18 21:54:02,554 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,554 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-18 21:54:02,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-18 21:54:02,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-18 21:54:02,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-18 21:54:02,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38777,1692395590756' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-18 21:54:02,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b167675[Count = 0] remaining members to acquire global barrier 2023-08-18 21:54:02,555 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-18 21:54:02,556 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,556 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,556 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-18 21:54:02,557 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-18 21:54:02,557 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase20.apache.org,38777,1692395590756' in zk 2023-08-18 21:54:02,557 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,557 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-18 21:54:02,557 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,557 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-18 21:54:02,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,558 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-18 21:54:02,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-18 21:54:02,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-18 21:54:02,558 DEBUG [member: 'jenkins-hbase20.apache.org,38777,1692395590756' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-18 21:54:02,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-18 21:54:02,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-18 21:54:02,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-18 21:54:02,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase20.apache.org,38777,1692395590756': 2023-08-18 21:54:02,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38777,1692395590756' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-18 21:54:02,561 INFO [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-18 21:54:02,561 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-18 21:54:02,561 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-18 21:54:02,561 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,561 INFO [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-18 21:54:02,575 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,575 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-18 21:54:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-18 21:54:02,575 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-18 21:54:02,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-18 21:54:02,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-18 21:54:02,576 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-18 21:54:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-18 21:54:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,577 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-18 21:54:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,579 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-18 21:54:02,579 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-18 21:54:02,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-18 21:54:02,579 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-18 21:54:02,579 DEBUG [(jenkins-hbase20.apache.org,41155,1692395590711)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-18 21:54:02,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-18 21:54:02,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-18 21:54:02,579 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,580 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-18 21:54:02,580 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:02,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-18 21:54:02,580 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,580 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,580 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-18 21:54:02,580 DEBUG [Listener at localhost/35549] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-18 21:54:02,580 DEBUG [Listener at localhost/35549] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-18 21:54:12,580 DEBUG [Listener at localhost/35549] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-18 21:54:12,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41155] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-18 21:54:12,604 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32795,DS-326f75c9-c7bc-446e-a6a4-693543faaa59,DISK] 2023-08-18 21:54:12,604 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35721,DS-bbb67da9-9879-4923-8d2f-fe7f55c84ce6,DISK] 2023-08-18 21:54:12,606 INFO [Listener at localhost/35549] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756/jenkins-hbase20.apache.org%2C38777%2C1692395590756.1692395642486 with entries=3, filesize=1.94 KB; new WAL /user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756/jenkins-hbase20.apache.org%2C38777%2C1692395590756.1692395652590 2023-08-18 21:54:12,606 DEBUG [Listener at localhost/35549] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35721,DS-bbb67da9-9879-4923-8d2f-fe7f55c84ce6,DISK], DatanodeInfoWithStorage[127.0.0.1:32795,DS-326f75c9-c7bc-446e-a6a4-693543faaa59,DISK]] 2023-08-18 21:54:12,606 DEBUG [Listener at localhost/35549] wal.AbstractFSWAL(716): hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756/jenkins-hbase20.apache.org%2C38777%2C1692395590756.1692395642486 is not closed yet, will try archiving it next time 2023-08-18 21:54:12,606 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/WALs/jenkins-hbase20.apache.org,38777,1692395590756/jenkins-hbase20.apache.org%2C38777%2C1692395590756.1692395632283 to hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/oldWALs/jenkins-hbase20.apache.org%2C38777%2C1692395590756.1692395632283 2023-08-18 21:54:12,607 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-18 21:54:12,607 INFO [Listener at localhost/35549] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-18 21:54:12,607 DEBUG [Listener at localhost/35549] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ca8ec10 to 127.0.0.1:63726 2023-08-18 21:54:12,607 DEBUG [Listener at localhost/35549] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:54:12,608 DEBUG [Listener at localhost/35549] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-18 21:54:12,608 DEBUG [Listener at localhost/35549] util.JVMClusterUtil(257): Found active master hash=2020729526, stopped=false 2023-08-18 21:54:12,608 INFO [Listener at localhost/35549] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,41155,1692395590711 2023-08-18 21:54:12,611 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-18 21:54:12,611 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-18 21:54:12,611 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:54:12,611 INFO [Listener at localhost/35549] procedure2.ProcedureExecutor(629): Stopping 2023-08-18 21:54:12,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:54:12,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:54:12,612 DEBUG [Listener at localhost/35549] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x788988e3 to 127.0.0.1:63726 2023-08-18 21:54:12,613 DEBUG [Listener at localhost/35549] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:54:12,613 INFO [Listener at localhost/35549] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,38777,1692395590756' ***** 2023-08-18 21:54:12,613 INFO [Listener at localhost/35549] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-18 21:54:12,613 INFO [RS:0;jenkins-hbase20:38777] regionserver.HeapMemoryManager(220): Stopping 2023-08-18 21:54:12,613 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-18 21:54:12,613 INFO [RS:0;jenkins-hbase20:38777] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-18 21:54:12,614 INFO [RS:0;jenkins-hbase20:38777] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-18 21:54:12,614 INFO [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(3305): Received CLOSE for b29b788841828f0d9e898f3cac7fc50b 2023-08-18 21:54:12,614 INFO [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(3305): Received CLOSE for 987ec7e5cfb6a05b07d965311ee352ab 2023-08-18 21:54:12,614 INFO [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:12,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b29b788841828f0d9e898f3cac7fc50b, disabling compactions & flushes 2023-08-18 21:54:12,614 DEBUG [RS:0;jenkins-hbase20:38777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70bee9be to 127.0.0.1:63726 2023-08-18 21:54:12,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. 2023-08-18 21:54:12,614 DEBUG [RS:0;jenkins-hbase20:38777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:54:12,614 INFO [RS:0;jenkins-hbase20:38777] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-18 21:54:12,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. 2023-08-18 21:54:12,614 INFO [RS:0;jenkins-hbase20:38777] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-18 21:54:12,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. after waiting 0 ms 2023-08-18 21:54:12,614 INFO [RS:0;jenkins-hbase20:38777] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-18 21:54:12,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. 2023-08-18 21:54:12,614 INFO [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-18 21:54:12,615 INFO [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-08-18 21:54:12,615 DEBUG [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(1478): Online Regions={b29b788841828f0d9e898f3cac7fc50b=hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b., 1588230740=hbase:meta,,1.1588230740, 987ec7e5cfb6a05b07d965311ee352ab=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab.} 2023-08-18 21:54:12,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-18 21:54:12,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-18 21:54:12,616 DEBUG [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(1504): Waiting on 1588230740, 987ec7e5cfb6a05b07d965311ee352ab, b29b788841828f0d9e898f3cac7fc50b 2023-08-18 21:54:12,616 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-18 21:54:12,616 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-18 21:54:12,616 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-18 21:54:12,616 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=3.10 KB heapSize=5.61 KB 2023-08-18 21:54:12,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/namespace/b29b788841828f0d9e898f3cac7fc50b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-18 21:54:12,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. 2023-08-18 21:54:12,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b29b788841828f0d9e898f3cac7fc50b: 2023-08-18 21:54:12,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1692395591397.b29b788841828f0d9e898f3cac7fc50b. 2023-08-18 21:54:12,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 987ec7e5cfb6a05b07d965311ee352ab, disabling compactions & flushes 2023-08-18 21:54:12,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:54:12,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:54:12,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. after waiting 0 ms 2023-08-18 21:54:12,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:54:12,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 987ec7e5cfb6a05b07d965311ee352ab 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-18 21:54:12,646 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.85 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/.tmp/info/1c056f1e06a24e9cacd50db059e004ef 2023-08-18 21:54:12,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=22 (bloomFilter=true), to=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/.tmp/info/7186d27ea9b4402f9158e61960439197 2023-08-18 21:54:12,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/.tmp/info/7186d27ea9b4402f9158e61960439197 as hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/7186d27ea9b4402f9158e61960439197 2023-08-18 21:54:12,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/7186d27ea9b4402f9158e61960439197, entries=1, sequenceid=22, filesize=5.8 K 2023-08-18 21:54:12,663 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=264 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/.tmp/table/9959ad0c1e294a7a8823c4f872baa92e 2023-08-18 21:54:12,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 987ec7e5cfb6a05b07d965311ee352ab in 41ms, sequenceid=22, compaction requested=true 2023-08-18 21:54:12,667 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/0e7c4319d31b4c96b25baa0491050b85, hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/a4a5f15f9f9040f9a44835ac9b2025a0, hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/e09a0d9ea23842a9a89a7f7490edc486] to archive 2023-08-18 21:54:12,668 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-18 21:54:12,671 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/0e7c4319d31b4c96b25baa0491050b85 to hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/0e7c4319d31b4c96b25baa0491050b85 2023-08-18 21:54:12,672 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/a4a5f15f9f9040f9a44835ac9b2025a0 to hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/a4a5f15f9f9040f9a44835ac9b2025a0 2023-08-18 21:54:12,674 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/e09a0d9ea23842a9a89a7f7490edc486 to hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/info/e09a0d9ea23842a9a89a7f7490edc486 2023-08-18 21:54:12,678 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/.tmp/info/1c056f1e06a24e9cacd50db059e004ef as hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/info/1c056f1e06a24e9cacd50db059e004ef 2023-08-18 21:54:12,686 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/info/1c056f1e06a24e9cacd50db059e004ef, entries=20, sequenceid=14, filesize=7.6 K 2023-08-18 21:54:12,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/.tmp/table/9959ad0c1e294a7a8823c4f872baa92e as hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/table/9959ad0c1e294a7a8823c4f872baa92e 2023-08-18 21:54:12,696 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/table/9959ad0c1e294a7a8823c4f872baa92e, entries=4, sequenceid=14, filesize=4.9 K 2023-08-18 21:54:12,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.10 KB/3178, heapSize ~5.33 KB/5456, currentSize=0 B/0 for 1588230740 in 82ms, sequenceid=14, compaction requested=false 2023-08-18 21:54:12,707 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-08-18 21:54:12,710 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-18 21:54:12,711 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-18 21:54:12,711 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-18 21:54:12,711 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-18 21:54:12,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/987ec7e5cfb6a05b07d965311ee352ab/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=1 2023-08-18 21:54:12,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:54:12,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 987ec7e5cfb6a05b07d965311ee352ab: 2023-08-18 21:54:12,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692395592002.987ec7e5cfb6a05b07d965311ee352ab. 2023-08-18 21:54:12,816 INFO [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,38777,1692395590756; all regions closed. 2023-08-18 21:54:12,822 DEBUG [RS:0;jenkins-hbase20:38777] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/oldWALs 2023-08-18 21:54:12,822 INFO [RS:0;jenkins-hbase20:38777] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38777%2C1692395590756.meta:.meta(num 1692395591328) 2023-08-18 21:54:12,829 DEBUG [RS:0;jenkins-hbase20:38777] wal.AbstractFSWAL(1028): Moved 2 WAL file(s) to /user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/oldWALs 2023-08-18 21:54:12,830 INFO [RS:0;jenkins-hbase20:38777] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38777%2C1692395590756:(num 1692395652590) 2023-08-18 21:54:12,830 DEBUG [RS:0;jenkins-hbase20:38777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:54:12,830 INFO [RS:0;jenkins-hbase20:38777] regionserver.LeaseManager(133): Closed leases 2023-08-18 21:54:12,830 INFO [RS:0;jenkins-hbase20:38777] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-08-18 21:54:12,830 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-18 21:54:12,831 INFO [RS:0;jenkins-hbase20:38777] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38777 2023-08-18 21:54:12,833 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-18 21:54:12,833 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38777,1692395590756 2023-08-18 21:54:12,833 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-18 21:54:12,834 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,38777,1692395590756] 2023-08-18 21:54:12,834 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,38777,1692395590756; numProcessing=1 2023-08-18 21:54:12,835 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,38777,1692395590756 already deleted, retry=false 2023-08-18 21:54:12,835 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,38777,1692395590756 expired; onlineServers=0 2023-08-18 21:54:12,835 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,41155,1692395590711' ***** 2023-08-18 21:54:12,835 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-18 21:54:12,836 DEBUG [M:0;jenkins-hbase20:41155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c4e7960, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-08-18 21:54:12,836 INFO [M:0;jenkins-hbase20:41155] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,41155,1692395590711 2023-08-18 21:54:12,836 INFO [M:0;jenkins-hbase20:41155] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,41155,1692395590711; all regions closed. 2023-08-18 21:54:12,836 DEBUG [M:0;jenkins-hbase20:41155] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:54:12,836 DEBUG [M:0;jenkins-hbase20:41155] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-18 21:54:12,836 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-18 21:54:12,836 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1692395590936] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1692395590936,5,FailOnTimeoutGroup] 2023-08-18 21:54:12,836 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1692395590934] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1692395590934,5,FailOnTimeoutGroup] 2023-08-18 21:54:12,836 DEBUG [M:0;jenkins-hbase20:41155] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-18 21:54:12,837 INFO [M:0;jenkins-hbase20:41155] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-18 21:54:12,837 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-18 21:54:12,837 INFO [M:0;jenkins-hbase20:41155] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-18 21:54:12,837 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:54:12,837 INFO [M:0;jenkins-hbase20:41155] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-08-18 21:54:12,837 DEBUG [M:0;jenkins-hbase20:41155] master.HMaster(1512): Stopping service threads 2023-08-18 21:54:12,837 INFO [M:0;jenkins-hbase20:41155] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-18 21:54:12,837 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-18 21:54:12,838 ERROR [M:0;jenkins-hbase20:41155] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-08-18 21:54:12,838 INFO [M:0;jenkins-hbase20:41155] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-18 21:54:12,838 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-18 21:54:12,838 DEBUG [M:0;jenkins-hbase20:41155] zookeeper.ZKUtil(398): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-18 21:54:12,838 WARN [M:0;jenkins-hbase20:41155] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-18 21:54:12,838 INFO [M:0;jenkins-hbase20:41155] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-18 21:54:12,839 INFO [M:0;jenkins-hbase20:41155] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-18 21:54:12,839 DEBUG [M:0;jenkins-hbase20:41155] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-18 21:54:12,839 INFO [M:0;jenkins-hbase20:41155] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:54:12,839 DEBUG [M:0;jenkins-hbase20:41155] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:54:12,839 DEBUG [M:0;jenkins-hbase20:41155] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-18 21:54:12,839 DEBUG [M:0;jenkins-hbase20:41155] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:54:12,839 INFO [M:0;jenkins-hbase20:41155] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.93 KB heapSize=47.38 KB 2023-08-18 21:54:12,855 INFO [M:0;jenkins-hbase20:41155] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.93 KB at sequenceid=100 (bloomFilter=true), to=hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/69941f96e2cd4f0685d333babbfc01c5 2023-08-18 21:54:12,862 INFO [M:0;jenkins-hbase20:41155] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69941f96e2cd4f0685d333babbfc01c5 2023-08-18 21:54:12,863 DEBUG [M:0;jenkins-hbase20:41155] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/69941f96e2cd4f0685d333babbfc01c5 as hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/69941f96e2cd4f0685d333babbfc01c5 2023-08-18 21:54:12,869 INFO [M:0;jenkins-hbase20:41155] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69941f96e2cd4f0685d333babbfc01c5 2023-08-18 21:54:12,869 INFO [M:0;jenkins-hbase20:41155] regionserver.HStore(1080): Added hdfs://localhost:42425/user/jenkins/test-data/5afc1a33-a59f-a108-664c-3e7e2aa0fef3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/69941f96e2cd4f0685d333babbfc01c5, entries=11, sequenceid=100, filesize=6.1 K 2023-08-18 21:54:12,870 INFO [M:0;jenkins-hbase20:41155] regionserver.HRegion(2948): Finished flush of dataSize ~38.93 KB/39866, heapSize ~47.36 KB/48496, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=100, compaction requested=false 2023-08-18 21:54:12,871 INFO [M:0;jenkins-hbase20:41155] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:54:12,871 DEBUG [M:0;jenkins-hbase20:41155] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-18 21:54:12,874 INFO [M:0;jenkins-hbase20:41155] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-18 21:54:12,874 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-18 21:54:12,874 INFO [M:0;jenkins-hbase20:41155] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41155 2023-08-18 21:54:12,876 DEBUG [M:0;jenkins-hbase20:41155] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,41155,1692395590711 already deleted, retry=false 2023-08-18 21:54:12,934 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:54:12,935 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): regionserver:38777-0x1000ce625420001, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:54:12,934 INFO [RS:0;jenkins-hbase20:38777] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,38777,1692395590756; zookeeper connection closed. 2023-08-18 21:54:12,936 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5699a6b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5699a6b 2023-08-18 21:54:12,936 INFO [Listener at localhost/35549] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-18 21:54:13,030 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-18 21:54:13,035 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:54:13,035 INFO [M:0;jenkins-hbase20:41155] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,41155,1692395590711; zookeeper connection closed. 2023-08-18 21:54:13,035 DEBUG [Listener at localhost/35549-EventThread] zookeeper.ZKWatcher(600): master:41155-0x1000ce625420000, quorum=127.0.0.1:63726, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:54:13,036 WARN [Listener at localhost/35549] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-18 21:54:13,045 INFO [Listener at localhost/35549] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:54:13,151 WARN [BP-1261884853-148.251.75.209-1692395590218 heartbeating to localhost/127.0.0.1:42425] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-18 21:54:13,151 WARN [BP-1261884853-148.251.75.209-1692395590218 heartbeating to localhost/127.0.0.1:42425] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1261884853-148.251.75.209-1692395590218 (Datanode Uuid 9b89b740-d3f2-439f-b20f-0d78d50394b8) service to localhost/127.0.0.1:42425 2023-08-18 21:54:13,152 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/cluster_b6998cf1-c11b-3dae-3265-3fe426ebc45a/dfs/data/data3/current/BP-1261884853-148.251.75.209-1692395590218] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:54:13,152 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/cluster_b6998cf1-c11b-3dae-3265-3fe426ebc45a/dfs/data/data4/current/BP-1261884853-148.251.75.209-1692395590218] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:54:13,155 WARN [Listener at localhost/35549] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-18 21:54:13,160 INFO [Listener at localhost/35549] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:54:13,269 WARN [BP-1261884853-148.251.75.209-1692395590218 heartbeating to localhost/127.0.0.1:42425] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-18 21:54:13,270 WARN [BP-1261884853-148.251.75.209-1692395590218 heartbeating to localhost/127.0.0.1:42425] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1261884853-148.251.75.209-1692395590218 (Datanode Uuid d7c4321c-84ab-4d1c-822c-1aff422cbbea) service to localhost/127.0.0.1:42425 2023-08-18 21:54:13,271 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/cluster_b6998cf1-c11b-3dae-3265-3fe426ebc45a/dfs/data/data1/current/BP-1261884853-148.251.75.209-1692395590218] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:54:13,273 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/cluster_b6998cf1-c11b-3dae-3265-3fe426ebc45a/dfs/data/data2/current/BP-1261884853-148.251.75.209-1692395590218] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:54:13,287 INFO [Listener at localhost/35549] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:54:13,406 INFO [Listener at localhost/35549] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-18 21:54:13,423 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-18 21:54:13,431 INFO [Listener at localhost/35549] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=63 (was 78), OpenFileDescriptor=435 (was 465), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=159 (was 286), ProcessCount=168 (was 168), AvailableMemoryMB=2642 (was 3166) 2023-08-18 21:54:13,438 INFO [Listener at localhost/35549] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=64, OpenFileDescriptor=435, MaxFileDescriptor=60000, SystemLoadAverage=159, ProcessCount=168, AvailableMemoryMB=2642 2023-08-18 21:54:13,438 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-18 21:54:13,438 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/hadoop.log.dir so I do NOT create it in target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e 2023-08-18 21:54:13,438 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b0191d-1363-b2d6-3c73-3a464ebe19f9/hadoop.tmp.dir so I do NOT create it in target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e 2023-08-18 21:54:13,438 INFO [Listener at localhost/35549] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/cluster_08b0cf47-de67-7890-9b90-e2d5581194a5, deleteOnExit=true 2023-08-18 21:54:13,438 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-18 21:54:13,439 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/test.cache.data in system properties and HBase conf 2023-08-18 21:54:13,439 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/hadoop.tmp.dir in system properties and HBase conf 2023-08-18 21:54:13,439 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/hadoop.log.dir in system properties and HBase conf 2023-08-18 21:54:13,439 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-18 21:54:13,439 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-18 21:54:13,439 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-18 21:54:13,439 DEBUG [Listener at localhost/35549] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-18 21:54:13,440 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-18 21:54:13,440 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-18 21:54:13,440 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-18 21:54:13,440 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-18 21:54:13,440 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-18 21:54:13,440 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-18 21:54:13,440 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-18 21:54:13,441 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-18 21:54:13,441 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-18 21:54:13,441 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/nfs.dump.dir in system properties and HBase conf 2023-08-18 21:54:13,441 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/java.io.tmpdir in system properties and HBase conf 2023-08-18 21:54:13,441 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-18 21:54:13,441 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-18 21:54:13,441 INFO [Listener at localhost/35549] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-18 21:54:13,444 WARN [Listener at localhost/35549] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-18 21:54:13,444 WARN [Listener at localhost/35549] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-18 21:54:13,467 WARN [Listener at localhost/35549] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:54:13,469 INFO [Listener at localhost/35549] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:54:13,474 INFO [Listener at localhost/35549] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/java.io.tmpdir/Jetty_localhost_45105_hdfs____i40znj/webapp 2023-08-18 21:54:13,546 INFO [Listener at localhost/35549] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45105 2023-08-18 21:54:13,548 WARN [Listener at localhost/35549] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-18 21:54:13,549 WARN [Listener at localhost/35549] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-18 21:54:13,570 WARN [Listener at localhost/36783] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:54:13,582 WARN [Listener at localhost/36783] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-18 21:54:13,584 WARN [Listener at localhost/36783] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:54:13,585 INFO [Listener at localhost/36783] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:54:13,590 INFO [Listener at localhost/36783] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/java.io.tmpdir/Jetty_localhost_39947_datanode____psoxp/webapp 2023-08-18 21:54:13,663 INFO [Listener at localhost/36783] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39947 2023-08-18 21:54:13,668 WARN [Listener at localhost/35119] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:54:13,677 WARN [Listener at localhost/35119] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-18 21:54:13,679 WARN [Listener at localhost/35119] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:54:13,680 INFO [Listener at localhost/35119] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:54:13,682 INFO [Listener at localhost/35119] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/java.io.tmpdir/Jetty_localhost_38169_datanode____.3mq7ai/webapp 2023-08-18 21:54:13,726 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe800f48e064e773e: Processing first storage report for DS-22a9a99d-5b2d-4afb-876d-f921623ecc52 from datanode eb7654ad-1276-4680-9faa-de4cde2535a2 2023-08-18 21:54:13,726 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe800f48e064e773e: from storage DS-22a9a99d-5b2d-4afb-876d-f921623ecc52 node DatanodeRegistration(127.0.0.1:45451, datanodeUuid=eb7654ad-1276-4680-9faa-de4cde2535a2, infoPort=37039, infoSecurePort=0, ipcPort=35119, storageInfo=lv=-57;cid=testClusterID;nsid=1257998828;c=1692395653446), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-18 21:54:13,726 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe800f48e064e773e: Processing first storage report for DS-aaaa39d2-09c7-4fb0-a36a-80e9ccda353d from datanode eb7654ad-1276-4680-9faa-de4cde2535a2 2023-08-18 21:54:13,726 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe800f48e064e773e: from storage DS-aaaa39d2-09c7-4fb0-a36a-80e9ccda353d node DatanodeRegistration(127.0.0.1:45451, datanodeUuid=eb7654ad-1276-4680-9faa-de4cde2535a2, infoPort=37039, infoSecurePort=0, ipcPort=35119, storageInfo=lv=-57;cid=testClusterID;nsid=1257998828;c=1692395653446), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:54:13,759 INFO [Listener at localhost/35119] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38169 2023-08-18 21:54:13,765 WARN [Listener at localhost/43617] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:54:13,817 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9b55d463678e3785: Processing first storage report for DS-4de6e420-299f-4cf3-8f66-78f9a6f1e1f3 from datanode a21648ec-45f5-4e59-87a6-ac1401e72ea7 2023-08-18 21:54:13,817 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9b55d463678e3785: from storage DS-4de6e420-299f-4cf3-8f66-78f9a6f1e1f3 node DatanodeRegistration(127.0.0.1:46083, datanodeUuid=a21648ec-45f5-4e59-87a6-ac1401e72ea7, infoPort=34221, infoSecurePort=0, ipcPort=43617, storageInfo=lv=-57;cid=testClusterID;nsid=1257998828;c=1692395653446), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:54:13,818 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9b55d463678e3785: Processing first storage report for DS-2ee30e6c-1dc1-4bb7-a436-4408fc80afeb from datanode a21648ec-45f5-4e59-87a6-ac1401e72ea7 2023-08-18 21:54:13,818 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9b55d463678e3785: from storage DS-2ee30e6c-1dc1-4bb7-a436-4408fc80afeb node DatanodeRegistration(127.0.0.1:46083, datanodeUuid=a21648ec-45f5-4e59-87a6-ac1401e72ea7, infoPort=34221, infoSecurePort=0, ipcPort=43617, storageInfo=lv=-57;cid=testClusterID;nsid=1257998828;c=1692395653446), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:54:13,874 DEBUG [Listener at localhost/43617] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e 2023-08-18 21:54:13,879 INFO [Listener at localhost/43617] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/cluster_08b0cf47-de67-7890-9b90-e2d5581194a5/zookeeper_0, clientPort=56270, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/cluster_08b0cf47-de67-7890-9b90-e2d5581194a5/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/cluster_08b0cf47-de67-7890-9b90-e2d5581194a5/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-18 21:54:13,881 INFO [Listener at localhost/43617] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56270 2023-08-18 21:54:13,881 INFO [Listener at localhost/43617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:54:13,883 INFO [Listener at localhost/43617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:54:13,900 INFO [Listener at localhost/43617] util.FSUtils(471): Created version file at hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09 with version=8 2023-08-18 21:54:13,900 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/hbase-staging 2023-08-18 21:54:13,903 INFO [Listener at localhost/43617] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-08-18 21:54:13,903 INFO [Listener at localhost/43617] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:54:13,903 INFO [Listener at localhost/43617] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-18 21:54:13,903 INFO [Listener at localhost/43617] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-18 21:54:13,903 INFO [Listener at localhost/43617] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:54:13,903 INFO [Listener at localhost/43617] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-18 21:54:13,904 INFO [Listener at localhost/43617] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-18 21:54:13,905 INFO [Listener at localhost/43617] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41299 2023-08-18 21:54:13,905 INFO [Listener at localhost/43617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:54:13,907 INFO [Listener at localhost/43617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:54:13,908 INFO [Listener at localhost/43617] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41299 connecting to ZooKeeper ensemble=127.0.0.1:56270 2023-08-18 21:54:13,912 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:412990x0, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-18 21:54:13,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41299-0x1000ce71c190000 connected 2023-08-18 21:54:13,922 DEBUG [Listener at localhost/43617] zookeeper.ZKUtil(164): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-18 21:54:13,922 DEBUG [Listener at localhost/43617] zookeeper.ZKUtil(164): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:54:13,923 DEBUG [Listener at localhost/43617] zookeeper.ZKUtil(164): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-18 21:54:13,924 DEBUG [Listener at localhost/43617] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41299 2023-08-18 21:54:13,924 DEBUG [Listener at localhost/43617] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41299 2023-08-18 21:54:13,924 DEBUG [Listener at localhost/43617] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41299 2023-08-18 21:54:13,924 DEBUG [Listener at localhost/43617] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41299 2023-08-18 21:54:13,925 DEBUG [Listener at localhost/43617] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41299 2023-08-18 21:54:13,925 INFO [Listener at localhost/43617] master.HMaster(444): hbase.rootdir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09, hbase.cluster.distributed=false 2023-08-18 21:54:13,940 INFO [Listener at localhost/43617] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-08-18 21:54:13,940 INFO [Listener at localhost/43617] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:54:13,940 INFO [Listener at localhost/43617] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-18 21:54:13,940 INFO [Listener at localhost/43617] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-18 21:54:13,941 INFO [Listener at localhost/43617] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:54:13,941 INFO [Listener at localhost/43617] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-18 21:54:13,941 INFO [Listener at localhost/43617] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-18 21:54:13,942 INFO [Listener at localhost/43617] ipc.NettyRpcServer(120): Bind to /148.251.75.209:43445 2023-08-18 21:54:13,942 INFO [Listener at localhost/43617] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-18 21:54:13,943 DEBUG [Listener at localhost/43617] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-18 21:54:13,944 INFO [Listener at localhost/43617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:54:13,944 INFO [Listener at localhost/43617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:54:13,945 INFO [Listener at localhost/43617] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43445 connecting to ZooKeeper ensemble=127.0.0.1:56270 2023-08-18 21:54:13,950 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): regionserver:434450x0, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-18 21:54:13,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43445-0x1000ce71c190001 connected 2023-08-18 21:54:13,951 DEBUG [Listener at localhost/43617] zookeeper.ZKUtil(164): regionserver:43445-0x1000ce71c190001, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-18 21:54:13,952 DEBUG [Listener at localhost/43617] zookeeper.ZKUtil(164): regionserver:43445-0x1000ce71c190001, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:54:13,952 DEBUG [Listener at localhost/43617] zookeeper.ZKUtil(164): regionserver:43445-0x1000ce71c190001, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-18 21:54:13,953 DEBUG [Listener at localhost/43617] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43445 2023-08-18 21:54:13,953 DEBUG [Listener at localhost/43617] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43445 2023-08-18 21:54:13,953 DEBUG [Listener at localhost/43617] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43445 2023-08-18 21:54:13,953 DEBUG [Listener at localhost/43617] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43445 2023-08-18 21:54:13,954 DEBUG [Listener at localhost/43617] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43445 2023-08-18 21:54:13,955 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,41299,1692395653902 2023-08-18 21:54:13,972 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-18 21:54:13,973 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,41299,1692395653902 2023-08-18 21:54:13,974 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-18 21:54:13,974 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x1000ce71c190001, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-18 21:54:13,975 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:54:13,975 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-18 21:54:13,976 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,41299,1692395653902 from backup master directory 2023-08-18 21:54:13,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-18 21:54:13,976 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,41299,1692395653902 2023-08-18 21:54:13,976 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-18 21:54:13,976 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-18 21:54:13,976 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,41299,1692395653902 2023-08-18 21:54:13,990 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/hbase.id with ID: 8ee0dcb4-62f7-4be5-887e-4c22d66e88ee 2023-08-18 21:54:14,001 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:54:14,003 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:54:14,012 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x611c5087 to 127.0.0.1:56270 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-18 21:54:14,017 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a0d85e9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-18 21:54:14,017 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-18 21:54:14,017 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-18 21:54:14,018 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-18 21:54:14,019 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/MasterData/data/master/store-tmp 2023-08-18 21:54:14,432 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:54:14,432 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-18 21:54:14,432 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:54:14,432 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:54:14,432 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-18 21:54:14,432 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:54:14,432 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:54:14,432 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-18 21:54:14,434 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/MasterData/WALs/jenkins-hbase20.apache.org,41299,1692395653902 2023-08-18 21:54:14,441 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41299%2C1692395653902, suffix=, logDir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/MasterData/WALs/jenkins-hbase20.apache.org,41299,1692395653902, archiveDir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/MasterData/oldWALs, maxLogs=10 2023-08-18 21:54:14,458 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45451,DS-22a9a99d-5b2d-4afb-876d-f921623ecc52,DISK] 2023-08-18 21:54:14,458 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46083,DS-4de6e420-299f-4cf3-8f66-78f9a6f1e1f3,DISK] 2023-08-18 21:54:14,460 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/MasterData/WALs/jenkins-hbase20.apache.org,41299,1692395653902/jenkins-hbase20.apache.org%2C41299%2C1692395653902.1692395654441 2023-08-18 21:54:14,460 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45451,DS-22a9a99d-5b2d-4afb-876d-f921623ecc52,DISK], DatanodeInfoWithStorage[127.0.0.1:46083,DS-4de6e420-299f-4cf3-8f66-78f9a6f1e1f3,DISK]] 2023-08-18 21:54:14,461 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-18 21:54:14,461 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:54:14,461 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:54:14,461 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:54:14,463 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:54:14,465 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-18 21:54:14,465 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-18 21:54:14,466 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:54:14,467 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:54:14,468 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:54:14,470 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:54:14,473 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-18 21:54:14,473 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=777793, jitterRate=-0.010985344648361206}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-18 21:54:14,473 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-18 21:54:14,473 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-18 21:54:14,475 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-18 21:54:14,475 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-18 21:54:14,475 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-18 21:54:14,475 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-18 21:54:14,476 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-18 21:54:14,476 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-18 21:54:14,478 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-18 21:54:14,480 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-18 21:54:14,490 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-18 21:54:14,491 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-18 21:54:14,491 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-18 21:54:14,491 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-18 21:54:14,492 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-18 21:54:14,493 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:54:14,494 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-18 21:54:14,494 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-18 21:54:14,495 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-18 21:54:14,496 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-18 21:54:14,496 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x1000ce71c190001, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-18 21:54:14,496 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:54:14,497 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,41299,1692395653902, sessionid=0x1000ce71c190000, setting cluster-up flag (Was=false) 2023-08-18 21:54:14,499 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:54:14,501 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-18 21:54:14,502 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,41299,1692395653902 2023-08-18 21:54:14,504 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:54:14,506 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-18 21:54:14,507 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,41299,1692395653902 2023-08-18 21:54:14,508 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/.hbase-snapshot/.tmp 2023-08-18 21:54:14,510 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-18 21:54:14,510 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:54:14,510 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:54:14,510 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:54:14,510 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:54:14,510 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-08-18 21:54:14,510 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:54:14,510 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-08-18 21:54:14,510 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:54:14,512 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1692395684512 2023-08-18 21:54:14,512 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-18 21:54:14,512 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-18 21:54:14,512 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-18 21:54:14,512 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-18 21:54:14,512 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-18 21:54:14,512 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-18 21:54:14,513 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:14,513 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-18 21:54:14,513 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-18 21:54:14,513 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-18 21:54:14,513 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-18 21:54:14,514 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-18 21:54:14,514 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-18 21:54:14,514 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-18 21:54:14,514 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1692395654514,5,FailOnTimeoutGroup] 2023-08-18 21:54:14,514 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1692395654514,5,FailOnTimeoutGroup] 2023-08-18 21:54:14,514 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:14,514 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-18 21:54:14,515 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:14,515 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:14,515 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-18 21:54:14,527 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-18 21:54:14,528 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-18 21:54:14,528 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09 2023-08-18 21:54:14,539 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:54:14,540 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-18 21:54:14,542 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/info 2023-08-18 21:54:14,542 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-18 21:54:14,543 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:54:14,543 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-18 21:54:14,545 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/rep_barrier 2023-08-18 21:54:14,545 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-18 21:54:14,546 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:54:14,546 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-18 21:54:14,547 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/table 2023-08-18 21:54:14,548 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-18 21:54:14,549 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:54:14,549 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740 2023-08-18 21:54:14,550 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740 2023-08-18 21:54:14,553 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-18 21:54:14,554 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-18 21:54:14,556 INFO [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(951): ClusterId : 8ee0dcb4-62f7-4be5-887e-4c22d66e88ee 2023-08-18 21:54:14,557 DEBUG [RS:0;jenkins-hbase20:43445] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-18 21:54:14,559 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-18 21:54:14,559 DEBUG [RS:0;jenkins-hbase20:43445] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-18 21:54:14,559 DEBUG [RS:0;jenkins-hbase20:43445] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-18 21:54:14,559 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=774020, jitterRate=-0.015782803297042847}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-18 21:54:14,559 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-18 21:54:14,560 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-18 21:54:14,560 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-18 21:54:14,560 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-18 21:54:14,560 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-18 21:54:14,560 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-18 21:54:14,560 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-18 21:54:14,560 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-18 21:54:14,561 DEBUG [RS:0;jenkins-hbase20:43445] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-18 21:54:14,562 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-18 21:54:14,562 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-18 21:54:14,562 DEBUG [RS:0;jenkins-hbase20:43445] zookeeper.ReadOnlyZKClient(139): Connect 0x0dd5cd43 to 127.0.0.1:56270 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-18 21:54:14,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-18 21:54:14,565 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-18 21:54:14,566 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-18 21:54:14,566 DEBUG [RS:0;jenkins-hbase20:43445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3123289, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-18 21:54:14,567 DEBUG [RS:0;jenkins-hbase20:43445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72da633, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-08-18 21:54:14,577 DEBUG [RS:0;jenkins-hbase20:43445] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:43445 2023-08-18 21:54:14,577 INFO [RS:0;jenkins-hbase20:43445] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-18 21:54:14,577 INFO [RS:0;jenkins-hbase20:43445] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-18 21:54:14,577 DEBUG [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(1022): About to register with Master. 2023-08-18 21:54:14,578 INFO [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,41299,1692395653902 with isa=jenkins-hbase20.apache.org/148.251.75.209:43445, startcode=1692395653940 2023-08-18 21:54:14,578 DEBUG [RS:0;jenkins-hbase20:43445] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-18 21:54:14,580 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46731, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-08-18 21:54:14,582 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41299] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:14,582 DEBUG [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09 2023-08-18 21:54:14,582 DEBUG [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36783 2023-08-18 21:54:14,582 DEBUG [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-18 21:54:14,583 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-18 21:54:14,584 DEBUG [RS:0;jenkins-hbase20:43445] zookeeper.ZKUtil(162): regionserver:43445-0x1000ce71c190001, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:14,584 WARN [RS:0;jenkins-hbase20:43445] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-18 21:54:14,584 INFO [RS:0;jenkins-hbase20:43445] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-18 21:54:14,584 DEBUG [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/WALs/jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:14,584 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,43445,1692395653940] 2023-08-18 21:54:14,589 DEBUG [RS:0;jenkins-hbase20:43445] zookeeper.ZKUtil(162): regionserver:43445-0x1000ce71c190001, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:14,590 DEBUG [RS:0;jenkins-hbase20:43445] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-18 21:54:14,590 INFO [RS:0;jenkins-hbase20:43445] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-18 21:54:14,592 INFO [RS:0;jenkins-hbase20:43445] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-18 21:54:14,592 INFO [RS:0;jenkins-hbase20:43445] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-18 21:54:14,592 INFO [RS:0;jenkins-hbase20:43445] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:14,593 INFO [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-18 21:54:14,594 INFO [RS:0;jenkins-hbase20:43445] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:14,594 DEBUG [RS:0;jenkins-hbase20:43445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:54:14,594 DEBUG [RS:0;jenkins-hbase20:43445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:54:14,594 DEBUG [RS:0;jenkins-hbase20:43445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:54:14,594 DEBUG [RS:0;jenkins-hbase20:43445] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:54:14,594 DEBUG [RS:0;jenkins-hbase20:43445] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:54:14,595 DEBUG [RS:0;jenkins-hbase20:43445] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-08-18 21:54:14,595 DEBUG [RS:0;jenkins-hbase20:43445] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:54:14,595 DEBUG [RS:0;jenkins-hbase20:43445] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:54:14,595 DEBUG [RS:0;jenkins-hbase20:43445] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:54:14,595 DEBUG [RS:0;jenkins-hbase20:43445] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:54:14,595 INFO [RS:0;jenkins-hbase20:43445] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:14,596 INFO [RS:0;jenkins-hbase20:43445] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:14,596 INFO [RS:0;jenkins-hbase20:43445] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:14,606 INFO [RS:0;jenkins-hbase20:43445] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-18 21:54:14,606 INFO [RS:0;jenkins-hbase20:43445] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43445,1692395653940-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:14,613 INFO [RS:0;jenkins-hbase20:43445] regionserver.Replication(203): jenkins-hbase20.apache.org,43445,1692395653940 started 2023-08-18 21:54:14,614 INFO [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,43445,1692395653940, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:43445, sessionid=0x1000ce71c190001 2023-08-18 21:54:14,614 DEBUG [RS:0;jenkins-hbase20:43445] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-18 21:54:14,614 DEBUG [RS:0;jenkins-hbase20:43445] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:14,614 DEBUG [RS:0;jenkins-hbase20:43445] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43445,1692395653940' 2023-08-18 21:54:14,614 DEBUG [RS:0;jenkins-hbase20:43445] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-18 21:54:14,614 DEBUG [RS:0;jenkins-hbase20:43445] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-18 21:54:14,614 DEBUG [RS:0;jenkins-hbase20:43445] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-18 21:54:14,614 DEBUG [RS:0;jenkins-hbase20:43445] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-18 21:54:14,615 DEBUG [RS:0;jenkins-hbase20:43445] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:14,615 DEBUG [RS:0;jenkins-hbase20:43445] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43445,1692395653940' 2023-08-18 21:54:14,615 DEBUG [RS:0;jenkins-hbase20:43445] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-18 21:54:14,615 DEBUG [RS:0;jenkins-hbase20:43445] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-18 21:54:14,615 DEBUG [RS:0;jenkins-hbase20:43445] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-18 21:54:14,615 INFO [RS:0;jenkins-hbase20:43445] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-18 21:54:14,615 INFO [RS:0;jenkins-hbase20:43445] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-18 21:54:14,717 DEBUG [jenkins-hbase20:41299] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-18 21:54:14,718 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,43445,1692395653940, state=OPENING 2023-08-18 21:54:14,720 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-18 21:54:14,720 INFO [RS:0;jenkins-hbase20:43445] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43445%2C1692395653940, suffix=, logDir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/WALs/jenkins-hbase20.apache.org,43445,1692395653940, archiveDir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/oldWALs, maxLogs=32 2023-08-18 21:54:14,721 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:54:14,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,43445,1692395653940}] 2023-08-18 21:54:14,722 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-18 21:54:14,739 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45451,DS-22a9a99d-5b2d-4afb-876d-f921623ecc52,DISK] 2023-08-18 21:54:14,739 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46083,DS-4de6e420-299f-4cf3-8f66-78f9a6f1e1f3,DISK] 2023-08-18 21:54:14,741 INFO [RS:0;jenkins-hbase20:43445] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/WALs/jenkins-hbase20.apache.org,43445,1692395653940/jenkins-hbase20.apache.org%2C43445%2C1692395653940.1692395654721 2023-08-18 21:54:14,741 DEBUG [RS:0;jenkins-hbase20:43445] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45451,DS-22a9a99d-5b2d-4afb-876d-f921623ecc52,DISK], DatanodeInfoWithStorage[127.0.0.1:46083,DS-4de6e420-299f-4cf3-8f66-78f9a6f1e1f3,DISK]] 2023-08-18 21:54:14,878 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:14,879 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-18 21:54:14,883 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-18 21:54:14,890 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-18 21:54:14,891 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-18 21:54:14,894 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43445%2C1692395653940.meta, suffix=.meta, logDir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/WALs/jenkins-hbase20.apache.org,43445,1692395653940, archiveDir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/oldWALs, maxLogs=32 2023-08-18 21:54:14,910 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46083,DS-4de6e420-299f-4cf3-8f66-78f9a6f1e1f3,DISK] 2023-08-18 21:54:14,910 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45451,DS-22a9a99d-5b2d-4afb-876d-f921623ecc52,DISK] 2023-08-18 21:54:14,912 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/WALs/jenkins-hbase20.apache.org,43445,1692395653940/jenkins-hbase20.apache.org%2C43445%2C1692395653940.meta.1692395654895.meta 2023-08-18 21:54:14,913 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46083,DS-4de6e420-299f-4cf3-8f66-78f9a6f1e1f3,DISK], DatanodeInfoWithStorage[127.0.0.1:45451,DS-22a9a99d-5b2d-4afb-876d-f921623ecc52,DISK]] 2023-08-18 21:54:14,913 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-18 21:54:14,913 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-18 21:54:14,913 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-18 21:54:14,913 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-18 21:54:14,914 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-18 21:54:14,914 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:54:14,914 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-18 21:54:14,914 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-18 21:54:14,915 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-18 21:54:14,916 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/info 2023-08-18 21:54:14,917 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/info 2023-08-18 21:54:14,917 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-18 21:54:14,918 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:54:14,918 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-18 21:54:14,919 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/rep_barrier 2023-08-18 21:54:14,919 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/rep_barrier 2023-08-18 21:54:14,920 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-18 21:54:14,920 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:54:14,920 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-18 21:54:14,921 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/table 2023-08-18 21:54:14,921 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/table 2023-08-18 21:54:14,922 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-18 21:54:14,922 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:54:14,923 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740 2023-08-18 21:54:14,925 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740 2023-08-18 21:54:14,927 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-18 21:54:14,928 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-18 21:54:14,928 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=868772, jitterRate=0.1047019213438034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-18 21:54:14,928 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-18 21:54:14,929 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1692395654878 2023-08-18 21:54:14,932 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-18 21:54:14,933 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-18 21:54:14,933 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,43445,1692395653940, state=OPEN 2023-08-18 21:54:14,934 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-18 21:54:14,934 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-18 21:54:14,936 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-18 21:54:14,936 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,43445,1692395653940 in 212 msec 2023-08-18 21:54:14,938 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-18 21:54:14,938 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 374 msec 2023-08-18 21:54:14,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 430 msec 2023-08-18 21:54:14,941 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1692395654941, completionTime=-1 2023-08-18 21:54:14,941 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-18 21:54:14,941 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-18 21:54:14,943 DEBUG [hconnection-0x325fab8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-18 21:54:14,945 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-18 21:54:14,946 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-18 21:54:14,946 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1692395714946 2023-08-18 21:54:14,946 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1692395774946 2023-08-18 21:54:14,946 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-08-18 21:54:14,950 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41299,1692395653902-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:14,950 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41299,1692395653902-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:14,950 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41299,1692395653902-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:14,950 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:41299, period=300000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:14,950 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-18 21:54:14,950 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-18 21:54:14,951 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-18 21:54:14,952 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-18 21:54:14,952 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-18 21:54:14,953 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-18 21:54:14,954 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-18 21:54:14,956 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/.tmp/data/hbase/namespace/d5adf88824da518151248f599cedaf52 2023-08-18 21:54:14,957 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/.tmp/data/hbase/namespace/d5adf88824da518151248f599cedaf52 empty. 2023-08-18 21:54:14,957 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/.tmp/data/hbase/namespace/d5adf88824da518151248f599cedaf52 2023-08-18 21:54:14,957 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-18 21:54:14,969 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-18 21:54:14,971 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d5adf88824da518151248f599cedaf52, NAME => 'hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/.tmp 2023-08-18 21:54:14,981 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:54:14,981 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d5adf88824da518151248f599cedaf52, disabling compactions & flushes 2023-08-18 21:54:14,981 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52. 2023-08-18 21:54:14,981 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52. 2023-08-18 21:54:14,981 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52. after waiting 0 ms 2023-08-18 21:54:14,981 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52. 2023-08-18 21:54:14,981 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52. 2023-08-18 21:54:14,981 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d5adf88824da518151248f599cedaf52: 2023-08-18 21:54:14,984 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-18 21:54:14,986 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692395654986"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692395654986"}]},"ts":"1692395654986"} 2023-08-18 21:54:14,989 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-18 21:54:14,990 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-18 21:54:14,990 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692395654990"}]},"ts":"1692395654990"} 2023-08-18 21:54:14,992 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-18 21:54:14,996 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d5adf88824da518151248f599cedaf52, ASSIGN}] 2023-08-18 21:54:14,999 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d5adf88824da518151248f599cedaf52, ASSIGN 2023-08-18 21:54:15,001 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d5adf88824da518151248f599cedaf52, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43445,1692395653940; forceNewPlan=false, retain=false 2023-08-18 21:54:15,153 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d5adf88824da518151248f599cedaf52, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:15,154 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692395655152"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1692395655152"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692395655152"}]},"ts":"1692395655152"} 2023-08-18 21:54:15,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d5adf88824da518151248f599cedaf52, server=jenkins-hbase20.apache.org,43445,1692395653940}] 2023-08-18 21:54:15,323 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52. 2023-08-18 21:54:15,323 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5adf88824da518151248f599cedaf52, NAME => 'hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52.', STARTKEY => '', ENDKEY => ''} 2023-08-18 21:54:15,324 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d5adf88824da518151248f599cedaf52 2023-08-18 21:54:15,324 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:54:15,324 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d5adf88824da518151248f599cedaf52 2023-08-18 21:54:15,324 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d5adf88824da518151248f599cedaf52 2023-08-18 21:54:15,327 INFO [StoreOpener-d5adf88824da518151248f599cedaf52-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d5adf88824da518151248f599cedaf52 2023-08-18 21:54:15,329 DEBUG [StoreOpener-d5adf88824da518151248f599cedaf52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/namespace/d5adf88824da518151248f599cedaf52/info 2023-08-18 21:54:15,329 DEBUG [StoreOpener-d5adf88824da518151248f599cedaf52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/namespace/d5adf88824da518151248f599cedaf52/info 2023-08-18 21:54:15,330 INFO [StoreOpener-d5adf88824da518151248f599cedaf52-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5adf88824da518151248f599cedaf52 columnFamilyName info 2023-08-18 21:54:15,331 INFO [StoreOpener-d5adf88824da518151248f599cedaf52-1] regionserver.HStore(310): Store=d5adf88824da518151248f599cedaf52/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:54:15,332 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/namespace/d5adf88824da518151248f599cedaf52 2023-08-18 21:54:15,333 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/namespace/d5adf88824da518151248f599cedaf52 2023-08-18 21:54:15,337 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d5adf88824da518151248f599cedaf52 2023-08-18 21:54:15,341 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/namespace/d5adf88824da518151248f599cedaf52/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-18 21:54:15,342 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d5adf88824da518151248f599cedaf52; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=722071, jitterRate=-0.08183988928794861}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-18 21:54:15,342 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d5adf88824da518151248f599cedaf52: 2023-08-18 21:54:15,343 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52., pid=6, masterSystemTime=1692395655313 2023-08-18 21:54:15,346 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52. 2023-08-18 21:54:15,346 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52. 2023-08-18 21:54:15,347 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d5adf88824da518151248f599cedaf52, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:15,348 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692395655347"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1692395655347"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692395655347"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692395655347"}]},"ts":"1692395655347"} 2023-08-18 21:54:15,353 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-18 21:54:15,353 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d5adf88824da518151248f599cedaf52, server=jenkins-hbase20.apache.org,43445,1692395653940 in 191 msec 2023-08-18 21:54:15,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-18 21:54:15,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d5adf88824da518151248f599cedaf52, ASSIGN in 357 msec 2023-08-18 21:54:15,357 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-18 21:54:15,357 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692395655357"}]},"ts":"1692395655357"} 2023-08-18 21:54:15,359 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-18 21:54:15,361 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-18 21:54:15,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 410 msec 2023-08-18 21:54:15,454 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-18 21:54:15,456 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-18 21:54:15,456 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:54:15,465 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-18 21:54:15,473 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-18 21:54:15,476 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-08-18 21:54:15,487 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-18 21:54:15,495 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-18 21:54:15,497 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-08-18 21:54:15,501 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-18 21:54:15,502 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-18 21:54:15,502 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.525sec 2023-08-18 21:54:15,502 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-18 21:54:15,502 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-18 21:54:15,502 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-18 21:54:15,502 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41299,1692395653902-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-18 21:54:15,503 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41299,1692395653902-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-18 21:54:15,504 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-18 21:54:15,557 DEBUG [Listener at localhost/43617] zookeeper.ReadOnlyZKClient(139): Connect 0x23096606 to 127.0.0.1:56270 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-18 21:54:15,564 DEBUG [Listener at localhost/43617] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cc40f3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-18 21:54:15,567 DEBUG [hconnection-0x38416858-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-18 21:54:15,570 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-18 21:54:15,573 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,41299,1692395653902 2023-08-18 21:54:15,573 INFO [Listener at localhost/43617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:54:15,577 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-18 21:54:15,577 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:54:15,579 INFO [Listener at localhost/43617] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-18 21:54:15,583 DEBUG [Listener at localhost/43617] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-18 21:54:15,586 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-18 21:54:15,588 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41299] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-18 21:54:15,588 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41299] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-18 21:54:15,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41299] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-18 21:54:15,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41299] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRolling 2023-08-18 21:54:15,592 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-08-18 21:54:15,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41299] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRolling" procId is: 9 2023-08-18 21:54:15,594 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-18 21:54:15,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41299] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-18 21:54:15,596 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/.tmp/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:15,597 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/.tmp/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf empty. 2023-08-18 21:54:15,598 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/.tmp/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:15,598 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRolling regions 2023-08-18 21:54:15,613 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/.tmp/data/default/TestLogRolling-testLogRolling/.tabledesc/.tableinfo.0000000001 2023-08-18 21:54:15,614 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => e3057d4258bc99588f29ff11a21364cf, NAME => 'TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/.tmp 2023-08-18 21:54:15,623 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:54:15,623 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1604): Closing e3057d4258bc99588f29ff11a21364cf, disabling compactions & flushes 2023-08-18 21:54:15,623 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. 2023-08-18 21:54:15,623 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. 2023-08-18 21:54:15,623 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. after waiting 0 ms 2023-08-18 21:54:15,623 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. 2023-08-18 21:54:15,623 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. 2023-08-18 21:54:15,623 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1558): Region close journal for e3057d4258bc99588f29ff11a21364cf: 2023-08-18 21:54:15,626 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ADD_TO_META 2023-08-18 21:54:15,628 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1692395655627"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692395655627"}]},"ts":"1692395655627"} 2023-08-18 21:54:15,629 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-18 21:54:15,630 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-18 21:54:15,630 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692395655630"}]},"ts":"1692395655630"} 2023-08-18 21:54:15,632 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLING in hbase:meta 2023-08-18 21:54:15,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e3057d4258bc99588f29ff11a21364cf, ASSIGN}] 2023-08-18 21:54:15,636 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e3057d4258bc99588f29ff11a21364cf, ASSIGN 2023-08-18 21:54:15,637 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e3057d4258bc99588f29ff11a21364cf, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43445,1692395653940; forceNewPlan=false, retain=false 2023-08-18 21:54:15,789 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e3057d4258bc99588f29ff11a21364cf, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:15,790 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1692395655789"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1692395655789"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692395655789"}]},"ts":"1692395655789"} 2023-08-18 21:54:15,795 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure e3057d4258bc99588f29ff11a21364cf, server=jenkins-hbase20.apache.org,43445,1692395653940}] 2023-08-18 21:54:15,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. 2023-08-18 21:54:15,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e3057d4258bc99588f29ff11a21364cf, NAME => 'TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.', STARTKEY => '', ENDKEY => ''} 2023-08-18 21:54:15,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:15,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:54:15,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:15,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:15,959 INFO [StoreOpener-e3057d4258bc99588f29ff11a21364cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:15,961 DEBUG [StoreOpener-e3057d4258bc99588f29ff11a21364cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info 2023-08-18 21:54:15,961 DEBUG [StoreOpener-e3057d4258bc99588f29ff11a21364cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info 2023-08-18 21:54:15,962 INFO [StoreOpener-e3057d4258bc99588f29ff11a21364cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3057d4258bc99588f29ff11a21364cf columnFamilyName info 2023-08-18 21:54:15,963 INFO [StoreOpener-e3057d4258bc99588f29ff11a21364cf-1] regionserver.HStore(310): Store=e3057d4258bc99588f29ff11a21364cf/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:54:15,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:15,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:15,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:15,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-18 21:54:15,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e3057d4258bc99588f29ff11a21364cf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=741864, jitterRate=-0.05667181313037872}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-18 21:54:15,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e3057d4258bc99588f29ff11a21364cf: 2023-08-18 21:54:15,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf., pid=11, masterSystemTime=1692395655951 2023-08-18 21:54:15,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. 2023-08-18 21:54:15,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. 2023-08-18 21:54:15,981 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e3057d4258bc99588f29ff11a21364cf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:15,981 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1692395655980"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1692395655980"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692395655980"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692395655980"}]},"ts":"1692395655980"} 2023-08-18 21:54:15,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-18 21:54:15,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure e3057d4258bc99588f29ff11a21364cf, server=jenkins-hbase20.apache.org,43445,1692395653940 in 188 msec 2023-08-18 21:54:15,989 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-18 21:54:15,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e3057d4258bc99588f29ff11a21364cf, ASSIGN in 352 msec 2023-08-18 21:54:15,991 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-18 21:54:15,992 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692395655992"}]},"ts":"1692395655992"} 2023-08-18 21:54:15,994 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLED in hbase:meta 2023-08-18 21:54:15,996 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_POST_OPERATION 2023-08-18 21:54:15,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRolling in 408 msec 2023-08-18 21:54:18,159 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-18 21:54:20,591 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-18 21:54:20,592 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-18 21:54:20,594 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRolling' 2023-08-18 21:54:25,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41299] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-18 21:54:25,598 INFO [Listener at localhost/43617] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRolling, procId: 9 completed 2023-08-18 21:54:25,605 DEBUG [Listener at localhost/43617] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRolling 2023-08-18 21:54:25,606 DEBUG [Listener at localhost/43617] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. 2023-08-18 21:54:25,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:25,624 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e3057d4258bc99588f29ff11a21364cf 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-18 21:54:25,637 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=12 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/9f3ceeb3ec2246cc913d4da8c1748efb 2023-08-18 21:54:25,646 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/9f3ceeb3ec2246cc913d4da8c1748efb as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/9f3ceeb3ec2246cc913d4da8c1748efb 2023-08-18 21:54:25,652 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/9f3ceeb3ec2246cc913d4da8c1748efb, entries=8, sequenceid=12, filesize=13.0 K 2023-08-18 21:54:25,654 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=18.47 KB/18918 for e3057d4258bc99588f29ff11a21364cf in 30ms, sequenceid=12, compaction requested=false 2023-08-18 21:54:25,654 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e3057d4258bc99588f29ff11a21364cf: 2023-08-18 21:54:25,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:25,656 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e3057d4258bc99588f29ff11a21364cf 1/1 column families, dataSize=20.53 KB heapSize=22.28 KB 2023-08-18 21:54:25,675 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=20.53 KB at sequenceid=35 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/8cf42629e1864ac5861141ee9afd53e5 2023-08-18 21:54:25,681 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/8cf42629e1864ac5861141ee9afd53e5 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/8cf42629e1864ac5861141ee9afd53e5 2023-08-18 21:54:25,689 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/8cf42629e1864ac5861141ee9afd53e5, entries=20, sequenceid=35, filesize=25.3 K 2023-08-18 21:54:25,690 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~20.53 KB/21020, heapSize ~22.27 KB/22800, currentSize=4.11 KB/4204 for e3057d4258bc99588f29ff11a21364cf in 34ms, sequenceid=35, compaction requested=false 2023-08-18 21:54:25,690 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e3057d4258bc99588f29ff11a21364cf: 2023-08-18 21:54:25,690 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=38.3 K, sizeToCheck=16.0 K 2023-08-18 21:54:25,690 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-18 21:54:25,691 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/8cf42629e1864ac5861141ee9afd53e5 because midkey is the same as first or last row 2023-08-18 21:54:27,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:27,672 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e3057d4258bc99588f29ff11a21364cf 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-18 21:54:27,688 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=46 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/dc435d79773a4a579b422970a9e101b0 2023-08-18 21:54:27,695 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/dc435d79773a4a579b422970a9e101b0 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/dc435d79773a4a579b422970a9e101b0 2023-08-18 21:54:27,702 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/dc435d79773a4a579b422970a9e101b0, entries=8, sequenceid=46, filesize=13.0 K 2023-08-18 21:54:27,703 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=17.45 KB/17867 for e3057d4258bc99588f29ff11a21364cf in 31ms, sequenceid=46, compaction requested=true 2023-08-18 21:54:27,703 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e3057d4258bc99588f29ff11a21364cf: 2023-08-18 21:54:27,703 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=51.2 K, sizeToCheck=16.0 K 2023-08-18 21:54:27,703 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-18 21:54:27,703 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/8cf42629e1864ac5861141ee9afd53e5 because midkey is the same as first or last row 2023-08-18 21:54:27,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:27,704 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:54:27,705 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-18 21:54:27,705 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e3057d4258bc99588f29ff11a21364cf 1/1 column families, dataSize=19.50 KB heapSize=21.18 KB 2023-08-18 21:54:27,707 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 52472 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-18 21:54:27,707 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1912): e3057d4258bc99588f29ff11a21364cf/info is initiating minor compaction (all files) 2023-08-18 21:54:27,707 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e3057d4258bc99588f29ff11a21364cf/info in TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. 2023-08-18 21:54:27,707 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/9f3ceeb3ec2246cc913d4da8c1748efb, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/8cf42629e1864ac5861141ee9afd53e5, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/dc435d79773a4a579b422970a9e101b0] into tmpdir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp, totalSize=51.2 K 2023-08-18 21:54:27,708 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 9f3ceeb3ec2246cc913d4da8c1748efb, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1692395665611 2023-08-18 21:54:27,708 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 8cf42629e1864ac5861141ee9afd53e5, keycount=20, bloomtype=ROW, size=25.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1692395665625 2023-08-18 21:54:27,709 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting dc435d79773a4a579b422970a9e101b0, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=46, earliestPutTs=1692395665656 2023-08-18 21:54:27,720 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=19.50 KB at sequenceid=68 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/de95ce026bfa42a29f16b3ea93677558 2023-08-18 21:54:27,730 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/de95ce026bfa42a29f16b3ea93677558 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/de95ce026bfa42a29f16b3ea93677558 2023-08-18 21:54:27,730 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] throttle.PressureAwareThroughputController(145): e3057d4258bc99588f29ff11a21364cf#info#compaction#19 average throughput is 18.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-18 21:54:27,736 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/de95ce026bfa42a29f16b3ea93677558, entries=19, sequenceid=68, filesize=24.3 K 2023-08-18 21:54:27,738 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~19.50 KB/19969, heapSize ~21.16 KB/21672, currentSize=9.24 KB/9459 for e3057d4258bc99588f29ff11a21364cf in 33ms, sequenceid=68, compaction requested=false 2023-08-18 21:54:27,738 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e3057d4258bc99588f29ff11a21364cf: 2023-08-18 21:54:27,739 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=75.5 K, sizeToCheck=16.0 K 2023-08-18 21:54:27,739 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-18 21:54:27,740 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/8cf42629e1864ac5861141ee9afd53e5 because midkey is the same as first or last row 2023-08-18 21:54:27,747 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/133f471783e64492a48a342995bd81f1 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/133f471783e64492a48a342995bd81f1 2023-08-18 21:54:27,756 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e3057d4258bc99588f29ff11a21364cf/info of e3057d4258bc99588f29ff11a21364cf into 133f471783e64492a48a342995bd81f1(size=41.9 K), total size for store is 66.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-18 21:54:27,756 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e3057d4258bc99588f29ff11a21364cf: 2023-08-18 21:54:27,756 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf., storeName=e3057d4258bc99588f29ff11a21364cf/info, priority=13, startTime=1692395667704; duration=0sec 2023-08-18 21:54:27,758 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=66.2 K, sizeToCheck=16.0 K 2023-08-18 21:54:27,758 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-18 21:54:27,758 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.StoreUtils(129): cannot split hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/133f471783e64492a48a342995bd81f1 because midkey is the same as first or last row 2023-08-18 21:54:27,758 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:54:29,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:29,730 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e3057d4258bc99588f29ff11a21364cf 1/1 column families, dataSize=10.26 KB heapSize=11.27 KB 2023-08-18 21:54:29,747 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=10.26 KB at sequenceid=82 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/5c720f2335ef453eafd8c541c742f3b8 2023-08-18 21:54:29,753 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/5c720f2335ef453eafd8c541c742f3b8 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/5c720f2335ef453eafd8c541c742f3b8 2023-08-18 21:54:29,760 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/5c720f2335ef453eafd8c541c742f3b8, entries=10, sequenceid=82, filesize=15.0 K 2023-08-18 21:54:29,761 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~10.26 KB/10510, heapSize ~11.25 KB/11520, currentSize=17.45 KB/17867 for e3057d4258bc99588f29ff11a21364cf in 31ms, sequenceid=82, compaction requested=true 2023-08-18 21:54:29,761 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e3057d4258bc99588f29ff11a21364cf: 2023-08-18 21:54:29,761 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=81.2 K, sizeToCheck=16.0 K 2023-08-18 21:54:29,761 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-18 21:54:29,761 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/133f471783e64492a48a342995bd81f1 because midkey is the same as first or last row 2023-08-18 21:54:29,762 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:54:29,762 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-18 21:54:29,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:29,762 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e3057d4258bc99588f29ff11a21364cf 1/1 column families, dataSize=18.47 KB heapSize=20.08 KB 2023-08-18 21:54:29,763 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 83139 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-18 21:54:29,763 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1912): e3057d4258bc99588f29ff11a21364cf/info is initiating minor compaction (all files) 2023-08-18 21:54:29,764 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e3057d4258bc99588f29ff11a21364cf/info in TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. 2023-08-18 21:54:29,764 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/133f471783e64492a48a342995bd81f1, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/de95ce026bfa42a29f16b3ea93677558, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/5c720f2335ef453eafd8c541c742f3b8] into tmpdir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp, totalSize=81.2 K 2023-08-18 21:54:29,764 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 133f471783e64492a48a342995bd81f1, keycount=36, bloomtype=ROW, size=41.9 K, encoding=NONE, compression=NONE, seqNum=46, earliestPutTs=1692395665611 2023-08-18 21:54:29,765 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting de95ce026bfa42a29f16b3ea93677558, keycount=19, bloomtype=ROW, size=24.3 K, encoding=NONE, compression=NONE, seqNum=68, earliestPutTs=1692395667673 2023-08-18 21:54:29,765 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 5c720f2335ef453eafd8c541c742f3b8, keycount=10, bloomtype=ROW, size=15.0 K, encoding=NONE, compression=NONE, seqNum=82, earliestPutTs=1692395667706 2023-08-18 21:54:29,774 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=18.47 KB at sequenceid=103 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/ef623c1df6a847b0898c00e9585804bd 2023-08-18 21:54:29,782 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e3057d4258bc99588f29ff11a21364cf, server=jenkins-hbase20.apache.org,43445,1692395653940 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-18 21:54:29,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Mutate size: 1.1 K connection: 148.251.75.209:53306 deadline: 1692395679782, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e3057d4258bc99588f29ff11a21364cf, server=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:29,784 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/ef623c1df6a847b0898c00e9585804bd as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/ef623c1df6a847b0898c00e9585804bd 2023-08-18 21:54:29,784 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] throttle.PressureAwareThroughputController(145): e3057d4258bc99588f29ff11a21364cf#info#compaction#22 average throughput is 16.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-18 21:54:29,795 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/ef623c1df6a847b0898c00e9585804bd, entries=18, sequenceid=103, filesize=23.3 K 2023-08-18 21:54:29,796 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~18.47 KB/18918, heapSize ~20.06 KB/20544, currentSize=11.29 KB/11561 for e3057d4258bc99588f29ff11a21364cf in 34ms, sequenceid=103, compaction requested=false 2023-08-18 21:54:29,796 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e3057d4258bc99588f29ff11a21364cf: 2023-08-18 21:54:29,796 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=104.4 K, sizeToCheck=16.0 K 2023-08-18 21:54:29,796 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-18 21:54:29,796 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/133f471783e64492a48a342995bd81f1 because midkey is the same as first or last row 2023-08-18 21:54:29,800 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/76f707e013d243f18182fe9fff5feb5c as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/76f707e013d243f18182fe9fff5feb5c 2023-08-18 21:54:29,806 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e3057d4258bc99588f29ff11a21364cf/info of e3057d4258bc99588f29ff11a21364cf into 76f707e013d243f18182fe9fff5feb5c(size=71.9 K), total size for store is 95.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-18 21:54:29,807 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e3057d4258bc99588f29ff11a21364cf: 2023-08-18 21:54:29,807 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf., storeName=e3057d4258bc99588f29ff11a21364cf/info, priority=13, startTime=1692395669762; duration=0sec 2023-08-18 21:54:29,807 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=95.2 K, sizeToCheck=16.0 K 2023-08-18 21:54:29,807 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-18 21:54:29,808 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit(227): Splitting TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf., compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:54:29,808 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:54:29,809 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41299] assignment.AssignmentManager(1140): Split request from jenkins-hbase20.apache.org,43445,1692395653940, parent={ENCODED => e3057d4258bc99588f29ff11a21364cf, NAME => 'TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.', STARTKEY => '', ENDKEY => ''} splitKey=row0064 2023-08-18 21:54:29,816 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41299] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:29,821 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41299] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=e3057d4258bc99588f29ff11a21364cf, daughterA=a35817ba29f0034353c852bda8109aa8, daughterB=5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:54:29,822 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=e3057d4258bc99588f29ff11a21364cf, daughterA=a35817ba29f0034353c852bda8109aa8, daughterB=5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:54:29,822 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=e3057d4258bc99588f29ff11a21364cf, daughterA=a35817ba29f0034353c852bda8109aa8, daughterB=5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:54:29,822 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=e3057d4258bc99588f29ff11a21364cf, daughterA=a35817ba29f0034353c852bda8109aa8, daughterB=5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:54:29,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e3057d4258bc99588f29ff11a21364cf, UNASSIGN}] 2023-08-18 21:54:29,832 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e3057d4258bc99588f29ff11a21364cf, UNASSIGN 2023-08-18 21:54:29,833 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e3057d4258bc99588f29ff11a21364cf, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:29,833 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1692395669833"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1692395669833"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692395669833"}]},"ts":"1692395669833"} 2023-08-18 21:54:29,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; CloseRegionProcedure e3057d4258bc99588f29ff11a21364cf, server=jenkins-hbase20.apache.org,43445,1692395653940}] 2023-08-18 21:54:29,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:29,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e3057d4258bc99588f29ff11a21364cf, disabling compactions & flushes 2023-08-18 21:54:29,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. 2023-08-18 21:54:29,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. 2023-08-18 21:54:29,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. after waiting 0 ms 2023-08-18 21:54:29,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. 2023-08-18 21:54:29,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing e3057d4258bc99588f29ff11a21364cf 1/1 column families, dataSize=11.29 KB heapSize=12.37 KB 2023-08-18 21:54:30,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=11.29 KB at sequenceid=118 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/84bc730a96384ee38a2dfa44accd6572 2023-08-18 21:54:30,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.tmp/info/84bc730a96384ee38a2dfa44accd6572 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/84bc730a96384ee38a2dfa44accd6572 2023-08-18 21:54:30,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/84bc730a96384ee38a2dfa44accd6572, entries=11, sequenceid=118, filesize=16.0 K 2023-08-18 21:54:30,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~11.29 KB/11561, heapSize ~12.35 KB/12648, currentSize=0 B/0 for e3057d4258bc99588f29ff11a21364cf in 32ms, sequenceid=118, compaction requested=true 2023-08-18 21:54:30,034 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/9f3ceeb3ec2246cc913d4da8c1748efb, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/8cf42629e1864ac5861141ee9afd53e5, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/133f471783e64492a48a342995bd81f1, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/dc435d79773a4a579b422970a9e101b0, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/de95ce026bfa42a29f16b3ea93677558, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/5c720f2335ef453eafd8c541c742f3b8] to archive 2023-08-18 21:54:30,035 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-18 21:54:30,037 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/9f3ceeb3ec2246cc913d4da8c1748efb to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/9f3ceeb3ec2246cc913d4da8c1748efb 2023-08-18 21:54:30,038 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/8cf42629e1864ac5861141ee9afd53e5 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/8cf42629e1864ac5861141ee9afd53e5 2023-08-18 21:54:30,040 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/133f471783e64492a48a342995bd81f1 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/133f471783e64492a48a342995bd81f1 2023-08-18 21:54:30,041 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/dc435d79773a4a579b422970a9e101b0 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/dc435d79773a4a579b422970a9e101b0 2023-08-18 21:54:30,042 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/de95ce026bfa42a29f16b3ea93677558 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/de95ce026bfa42a29f16b3ea93677558 2023-08-18 21:54:30,044 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/5c720f2335ef453eafd8c541c742f3b8 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/5c720f2335ef453eafd8c541c742f3b8 2023-08-18 21:54:30,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/recovered.edits/121.seqid, newMaxSeqId=121, maxSeqId=1 2023-08-18 21:54:30,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. 2023-08-18 21:54:30,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e3057d4258bc99588f29ff11a21364cf: 2023-08-18 21:54:30,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:30,054 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e3057d4258bc99588f29ff11a21364cf, regionState=CLOSED 2023-08-18 21:54:30,054 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1692395670054"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692395670054"}]},"ts":"1692395670054"} 2023-08-18 21:54:30,057 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-08-18 21:54:30,057 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; CloseRegionProcedure e3057d4258bc99588f29ff11a21364cf, server=jenkins-hbase20.apache.org,43445,1692395653940 in 221 msec 2023-08-18 21:54:30,059 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-08-18 21:54:30,059 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e3057d4258bc99588f29ff11a21364cf, UNASSIGN in 226 msec 2023-08-18 21:54:30,072 INFO [PEWorker-3] assignment.SplitTableRegionProcedure(694): pid=12 splitting 3 storefiles, region=e3057d4258bc99588f29ff11a21364cf, threads=3 2023-08-18 21:54:30,072 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/76f707e013d243f18182fe9fff5feb5c for region: e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:30,072 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/84bc730a96384ee38a2dfa44accd6572 for region: e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:30,072 DEBUG [StoreFileSplitter-pool-2] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/ef623c1df6a847b0898c00e9585804bd for region: e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:30,083 DEBUG [StoreFileSplitter-pool-2] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/ef623c1df6a847b0898c00e9585804bd, top=true 2023-08-18 21:54:30,087 DEBUG [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/84bc730a96384ee38a2dfa44accd6572, top=true 2023-08-18 21:54:30,092 INFO [StoreFileSplitter-pool-2] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.splits/5096705496daf72746c3f1b73aa7b99a/info/TestLogRolling-testLogRolling=e3057d4258bc99588f29ff11a21364cf-ef623c1df6a847b0898c00e9585804bd for child: 5096705496daf72746c3f1b73aa7b99a, parent: e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:30,092 DEBUG [StoreFileSplitter-pool-2] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/ef623c1df6a847b0898c00e9585804bd for region: e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:30,098 INFO [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/.splits/5096705496daf72746c3f1b73aa7b99a/info/TestLogRolling-testLogRolling=e3057d4258bc99588f29ff11a21364cf-84bc730a96384ee38a2dfa44accd6572 for child: 5096705496daf72746c3f1b73aa7b99a, parent: e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:30,098 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/84bc730a96384ee38a2dfa44accd6572 for region: e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:30,111 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/76f707e013d243f18182fe9fff5feb5c for region: e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:54:30,111 DEBUG [PEWorker-3] assignment.SplitTableRegionProcedure(755): pid=12 split storefiles for region e3057d4258bc99588f29ff11a21364cf Daughter A: 1 storefiles, Daughter B: 3 storefiles. 2023-08-18 21:54:30,141 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/a35817ba29f0034353c852bda8109aa8/recovered.edits/121.seqid, newMaxSeqId=121, maxSeqId=-1 2023-08-18 21:54:30,143 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/recovered.edits/121.seqid, newMaxSeqId=121, maxSeqId=-1 2023-08-18 21:54:30,145 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1692395670145"},{"qualifier":"splitA","vlen":70,"tag":[],"timestamp":"1692395670145"},{"qualifier":"splitB","vlen":70,"tag":[],"timestamp":"1692395670145"}]},"ts":"1692395670145"} 2023-08-18 21:54:30,146 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1692395670145"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692395670145"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692395670145"}]},"ts":"1692395670145"} 2023-08-18 21:54:30,146 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1692395670145"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692395670145"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692395670145"}]},"ts":"1692395670145"} 2023-08-18 21:54:30,183 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43445] regionserver.HRegion(9158): Flush requested on 1588230740 2023-08-18 21:54:30,183 DEBUG [MemStoreFlusher.0] regionserver.FlushAllLargeStoresPolicy(69): Since none of the CFs were above the size, flushing all. 2023-08-18 21:54:30,183 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=4.82 KB heapSize=8.36 KB 2023-08-18 21:54:30,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=a35817ba29f0034353c852bda8109aa8, ASSIGN}, {pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=5096705496daf72746c3f1b73aa7b99a, ASSIGN}] 2023-08-18 21:54:30,193 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=5096705496daf72746c3f1b73aa7b99a, ASSIGN 2023-08-18 21:54:30,193 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=a35817ba29f0034353c852bda8109aa8, ASSIGN 2023-08-18 21:54:30,194 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=5096705496daf72746c3f1b73aa7b99a, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase20.apache.org,43445,1692395653940; forceNewPlan=false, retain=false 2023-08-18 21:54:30,194 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=a35817ba29f0034353c852bda8109aa8, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase20.apache.org,43445,1692395653940; forceNewPlan=false, retain=false 2023-08-18 21:54:30,198 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=4.61 KB at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/.tmp/info/4862f1e494cb414d93e3325758e54c8c 2023-08-18 21:54:30,217 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=216 B at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/.tmp/table/4f067b2948254c1e9d9b1ed6a3277762 2023-08-18 21:54:30,224 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/.tmp/info/4862f1e494cb414d93e3325758e54c8c as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/info/4862f1e494cb414d93e3325758e54c8c 2023-08-18 21:54:30,230 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/info/4862f1e494cb414d93e3325758e54c8c, entries=29, sequenceid=17, filesize=8.6 K 2023-08-18 21:54:30,231 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/.tmp/table/4f067b2948254c1e9d9b1ed6a3277762 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/table/4f067b2948254c1e9d9b1ed6a3277762 2023-08-18 21:54:30,238 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/table/4f067b2948254c1e9d9b1ed6a3277762, entries=4, sequenceid=17, filesize=4.8 K 2023-08-18 21:54:30,239 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~4.82 KB/4939, heapSize ~8.08 KB/8272, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=17, compaction requested=false 2023-08-18 21:54:30,239 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-08-18 21:54:30,345 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=a35817ba29f0034353c852bda8109aa8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:30,345 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5096705496daf72746c3f1b73aa7b99a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:30,346 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1692395670345"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1692395670345"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692395670345"}]},"ts":"1692395670345"} 2023-08-18 21:54:30,346 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1692395670345"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1692395670345"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692395670345"}]},"ts":"1692395670345"} 2023-08-18 21:54:30,348 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure a35817ba29f0034353c852bda8109aa8, server=jenkins-hbase20.apache.org,43445,1692395653940}] 2023-08-18 21:54:30,349 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=18, ppid=16, state=RUNNABLE; OpenRegionProcedure 5096705496daf72746c3f1b73aa7b99a, server=jenkins-hbase20.apache.org,43445,1692395653940}] 2023-08-18 21:54:30,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8. 2023-08-18 21:54:30,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a35817ba29f0034353c852bda8109aa8, NAME => 'TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8.', STARTKEY => '', ENDKEY => 'row0064'} 2023-08-18 21:54:30,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling a35817ba29f0034353c852bda8109aa8 2023-08-18 21:54:30,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:54:30,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a35817ba29f0034353c852bda8109aa8 2023-08-18 21:54:30,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a35817ba29f0034353c852bda8109aa8 2023-08-18 21:54:30,507 INFO [StoreOpener-a35817ba29f0034353c852bda8109aa8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a35817ba29f0034353c852bda8109aa8 2023-08-18 21:54:30,509 DEBUG [StoreOpener-a35817ba29f0034353c852bda8109aa8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/a35817ba29f0034353c852bda8109aa8/info 2023-08-18 21:54:30,509 DEBUG [StoreOpener-a35817ba29f0034353c852bda8109aa8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/a35817ba29f0034353c852bda8109aa8/info 2023-08-18 21:54:30,510 INFO [StoreOpener-a35817ba29f0034353c852bda8109aa8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a35817ba29f0034353c852bda8109aa8 columnFamilyName info 2023-08-18 21:54:30,529 DEBUG [StoreOpener-a35817ba29f0034353c852bda8109aa8-1] regionserver.HStore(539): loaded hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/a35817ba29f0034353c852bda8109aa8/info/76f707e013d243f18182fe9fff5feb5c.e3057d4258bc99588f29ff11a21364cf->hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/76f707e013d243f18182fe9fff5feb5c-bottom 2023-08-18 21:54:30,530 INFO [StoreOpener-a35817ba29f0034353c852bda8109aa8-1] regionserver.HStore(310): Store=a35817ba29f0034353c852bda8109aa8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:54:30,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/a35817ba29f0034353c852bda8109aa8 2023-08-18 21:54:30,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/a35817ba29f0034353c852bda8109aa8 2023-08-18 21:54:30,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a35817ba29f0034353c852bda8109aa8 2023-08-18 21:54:30,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a35817ba29f0034353c852bda8109aa8; next sequenceid=122; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=713898, jitterRate=-0.09223289787769318}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-18 21:54:30,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a35817ba29f0034353c852bda8109aa8: 2023-08-18 21:54:30,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8., pid=17, masterSystemTime=1692395670500 2023-08-18 21:54:30,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:54:30,538 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-08-18 21:54:30,539 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8. 2023-08-18 21:54:30,539 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1912): a35817ba29f0034353c852bda8109aa8/info is initiating minor compaction (all files) 2023-08-18 21:54:30,539 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a35817ba29f0034353c852bda8109aa8/info in TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8. 2023-08-18 21:54:30,540 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/a35817ba29f0034353c852bda8109aa8/info/76f707e013d243f18182fe9fff5feb5c.e3057d4258bc99588f29ff11a21364cf->hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/76f707e013d243f18182fe9fff5feb5c-bottom] into tmpdir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/a35817ba29f0034353c852bda8109aa8/.tmp, totalSize=71.9 K 2023-08-18 21:54:30,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8. 2023-08-18 21:54:30,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8. 2023-08-18 21:54:30,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:54:30,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5096705496daf72746c3f1b73aa7b99a, NAME => 'TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.', STARTKEY => 'row0064', ENDKEY => ''} 2023-08-18 21:54:30,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:54:30,541 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 76f707e013d243f18182fe9fff5feb5c.e3057d4258bc99588f29ff11a21364cf, keycount=32, bloomtype=ROW, size=71.9 K, encoding=NONE, compression=NONE, seqNum=82, earliestPutTs=1692395665611 2023-08-18 21:54:30,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:54:30,541 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=a35817ba29f0034353c852bda8109aa8, regionState=OPEN, openSeqNum=122, regionLocation=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:30,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:54:30,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:54:30,542 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1692395670541"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1692395670541"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692395670541"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692395670541"}]},"ts":"1692395670541"} 2023-08-18 21:54:30,543 INFO [StoreOpener-5096705496daf72746c3f1b73aa7b99a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:54:30,545 DEBUG [StoreOpener-5096705496daf72746c3f1b73aa7b99a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info 2023-08-18 21:54:30,545 DEBUG [StoreOpener-5096705496daf72746c3f1b73aa7b99a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info 2023-08-18 21:54:30,546 INFO [StoreOpener-5096705496daf72746c3f1b73aa7b99a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5096705496daf72746c3f1b73aa7b99a columnFamilyName info 2023-08-18 21:54:30,546 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-08-18 21:54:30,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure a35817ba29f0034353c852bda8109aa8, server=jenkins-hbase20.apache.org,43445,1692395653940 in 196 msec 2023-08-18 21:54:30,548 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=a35817ba29f0034353c852bda8109aa8, ASSIGN in 356 msec 2023-08-18 21:54:30,551 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] throttle.PressureAwareThroughputController(145): a35817ba29f0034353c852bda8109aa8#info#compaction#26 average throughput is 15.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-18 21:54:30,559 DEBUG [StoreOpener-5096705496daf72746c3f1b73aa7b99a-1] regionserver.HStore(539): loaded hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/76f707e013d243f18182fe9fff5feb5c.e3057d4258bc99588f29ff11a21364cf->hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/76f707e013d243f18182fe9fff5feb5c-top 2023-08-18 21:54:30,570 DEBUG [StoreOpener-5096705496daf72746c3f1b73aa7b99a-1] regionserver.HStore(539): loaded hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/TestLogRolling-testLogRolling=e3057d4258bc99588f29ff11a21364cf-84bc730a96384ee38a2dfa44accd6572 2023-08-18 21:54:30,576 DEBUG [StoreOpener-5096705496daf72746c3f1b73aa7b99a-1] regionserver.HStore(539): loaded hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/TestLogRolling-testLogRolling=e3057d4258bc99588f29ff11a21364cf-ef623c1df6a847b0898c00e9585804bd 2023-08-18 21:54:30,576 INFO [StoreOpener-5096705496daf72746c3f1b73aa7b99a-1] regionserver.HStore(310): Store=5096705496daf72746c3f1b73aa7b99a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:54:30,577 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/a35817ba29f0034353c852bda8109aa8/.tmp/info/24260aadc5b74abca50c4dffc8bed1f5 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/a35817ba29f0034353c852bda8109aa8/info/24260aadc5b74abca50c4dffc8bed1f5 2023-08-18 21:54:30,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:54:30,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:54:30,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:54:30,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5096705496daf72746c3f1b73aa7b99a; next sequenceid=122; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=790224, jitterRate=0.004822626709938049}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-18 21:54:30,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:54:30,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a., pid=18, masterSystemTime=1692395670500 2023-08-18 21:54:30,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:54:30,586 DEBUG [RS:0;jenkins-hbase20:43445-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-18 21:54:30,588 INFO [RS:0;jenkins-hbase20:43445-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:54:30,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:54:30,588 DEBUG [RS:0;jenkins-hbase20:43445-longCompactions-0] regionserver.HStore(1912): 5096705496daf72746c3f1b73aa7b99a/info is initiating minor compaction (all files) 2023-08-18 21:54:30,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:54:30,588 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in a35817ba29f0034353c852bda8109aa8/info of a35817ba29f0034353c852bda8109aa8 into 24260aadc5b74abca50c4dffc8bed1f5(size=69.7 K), total size for store is 69.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-18 21:54:30,588 INFO [RS:0;jenkins-hbase20:43445-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 5096705496daf72746c3f1b73aa7b99a/info in TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:54:30,589 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a35817ba29f0034353c852bda8109aa8: 2023-08-18 21:54:30,589 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8., storeName=a35817ba29f0034353c852bda8109aa8/info, priority=15, startTime=1692395670538; duration=0sec 2023-08-18 21:54:30,589 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:54:30,589 INFO [RS:0;jenkins-hbase20:43445-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/76f707e013d243f18182fe9fff5feb5c.e3057d4258bc99588f29ff11a21364cf->hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/76f707e013d243f18182fe9fff5feb5c-top, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/TestLogRolling-testLogRolling=e3057d4258bc99588f29ff11a21364cf-ef623c1df6a847b0898c00e9585804bd, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/TestLogRolling-testLogRolling=e3057d4258bc99588f29ff11a21364cf-84bc730a96384ee38a2dfa44accd6572] into tmpdir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp, totalSize=111.2 K 2023-08-18 21:54:30,589 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5096705496daf72746c3f1b73aa7b99a, regionState=OPEN, openSeqNum=122, regionLocation=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:54:30,589 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1692395670589"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1692395670589"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692395670589"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692395670589"}]},"ts":"1692395670589"} 2023-08-18 21:54:30,590 DEBUG [RS:0;jenkins-hbase20:43445-longCompactions-0] compactions.Compactor(207): Compacting 76f707e013d243f18182fe9fff5feb5c.e3057d4258bc99588f29ff11a21364cf, keycount=32, bloomtype=ROW, size=71.9 K, encoding=NONE, compression=NONE, seqNum=83, earliestPutTs=1692395665611 2023-08-18 21:54:30,591 DEBUG [RS:0;jenkins-hbase20:43445-longCompactions-0] compactions.Compactor(207): Compacting TestLogRolling-testLogRolling=e3057d4258bc99588f29ff11a21364cf-ef623c1df6a847b0898c00e9585804bd, keycount=18, bloomtype=ROW, size=23.3 K, encoding=NONE, compression=NONE, seqNum=103, earliestPutTs=1692395669733 2023-08-18 21:54:30,592 DEBUG [RS:0;jenkins-hbase20:43445-longCompactions-0] compactions.Compactor(207): Compacting TestLogRolling-testLogRolling=e3057d4258bc99588f29ff11a21364cf-84bc730a96384ee38a2dfa44accd6572, keycount=11, bloomtype=ROW, size=16.0 K, encoding=NONE, compression=NONE, seqNum=118, earliestPutTs=1692395669763 2023-08-18 21:54:30,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=16 2023-08-18 21:54:30,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=16, state=SUCCESS; OpenRegionProcedure 5096705496daf72746c3f1b73aa7b99a, server=jenkins-hbase20.apache.org,43445,1692395653940 in 243 msec 2023-08-18 21:54:30,599 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=12 2023-08-18 21:54:30,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=5096705496daf72746c3f1b73aa7b99a, ASSIGN in 405 msec 2023-08-18 21:54:30,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=e3057d4258bc99588f29ff11a21364cf, daughterA=a35817ba29f0034353c852bda8109aa8, daughterB=5096705496daf72746c3f1b73aa7b99a in 784 msec 2023-08-18 21:54:30,607 INFO [RS:0;jenkins-hbase20:43445-longCompactions-0] throttle.PressureAwareThroughputController(145): 5096705496daf72746c3f1b73aa7b99a#info#compaction#27 average throughput is 15.54 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-18 21:54:30,625 DEBUG [RS:0;jenkins-hbase20:43445-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/c0ca4944207740f49550ee60dfa1d7b6 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/c0ca4944207740f49550ee60dfa1d7b6 2023-08-18 21:54:30,633 INFO [RS:0;jenkins-hbase20:43445-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5096705496daf72746c3f1b73aa7b99a/info of 5096705496daf72746c3f1b73aa7b99a into c0ca4944207740f49550ee60dfa1d7b6(size=36.9 K), total size for store is 36.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-18 21:54:30,633 DEBUG [RS:0;jenkins-hbase20:43445-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:54:30,633 INFO [RS:0;jenkins-hbase20:43445-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a., storeName=5096705496daf72746c3f1b73aa7b99a/info, priority=13, startTime=1692395670585; duration=0sec 2023-08-18 21:54:30,633 DEBUG [RS:0;jenkins-hbase20:43445-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:54:35,598 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-18 21:54:39,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Mutate size: 1.1 K connection: 148.251.75.209:53306 deadline: 1692395689829, exception=org.apache.hadoop.hbase.NotServingRegionException: TestLogRolling-testLogRolling,,1692395655588.e3057d4258bc99588f29ff11a21364cf. is not online on jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:55:02,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:55:02,013 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 5096705496daf72746c3f1b73aa7b99a 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-18 21:55:02,036 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=133 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/72a8b84b5a784529bfc2b08183ef8122 2023-08-18 21:55:02,044 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/72a8b84b5a784529bfc2b08183ef8122 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/72a8b84b5a784529bfc2b08183ef8122 2023-08-18 21:55:02,051 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/72a8b84b5a784529bfc2b08183ef8122, entries=8, sequenceid=133, filesize=13.0 K 2023-08-18 21:55:02,052 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=18.47 KB/18918 for 5096705496daf72746c3f1b73aa7b99a in 39ms, sequenceid=133, compaction requested=false 2023-08-18 21:55:02,052 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:02,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:55:02,053 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 5096705496daf72746c3f1b73aa7b99a 1/1 column families, dataSize=20.53 KB heapSize=22.28 KB 2023-08-18 21:55:02,069 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=20.53 KB at sequenceid=156 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/04d5a65bc19f434ebc373abc56233052 2023-08-18 21:55:02,074 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/04d5a65bc19f434ebc373abc56233052 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/04d5a65bc19f434ebc373abc56233052 2023-08-18 21:55:02,079 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/04d5a65bc19f434ebc373abc56233052, entries=20, sequenceid=156, filesize=25.3 K 2023-08-18 21:55:02,080 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~20.53 KB/21020, heapSize ~22.27 KB/22800, currentSize=6.16 KB/6306 for 5096705496daf72746c3f1b73aa7b99a in 27ms, sequenceid=156, compaction requested=true 2023-08-18 21:55:02,080 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:02,080 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:55:02,081 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-18 21:55:02,082 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 77008 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-18 21:55:02,082 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1912): 5096705496daf72746c3f1b73aa7b99a/info is initiating minor compaction (all files) 2023-08-18 21:55:02,082 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5096705496daf72746c3f1b73aa7b99a/info in TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:55:02,082 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/c0ca4944207740f49550ee60dfa1d7b6, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/72a8b84b5a784529bfc2b08183ef8122, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/04d5a65bc19f434ebc373abc56233052] into tmpdir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp, totalSize=75.2 K 2023-08-18 21:55:02,082 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting c0ca4944207740f49550ee60dfa1d7b6, keycount=31, bloomtype=ROW, size=36.9 K, encoding=NONE, compression=NONE, seqNum=118, earliestPutTs=1692395667723 2023-08-18 21:55:02,083 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 72a8b84b5a784529bfc2b08183ef8122, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=133, earliestPutTs=1692395699995 2023-08-18 21:55:02,083 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 04d5a65bc19f434ebc373abc56233052, keycount=20, bloomtype=ROW, size=25.3 K, encoding=NONE, compression=NONE, seqNum=156, earliestPutTs=1692395702014 2023-08-18 21:55:02,096 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5096705496daf72746c3f1b73aa7b99a#info#compaction#30 average throughput is 19.71 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-18 21:55:02,522 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/c53c6c60de174404b87b7119f2507618 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/c53c6c60de174404b87b7119f2507618 2023-08-18 21:55:02,530 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5096705496daf72746c3f1b73aa7b99a/info of 5096705496daf72746c3f1b73aa7b99a into c53c6c60de174404b87b7119f2507618(size=65.9 K), total size for store is 65.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-18 21:55:02,530 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:02,531 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a., storeName=5096705496daf72746c3f1b73aa7b99a/info, priority=13, startTime=1692395702080; duration=0sec 2023-08-18 21:55:02,531 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:55:04,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:55:04,069 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 5096705496daf72746c3f1b73aa7b99a 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-18 21:55:04,086 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=168 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/47ea6d84037e4d5d828d00c48f83dcce 2023-08-18 21:55:04,093 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/47ea6d84037e4d5d828d00c48f83dcce as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/47ea6d84037e4d5d828d00c48f83dcce 2023-08-18 21:55:04,100 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/47ea6d84037e4d5d828d00c48f83dcce, entries=8, sequenceid=168, filesize=13.0 K 2023-08-18 21:55:04,100 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=19.50 KB/19969 for 5096705496daf72746c3f1b73aa7b99a in 31ms, sequenceid=168, compaction requested=false 2023-08-18 21:55:04,101 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:04,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:55:04,102 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 5096705496daf72746c3f1b73aa7b99a 1/1 column families, dataSize=20.53 KB heapSize=22.28 KB 2023-08-18 21:55:04,115 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=20.53 KB at sequenceid=191 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/7e7caacc72cf4bf0a099bfd6c2cc3c0d 2023-08-18 21:55:04,116 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=5096705496daf72746c3f1b73aa7b99a, server=jenkins-hbase20.apache.org,43445,1692395653940 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-18 21:55:04,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] ipc.CallRunner(144): callId: 174 service: ClientService methodName: Mutate size: 1.2 K connection: 148.251.75.209:53306 deadline: 1692395714115, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=5096705496daf72746c3f1b73aa7b99a, server=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:55:04,120 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/7e7caacc72cf4bf0a099bfd6c2cc3c0d as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/7e7caacc72cf4bf0a099bfd6c2cc3c0d 2023-08-18 21:55:04,125 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/7e7caacc72cf4bf0a099bfd6c2cc3c0d, entries=20, sequenceid=191, filesize=25.3 K 2023-08-18 21:55:04,126 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~20.53 KB/21020, heapSize ~22.27 KB/22800, currentSize=9.24 KB/9459 for 5096705496daf72746c3f1b73aa7b99a in 24ms, sequenceid=191, compaction requested=true 2023-08-18 21:55:04,126 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:04,126 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-08-18 21:55:04,126 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-18 21:55:04,127 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 106666 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-18 21:55:04,127 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1912): 5096705496daf72746c3f1b73aa7b99a/info is initiating minor compaction (all files) 2023-08-18 21:55:04,128 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5096705496daf72746c3f1b73aa7b99a/info in TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:55:04,128 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/c53c6c60de174404b87b7119f2507618, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/47ea6d84037e4d5d828d00c48f83dcce, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/7e7caacc72cf4bf0a099bfd6c2cc3c0d] into tmpdir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp, totalSize=104.2 K 2023-08-18 21:55:04,128 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting c53c6c60de174404b87b7119f2507618, keycount=59, bloomtype=ROW, size=65.9 K, encoding=NONE, compression=NONE, seqNum=156, earliestPutTs=1692395667723 2023-08-18 21:55:04,128 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 47ea6d84037e4d5d828d00c48f83dcce, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=168, earliestPutTs=1692395702054 2023-08-18 21:55:04,129 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 7e7caacc72cf4bf0a099bfd6c2cc3c0d, keycount=20, bloomtype=ROW, size=25.3 K, encoding=NONE, compression=NONE, seqNum=191, earliestPutTs=1692395704071 2023-08-18 21:55:04,140 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5096705496daf72746c3f1b73aa7b99a#info#compaction#33 average throughput is 43.60 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-18 21:55:04,152 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/ac9d2e8cd3ba4be99d3cd0a382204aed as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/ac9d2e8cd3ba4be99d3cd0a382204aed 2023-08-18 21:55:04,159 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5096705496daf72746c3f1b73aa7b99a/info of 5096705496daf72746c3f1b73aa7b99a into ac9d2e8cd3ba4be99d3cd0a382204aed(size=94.8 K), total size for store is 94.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-18 21:55:04,159 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:04,159 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a., storeName=5096705496daf72746c3f1b73aa7b99a/info, priority=13, startTime=1692395704126; duration=0sec 2023-08-18 21:55:04,159 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:55:14,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:55:14,203 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 5096705496daf72746c3f1b73aa7b99a 1/1 column families, dataSize=10.26 KB heapSize=11.27 KB 2023-08-18 21:55:14,214 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=10.26 KB at sequenceid=205 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/37b895ee722d45ac9dacac8de31beb87 2023-08-18 21:55:14,221 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/37b895ee722d45ac9dacac8de31beb87 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/37b895ee722d45ac9dacac8de31beb87 2023-08-18 21:55:14,227 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/37b895ee722d45ac9dacac8de31beb87, entries=10, sequenceid=205, filesize=15.0 K 2023-08-18 21:55:14,228 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~10.26 KB/10510, heapSize ~11.25 KB/11520, currentSize=0 B/0 for 5096705496daf72746c3f1b73aa7b99a in 25ms, sequenceid=205, compaction requested=false 2023-08-18 21:55:14,228 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:16,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:55:16,215 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 5096705496daf72746c3f1b73aa7b99a 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-18 21:55:16,243 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=5096705496daf72746c3f1b73aa7b99a, server=jenkins-hbase20.apache.org,43445,1692395653940 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-18 21:55:16,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Mutate size: 1.2 K connection: 148.251.75.209:53306 deadline: 1692395726242, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=5096705496daf72746c3f1b73aa7b99a, server=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:55:16,628 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=216 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/1c62d23fd91f47f48c3e1bf6fd3a5e5c 2023-08-18 21:55:16,636 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/1c62d23fd91f47f48c3e1bf6fd3a5e5c as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/1c62d23fd91f47f48c3e1bf6fd3a5e5c 2023-08-18 21:55:16,644 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/1c62d23fd91f47f48c3e1bf6fd3a5e5c, entries=8, sequenceid=216, filesize=13.0 K 2023-08-18 21:55:16,645 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 5096705496daf72746c3f1b73aa7b99a in 431ms, sequenceid=216, compaction requested=true 2023-08-18 21:55:16,645 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:16,645 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:55:16,645 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-18 21:55:16,646 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 125779 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-18 21:55:16,646 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1912): 5096705496daf72746c3f1b73aa7b99a/info is initiating minor compaction (all files) 2023-08-18 21:55:16,646 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5096705496daf72746c3f1b73aa7b99a/info in TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:55:16,646 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/ac9d2e8cd3ba4be99d3cd0a382204aed, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/37b895ee722d45ac9dacac8de31beb87, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/1c62d23fd91f47f48c3e1bf6fd3a5e5c] into tmpdir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp, totalSize=122.8 K 2023-08-18 21:55:16,647 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting ac9d2e8cd3ba4be99d3cd0a382204aed, keycount=87, bloomtype=ROW, size=94.8 K, encoding=NONE, compression=NONE, seqNum=191, earliestPutTs=1692395667723 2023-08-18 21:55:16,647 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 37b895ee722d45ac9dacac8de31beb87, keycount=10, bloomtype=ROW, size=15.0 K, encoding=NONE, compression=NONE, seqNum=205, earliestPutTs=1692395704102 2023-08-18 21:55:16,648 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 1c62d23fd91f47f48c3e1bf6fd3a5e5c, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=216, earliestPutTs=1692395716205 2023-08-18 21:55:16,663 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5096705496daf72746c3f1b73aa7b99a#info#compaction#36 average throughput is 35.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-18 21:55:16,682 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/b5b175ffaceb4f01b6f83bd883f4897c as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/b5b175ffaceb4f01b6f83bd883f4897c 2023-08-18 21:55:16,689 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5096705496daf72746c3f1b73aa7b99a/info of 5096705496daf72746c3f1b73aa7b99a into b5b175ffaceb4f01b6f83bd883f4897c(size=113.4 K), total size for store is 113.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-18 21:55:16,689 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:16,689 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a., storeName=5096705496daf72746c3f1b73aa7b99a/info, priority=13, startTime=1692395716645; duration=0sec 2023-08-18 21:55:16,689 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:55:26,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:55:26,267 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 5096705496daf72746c3f1b73aa7b99a 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-18 21:55:26,289 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=242 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/e0f1ac32261f4415b893873eb66e8517 2023-08-18 21:55:26,298 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/e0f1ac32261f4415b893873eb66e8517 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/e0f1ac32261f4415b893873eb66e8517 2023-08-18 21:55:26,304 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/e0f1ac32261f4415b893873eb66e8517, entries=22, sequenceid=242, filesize=27.4 K 2023-08-18 21:55:26,305 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=2.05 KB/2102 for 5096705496daf72746c3f1b73aa7b99a in 38ms, sequenceid=242, compaction requested=false 2023-08-18 21:55:26,305 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:28,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:55:28,285 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 5096705496daf72746c3f1b73aa7b99a 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-18 21:55:28,298 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=253 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/cef88c2fc159432fa076f4f19ebb3a05 2023-08-18 21:55:28,305 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/cef88c2fc159432fa076f4f19ebb3a05 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/cef88c2fc159432fa076f4f19ebb3a05 2023-08-18 21:55:28,313 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/cef88c2fc159432fa076f4f19ebb3a05, entries=8, sequenceid=253, filesize=13.0 K 2023-08-18 21:55:28,314 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=17.45 KB/17867 for 5096705496daf72746c3f1b73aa7b99a in 29ms, sequenceid=253, compaction requested=true 2023-08-18 21:55:28,314 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:28,314 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:55:28,314 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-18 21:55:28,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:55:28,316 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 5096705496daf72746c3f1b73aa7b99a 1/1 column families, dataSize=19.50 KB heapSize=21.18 KB 2023-08-18 21:55:28,316 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 157495 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-18 21:55:28,316 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1912): 5096705496daf72746c3f1b73aa7b99a/info is initiating minor compaction (all files) 2023-08-18 21:55:28,316 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5096705496daf72746c3f1b73aa7b99a/info in TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:55:28,316 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/b5b175ffaceb4f01b6f83bd883f4897c, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/e0f1ac32261f4415b893873eb66e8517, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/cef88c2fc159432fa076f4f19ebb3a05] into tmpdir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp, totalSize=153.8 K 2023-08-18 21:55:28,317 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting b5b175ffaceb4f01b6f83bd883f4897c, keycount=105, bloomtype=ROW, size=113.4 K, encoding=NONE, compression=NONE, seqNum=216, earliestPutTs=1692395667723 2023-08-18 21:55:28,318 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting e0f1ac32261f4415b893873eb66e8517, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=242, earliestPutTs=1692395716215 2023-08-18 21:55:28,318 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting cef88c2fc159432fa076f4f19ebb3a05, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=253, earliestPutTs=1692395726268 2023-08-18 21:55:28,339 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=19.50 KB at sequenceid=275 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/d1a5a7373de84e1aa8b370890ef69439 2023-08-18 21:55:28,342 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5096705496daf72746c3f1b73aa7b99a#info#compaction#40 average throughput is 45.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-18 21:55:28,350 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/d1a5a7373de84e1aa8b370890ef69439 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/d1a5a7373de84e1aa8b370890ef69439 2023-08-18 21:55:28,358 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/d1a5a7373de84e1aa8b370890ef69439, entries=19, sequenceid=275, filesize=24.3 K 2023-08-18 21:55:28,358 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/36067f359fc5450b9296c39eb7caabd9 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/36067f359fc5450b9296c39eb7caabd9 2023-08-18 21:55:28,358 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~19.50 KB/19969, heapSize ~21.16 KB/21672, currentSize=7.18 KB/7357 for 5096705496daf72746c3f1b73aa7b99a in 43ms, sequenceid=275, compaction requested=false 2023-08-18 21:55:28,359 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:28,365 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5096705496daf72746c3f1b73aa7b99a/info of 5096705496daf72746c3f1b73aa7b99a into 36067f359fc5450b9296c39eb7caabd9(size=144.6 K), total size for store is 168.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-18 21:55:28,365 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:28,365 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a., storeName=5096705496daf72746c3f1b73aa7b99a/info, priority=13, startTime=1692395728314; duration=0sec 2023-08-18 21:55:28,365 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:55:30,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:55:30,336 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 5096705496daf72746c3f1b73aa7b99a 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-18 21:55:30,371 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=287 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/3205e422805f48bb8e5b2df4c685075e 2023-08-18 21:55:30,380 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/3205e422805f48bb8e5b2df4c685075e as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/3205e422805f48bb8e5b2df4c685075e 2023-08-18 21:55:30,402 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=5096705496daf72746c3f1b73aa7b99a, server=jenkins-hbase20.apache.org,43445,1692395653940 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-18 21:55:30,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] ipc.CallRunner(144): callId: 265 service: ClientService methodName: Mutate size: 1.2 K connection: 148.251.75.209:53306 deadline: 1692395740400, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=5096705496daf72746c3f1b73aa7b99a, server=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:55:30,413 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/3205e422805f48bb8e5b2df4c685075e, entries=8, sequenceid=287, filesize=13.0 K 2023-08-18 21:55:30,415 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 5096705496daf72746c3f1b73aa7b99a in 79ms, sequenceid=287, compaction requested=true 2023-08-18 21:55:30,415 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:30,415 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-08-18 21:55:30,415 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-18 21:55:30,417 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 186258 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-18 21:55:30,417 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1912): 5096705496daf72746c3f1b73aa7b99a/info is initiating minor compaction (all files) 2023-08-18 21:55:30,417 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5096705496daf72746c3f1b73aa7b99a/info in TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:55:30,418 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/36067f359fc5450b9296c39eb7caabd9, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/d1a5a7373de84e1aa8b370890ef69439, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/3205e422805f48bb8e5b2df4c685075e] into tmpdir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp, totalSize=181.9 K 2023-08-18 21:55:30,418 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 36067f359fc5450b9296c39eb7caabd9, keycount=135, bloomtype=ROW, size=144.6 K, encoding=NONE, compression=NONE, seqNum=253, earliestPutTs=1692395667723 2023-08-18 21:55:30,419 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting d1a5a7373de84e1aa8b370890ef69439, keycount=19, bloomtype=ROW, size=24.3 K, encoding=NONE, compression=NONE, seqNum=275, earliestPutTs=1692395728286 2023-08-18 21:55:30,419 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 3205e422805f48bb8e5b2df4c685075e, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=287, earliestPutTs=1692395728316 2023-08-18 21:55:30,450 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5096705496daf72746c3f1b73aa7b99a#info#compaction#42 average throughput is 81.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-18 21:55:30,526 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/0512e83a0699405388bee13f96a304b7 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/0512e83a0699405388bee13f96a304b7 2023-08-18 21:55:30,533 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5096705496daf72746c3f1b73aa7b99a/info of 5096705496daf72746c3f1b73aa7b99a into 0512e83a0699405388bee13f96a304b7(size=172.5 K), total size for store is 172.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-18 21:55:30,533 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:30,533 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a., storeName=5096705496daf72746c3f1b73aa7b99a/info, priority=13, startTime=1692395730415; duration=0sec 2023-08-18 21:55:30,533 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:55:40,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:55:40,452 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 5096705496daf72746c3f1b73aa7b99a 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-18 21:55:40,462 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=5096705496daf72746c3f1b73aa7b99a, server=jenkins-hbase20.apache.org,43445,1692395653940 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-18 21:55:40,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] ipc.CallRunner(144): callId: 275 service: ClientService methodName: Mutate size: 1.2 K connection: 148.251.75.209:53306 deadline: 1692395750462, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=5096705496daf72746c3f1b73aa7b99a, server=jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:55:40,470 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=313 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/7cc1c53b5d294d8a93158a62d154339f 2023-08-18 21:55:40,484 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/7cc1c53b5d294d8a93158a62d154339f as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/7cc1c53b5d294d8a93158a62d154339f 2023-08-18 21:55:40,493 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/7cc1c53b5d294d8a93158a62d154339f, entries=22, sequenceid=313, filesize=27.4 K 2023-08-18 21:55:40,494 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=7.18 KB/7357 for 5096705496daf72746c3f1b73aa7b99a in 42ms, sequenceid=313, compaction requested=false 2023-08-18 21:55:40,494 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:50,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(9158): Flush requested on 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:55:50,543 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 5096705496daf72746c3f1b73aa7b99a 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-18 21:55:50,578 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=324 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/429658699df74d2084bcb66c3e0c6768 2023-08-18 21:55:50,587 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/429658699df74d2084bcb66c3e0c6768 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/429658699df74d2084bcb66c3e0c6768 2023-08-18 21:55:50,592 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/429658699df74d2084bcb66c3e0c6768, entries=8, sequenceid=324, filesize=13.0 K 2023-08-18 21:55:50,593 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=1.03 KB/1051 for 5096705496daf72746c3f1b73aa7b99a in 50ms, sequenceid=324, compaction requested=true 2023-08-18 21:55:50,593 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:50,593 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:55:50,593 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-18 21:55:50,594 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 217988 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-18 21:55:50,595 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1912): 5096705496daf72746c3f1b73aa7b99a/info is initiating minor compaction (all files) 2023-08-18 21:55:50,595 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5096705496daf72746c3f1b73aa7b99a/info in TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:55:50,595 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/0512e83a0699405388bee13f96a304b7, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/7cc1c53b5d294d8a93158a62d154339f, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/429658699df74d2084bcb66c3e0c6768] into tmpdir=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp, totalSize=212.9 K 2023-08-18 21:55:50,595 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 0512e83a0699405388bee13f96a304b7, keycount=162, bloomtype=ROW, size=172.5 K, encoding=NONE, compression=NONE, seqNum=287, earliestPutTs=1692395667723 2023-08-18 21:55:50,596 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 7cc1c53b5d294d8a93158a62d154339f, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=313, earliestPutTs=1692395730338 2023-08-18 21:55:50,596 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] compactions.Compactor(207): Compacting 429658699df74d2084bcb66c3e0c6768, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=324, earliestPutTs=1692395740452 2023-08-18 21:55:50,614 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5096705496daf72746c3f1b73aa7b99a#info#compaction#45 average throughput is 48.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-18 21:55:50,636 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/2321b44e53ef41b19cafdbc24f8deab2 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/2321b44e53ef41b19cafdbc24f8deab2 2023-08-18 21:55:50,644 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5096705496daf72746c3f1b73aa7b99a/info of 5096705496daf72746c3f1b73aa7b99a into 2321b44e53ef41b19cafdbc24f8deab2(size=203.5 K), total size for store is 203.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-18 21:55:50,644 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:50,644 INFO [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a., storeName=5096705496daf72746c3f1b73aa7b99a/info, priority=13, startTime=1692395750593; duration=0sec 2023-08-18 21:55:50,644 DEBUG [RS:0;jenkins-hbase20:43445-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-18 21:55:52,545 INFO [Listener at localhost/43617] wal.AbstractTestLogRolling(188): after writing there are 0 log files 2023-08-18 21:55:52,568 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45451,DS-22a9a99d-5b2d-4afb-876d-f921623ecc52,DISK] 2023-08-18 21:55:52,568 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46083,DS-4de6e420-299f-4cf3-8f66-78f9a6f1e1f3,DISK] 2023-08-18 21:55:52,578 INFO [Listener at localhost/43617] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/WALs/jenkins-hbase20.apache.org,43445,1692395653940/jenkins-hbase20.apache.org%2C43445%2C1692395653940.1692395654721 with entries=311, filesize=301.41 KB; new WAL /user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/WALs/jenkins-hbase20.apache.org,43445,1692395653940/jenkins-hbase20.apache.org%2C43445%2C1692395653940.1692395752546 2023-08-18 21:55:52,578 DEBUG [Listener at localhost/43617] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46083,DS-4de6e420-299f-4cf3-8f66-78f9a6f1e1f3,DISK], DatanodeInfoWithStorage[127.0.0.1:45451,DS-22a9a99d-5b2d-4afb-876d-f921623ecc52,DISK]] 2023-08-18 21:55:52,578 DEBUG [Listener at localhost/43617] wal.AbstractFSWAL(716): hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/WALs/jenkins-hbase20.apache.org,43445,1692395653940/jenkins-hbase20.apache.org%2C43445%2C1692395653940.1692395654721 is not closed yet, will try archiving it next time 2023-08-18 21:55:52,584 INFO [Listener at localhost/43617] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.26 KB heapSize=4.19 KB 2023-08-18 21:55:52,598 INFO [Listener at localhost/43617] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.26 KB at sequenceid=24 (bloomFilter=false), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/.tmp/info/16e30cb7743d400ead48b3f880440bb4 2023-08-18 21:55:52,605 DEBUG [Listener at localhost/43617] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/.tmp/info/16e30cb7743d400ead48b3f880440bb4 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/info/16e30cb7743d400ead48b3f880440bb4 2023-08-18 21:55:52,612 INFO [Listener at localhost/43617] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/info/16e30cb7743d400ead48b3f880440bb4, entries=16, sequenceid=24, filesize=7.0 K 2023-08-18 21:55:52,613 INFO [Listener at localhost/43617] regionserver.HRegion(2948): Finished flush of dataSize ~2.26 KB/2316, heapSize ~3.67 KB/3760, currentSize=0 B/0 for 1588230740 in 29ms, sequenceid=24, compaction requested=false 2023-08-18 21:55:52,613 DEBUG [Listener at localhost/43617] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-08-18 21:55:52,614 INFO [Listener at localhost/43617] regionserver.HRegion(2745): Flushing d5adf88824da518151248f599cedaf52 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-18 21:55:52,640 INFO [Listener at localhost/43617] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/namespace/d5adf88824da518151248f599cedaf52/.tmp/info/df97edb0aabb4acb928077ac53306836 2023-08-18 21:55:52,648 DEBUG [Listener at localhost/43617] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/namespace/d5adf88824da518151248f599cedaf52/.tmp/info/df97edb0aabb4acb928077ac53306836 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/namespace/d5adf88824da518151248f599cedaf52/info/df97edb0aabb4acb928077ac53306836 2023-08-18 21:55:52,657 INFO [Listener at localhost/43617] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/namespace/d5adf88824da518151248f599cedaf52/info/df97edb0aabb4acb928077ac53306836, entries=2, sequenceid=6, filesize=4.8 K 2023-08-18 21:55:52,658 INFO [Listener at localhost/43617] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d5adf88824da518151248f599cedaf52 in 44ms, sequenceid=6, compaction requested=false 2023-08-18 21:55:52,659 DEBUG [Listener at localhost/43617] regionserver.HRegion(2446): Flush status journal for d5adf88824da518151248f599cedaf52: 2023-08-18 21:55:52,660 DEBUG [Listener at localhost/43617] regionserver.HRegion(2446): Flush status journal for a35817ba29f0034353c852bda8109aa8: 2023-08-18 21:55:52,660 INFO [Listener at localhost/43617] regionserver.HRegion(2745): Flushing 5096705496daf72746c3f1b73aa7b99a 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-18 21:55:52,678 INFO [Listener at localhost/43617] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=329 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/657171ed4ea347dbbb98f9a230321132 2023-08-18 21:55:52,685 DEBUG [Listener at localhost/43617] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/.tmp/info/657171ed4ea347dbbb98f9a230321132 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/657171ed4ea347dbbb98f9a230321132 2023-08-18 21:55:52,691 INFO [Listener at localhost/43617] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/657171ed4ea347dbbb98f9a230321132, entries=1, sequenceid=329, filesize=5.8 K 2023-08-18 21:55:52,692 INFO [Listener at localhost/43617] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 5096705496daf72746c3f1b73aa7b99a in 32ms, sequenceid=329, compaction requested=false 2023-08-18 21:55:52,692 DEBUG [Listener at localhost/43617] regionserver.HRegion(2446): Flush status journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:52,709 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46083,DS-4de6e420-299f-4cf3-8f66-78f9a6f1e1f3,DISK] 2023-08-18 21:55:52,711 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45451,DS-22a9a99d-5b2d-4afb-876d-f921623ecc52,DISK] 2023-08-18 21:55:52,714 INFO [Listener at localhost/43617] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/WALs/jenkins-hbase20.apache.org,43445,1692395653940/jenkins-hbase20.apache.org%2C43445%2C1692395653940.1692395752546 with entries=4, filesize=1.22 KB; new WAL /user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/WALs/jenkins-hbase20.apache.org,43445,1692395653940/jenkins-hbase20.apache.org%2C43445%2C1692395653940.1692395752692 2023-08-18 21:55:52,714 DEBUG [Listener at localhost/43617] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46083,DS-4de6e420-299f-4cf3-8f66-78f9a6f1e1f3,DISK], DatanodeInfoWithStorage[127.0.0.1:45451,DS-22a9a99d-5b2d-4afb-876d-f921623ecc52,DISK]] 2023-08-18 21:55:52,714 DEBUG [Listener at localhost/43617] wal.AbstractFSWAL(716): hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/WALs/jenkins-hbase20.apache.org,43445,1692395653940/jenkins-hbase20.apache.org%2C43445%2C1692395653940.1692395752546 is not closed yet, will try archiving it next time 2023-08-18 21:55:52,719 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/WALs/jenkins-hbase20.apache.org,43445,1692395653940/jenkins-hbase20.apache.org%2C43445%2C1692395653940.1692395654721 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/oldWALs/jenkins-hbase20.apache.org%2C43445%2C1692395653940.1692395654721 2023-08-18 21:55:52,720 INFO [Listener at localhost/43617] hbase.Waiter(180): Waiting up to [5,000] milli-secs(wait.for.ratio=[1]) 2023-08-18 21:55:52,723 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/WALs/jenkins-hbase20.apache.org,43445,1692395653940/jenkins-hbase20.apache.org%2C43445%2C1692395653940.1692395752546 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/oldWALs/jenkins-hbase20.apache.org%2C43445%2C1692395653940.1692395752546 2023-08-18 21:55:52,820 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-18 21:55:52,820 INFO [Listener at localhost/43617] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-18 21:55:52,820 DEBUG [Listener at localhost/43617] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23096606 to 127.0.0.1:56270 2023-08-18 21:55:52,820 DEBUG [Listener at localhost/43617] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:55:52,820 DEBUG [Listener at localhost/43617] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-18 21:55:52,820 DEBUG [Listener at localhost/43617] util.JVMClusterUtil(257): Found active master hash=847972597, stopped=false 2023-08-18 21:55:52,821 INFO [Listener at localhost/43617] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,41299,1692395653902 2023-08-18 21:55:52,821 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-18 21:55:52,821 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x1000ce71c190001, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-18 21:55:52,822 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:55:52,822 INFO [Listener at localhost/43617] procedure2.ProcedureExecutor(629): Stopping 2023-08-18 21:55:52,823 DEBUG [Listener at localhost/43617] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x611c5087 to 127.0.0.1:56270 2023-08-18 21:55:52,823 DEBUG [Listener at localhost/43617] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:55:52,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:55:52,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x1000ce71c190001, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:55:52,823 INFO [Listener at localhost/43617] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,43445,1692395653940' ***** 2023-08-18 21:55:52,823 INFO [Listener at localhost/43617] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-18 21:55:52,823 INFO [RS:0;jenkins-hbase20:43445] regionserver.HeapMemoryManager(220): Stopping 2023-08-18 21:55:52,823 INFO [RS:0;jenkins-hbase20:43445] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-18 21:55:52,823 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-18 21:55:52,823 INFO [RS:0;jenkins-hbase20:43445] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-18 21:55:52,823 INFO [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(3305): Received CLOSE for d5adf88824da518151248f599cedaf52 2023-08-18 21:55:52,824 INFO [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(3305): Received CLOSE for a35817ba29f0034353c852bda8109aa8 2023-08-18 21:55:52,824 INFO [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(3305): Received CLOSE for 5096705496daf72746c3f1b73aa7b99a 2023-08-18 21:55:52,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d5adf88824da518151248f599cedaf52, disabling compactions & flushes 2023-08-18 21:55:52,824 INFO [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:55:52,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52. 2023-08-18 21:55:52,824 DEBUG [RS:0;jenkins-hbase20:43445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0dd5cd43 to 127.0.0.1:56270 2023-08-18 21:55:52,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52. 2023-08-18 21:55:52,824 DEBUG [RS:0;jenkins-hbase20:43445] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:55:52,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52. after waiting 0 ms 2023-08-18 21:55:52,824 INFO [RS:0;jenkins-hbase20:43445] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-18 21:55:52,824 INFO [RS:0;jenkins-hbase20:43445] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-18 21:55:52,824 INFO [RS:0;jenkins-hbase20:43445] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-18 21:55:52,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52. 2023-08-18 21:55:52,824 INFO [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-18 21:55:52,824 INFO [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(1474): Waiting on 4 regions to close 2023-08-18 21:55:52,824 DEBUG [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, d5adf88824da518151248f599cedaf52=hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52., a35817ba29f0034353c852bda8109aa8=TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8., 5096705496daf72746c3f1b73aa7b99a=TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.} 2023-08-18 21:55:52,824 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-18 21:55:52,824 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-18 21:55:52,825 DEBUG [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(1504): Waiting on 1588230740, 5096705496daf72746c3f1b73aa7b99a, a35817ba29f0034353c852bda8109aa8, d5adf88824da518151248f599cedaf52 2023-08-18 21:55:52,825 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-18 21:55:52,826 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-18 21:55:52,826 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-18 21:55:52,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/namespace/d5adf88824da518151248f599cedaf52/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-18 21:55:52,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52. 2023-08-18 21:55:52,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d5adf88824da518151248f599cedaf52: 2023-08-18 21:55:52,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1692395654950.d5adf88824da518151248f599cedaf52. 2023-08-18 21:55:52,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a35817ba29f0034353c852bda8109aa8, disabling compactions & flushes 2023-08-18 21:55:52,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8. 2023-08-18 21:55:52,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8. 2023-08-18 21:55:52,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8. after waiting 0 ms 2023-08-18 21:55:52,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8. 2023-08-18 21:55:52,833 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/hbase/meta/1588230740/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-08-18 21:55:52,836 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/a35817ba29f0034353c852bda8109aa8/info/76f707e013d243f18182fe9fff5feb5c.e3057d4258bc99588f29ff11a21364cf->hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/76f707e013d243f18182fe9fff5feb5c-bottom] to archive 2023-08-18 21:55:52,837 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-18 21:55:52,837 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-18 21:55:52,838 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-18 21:55:52,838 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-18 21:55:52,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-18 21:55:52,841 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/a35817ba29f0034353c852bda8109aa8/info/76f707e013d243f18182fe9fff5feb5c.e3057d4258bc99588f29ff11a21364cf to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/a35817ba29f0034353c852bda8109aa8/info/76f707e013d243f18182fe9fff5feb5c.e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:55:52,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/a35817ba29f0034353c852bda8109aa8/recovered.edits/126.seqid, newMaxSeqId=126, maxSeqId=121 2023-08-18 21:55:52,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8. 2023-08-18 21:55:52,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a35817ba29f0034353c852bda8109aa8: 2023-08-18 21:55:52,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,,1692395669816.a35817ba29f0034353c852bda8109aa8. 2023-08-18 21:55:52,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5096705496daf72746c3f1b73aa7b99a, disabling compactions & flushes 2023-08-18 21:55:52,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:55:52,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:55:52,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. after waiting 0 ms 2023-08-18 21:55:52,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:55:52,870 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/76f707e013d243f18182fe9fff5feb5c.e3057d4258bc99588f29ff11a21364cf->hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/e3057d4258bc99588f29ff11a21364cf/info/76f707e013d243f18182fe9fff5feb5c-top, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/TestLogRolling-testLogRolling=e3057d4258bc99588f29ff11a21364cf-ef623c1df6a847b0898c00e9585804bd, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/c0ca4944207740f49550ee60dfa1d7b6, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/TestLogRolling-testLogRolling=e3057d4258bc99588f29ff11a21364cf-84bc730a96384ee38a2dfa44accd6572, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/72a8b84b5a784529bfc2b08183ef8122, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/c53c6c60de174404b87b7119f2507618, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/04d5a65bc19f434ebc373abc56233052, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/47ea6d84037e4d5d828d00c48f83dcce, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/ac9d2e8cd3ba4be99d3cd0a382204aed, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/7e7caacc72cf4bf0a099bfd6c2cc3c0d, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/37b895ee722d45ac9dacac8de31beb87, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/b5b175ffaceb4f01b6f83bd883f4897c, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/1c62d23fd91f47f48c3e1bf6fd3a5e5c, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/e0f1ac32261f4415b893873eb66e8517, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/36067f359fc5450b9296c39eb7caabd9, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/cef88c2fc159432fa076f4f19ebb3a05, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/d1a5a7373de84e1aa8b370890ef69439, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/0512e83a0699405388bee13f96a304b7, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/3205e422805f48bb8e5b2df4c685075e, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/7cc1c53b5d294d8a93158a62d154339f, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/429658699df74d2084bcb66c3e0c6768] to archive 2023-08-18 21:55:52,871 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-18 21:55:52,873 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/76f707e013d243f18182fe9fff5feb5c.e3057d4258bc99588f29ff11a21364cf to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/76f707e013d243f18182fe9fff5feb5c.e3057d4258bc99588f29ff11a21364cf 2023-08-18 21:55:52,875 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/TestLogRolling-testLogRolling=e3057d4258bc99588f29ff11a21364cf-ef623c1df6a847b0898c00e9585804bd to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/TestLogRolling-testLogRolling=e3057d4258bc99588f29ff11a21364cf-ef623c1df6a847b0898c00e9585804bd 2023-08-18 21:55:52,876 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/c0ca4944207740f49550ee60dfa1d7b6 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/c0ca4944207740f49550ee60dfa1d7b6 2023-08-18 21:55:52,877 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/TestLogRolling-testLogRolling=e3057d4258bc99588f29ff11a21364cf-84bc730a96384ee38a2dfa44accd6572 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/TestLogRolling-testLogRolling=e3057d4258bc99588f29ff11a21364cf-84bc730a96384ee38a2dfa44accd6572 2023-08-18 21:55:52,878 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/72a8b84b5a784529bfc2b08183ef8122 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/72a8b84b5a784529bfc2b08183ef8122 2023-08-18 21:55:52,879 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/c53c6c60de174404b87b7119f2507618 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/c53c6c60de174404b87b7119f2507618 2023-08-18 21:55:52,880 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/04d5a65bc19f434ebc373abc56233052 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/04d5a65bc19f434ebc373abc56233052 2023-08-18 21:55:52,881 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/47ea6d84037e4d5d828d00c48f83dcce to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/47ea6d84037e4d5d828d00c48f83dcce 2023-08-18 21:55:52,883 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/ac9d2e8cd3ba4be99d3cd0a382204aed to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/ac9d2e8cd3ba4be99d3cd0a382204aed 2023-08-18 21:55:52,885 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/7e7caacc72cf4bf0a099bfd6c2cc3c0d to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/7e7caacc72cf4bf0a099bfd6c2cc3c0d 2023-08-18 21:55:52,886 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/37b895ee722d45ac9dacac8de31beb87 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/37b895ee722d45ac9dacac8de31beb87 2023-08-18 21:55:52,888 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/b5b175ffaceb4f01b6f83bd883f4897c to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/b5b175ffaceb4f01b6f83bd883f4897c 2023-08-18 21:55:52,889 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/1c62d23fd91f47f48c3e1bf6fd3a5e5c to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/1c62d23fd91f47f48c3e1bf6fd3a5e5c 2023-08-18 21:55:52,890 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/e0f1ac32261f4415b893873eb66e8517 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/e0f1ac32261f4415b893873eb66e8517 2023-08-18 21:55:52,891 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/36067f359fc5450b9296c39eb7caabd9 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/36067f359fc5450b9296c39eb7caabd9 2023-08-18 21:55:52,892 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/cef88c2fc159432fa076f4f19ebb3a05 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/cef88c2fc159432fa076f4f19ebb3a05 2023-08-18 21:55:52,893 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/d1a5a7373de84e1aa8b370890ef69439 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/d1a5a7373de84e1aa8b370890ef69439 2023-08-18 21:55:52,894 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/0512e83a0699405388bee13f96a304b7 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/0512e83a0699405388bee13f96a304b7 2023-08-18 21:55:52,895 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/3205e422805f48bb8e5b2df4c685075e to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/3205e422805f48bb8e5b2df4c685075e 2023-08-18 21:55:52,896 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/7cc1c53b5d294d8a93158a62d154339f to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/7cc1c53b5d294d8a93158a62d154339f 2023-08-18 21:55:52,897 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/429658699df74d2084bcb66c3e0c6768 to hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/archive/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/info/429658699df74d2084bcb66c3e0c6768 2023-08-18 21:55:52,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/data/default/TestLogRolling-testLogRolling/5096705496daf72746c3f1b73aa7b99a/recovered.edits/332.seqid, newMaxSeqId=332, maxSeqId=121 2023-08-18 21:55:52,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:55:52,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5096705496daf72746c3f1b73aa7b99a: 2023-08-18 21:55:52,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,row0064,1692395669816.5096705496daf72746c3f1b73aa7b99a. 2023-08-18 21:55:53,026 INFO [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,43445,1692395653940; all regions closed. 2023-08-18 21:55:53,036 DEBUG [RS:0;jenkins-hbase20:43445] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/oldWALs 2023-08-18 21:55:53,036 INFO [RS:0;jenkins-hbase20:43445] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43445%2C1692395653940.meta:.meta(num 1692395654895) 2023-08-18 21:55:53,041 DEBUG [RS:0;jenkins-hbase20:43445] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/oldWALs 2023-08-18 21:55:53,041 INFO [RS:0;jenkins-hbase20:43445] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43445%2C1692395653940:(num 1692395752692) 2023-08-18 21:55:53,041 DEBUG [RS:0;jenkins-hbase20:43445] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:55:53,041 INFO [RS:0;jenkins-hbase20:43445] regionserver.LeaseManager(133): Closed leases 2023-08-18 21:55:53,042 INFO [RS:0;jenkins-hbase20:43445] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-08-18 21:55:53,042 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-18 21:55:53,042 INFO [RS:0;jenkins-hbase20:43445] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:43445 2023-08-18 21:55:53,045 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-18 21:55:53,045 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x1000ce71c190001, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,43445,1692395653940 2023-08-18 21:55:53,045 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x1000ce71c190001, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-18 21:55:53,046 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,43445,1692395653940] 2023-08-18 21:55:53,046 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,43445,1692395653940; numProcessing=1 2023-08-18 21:55:53,046 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,43445,1692395653940 already deleted, retry=false 2023-08-18 21:55:53,046 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,43445,1692395653940 expired; onlineServers=0 2023-08-18 21:55:53,046 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,41299,1692395653902' ***** 2023-08-18 21:55:53,046 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-18 21:55:53,047 DEBUG [M:0;jenkins-hbase20:41299] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36b49a7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-08-18 21:55:53,047 INFO [M:0;jenkins-hbase20:41299] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,41299,1692395653902 2023-08-18 21:55:53,047 INFO [M:0;jenkins-hbase20:41299] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,41299,1692395653902; all regions closed. 2023-08-18 21:55:53,047 DEBUG [M:0;jenkins-hbase20:41299] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:55:53,047 DEBUG [M:0;jenkins-hbase20:41299] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-18 21:55:53,047 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-18 21:55:53,047 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1692395654514] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1692395654514,5,FailOnTimeoutGroup] 2023-08-18 21:55:53,047 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1692395654514] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1692395654514,5,FailOnTimeoutGroup] 2023-08-18 21:55:53,047 DEBUG [M:0;jenkins-hbase20:41299] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-18 21:55:53,048 INFO [M:0;jenkins-hbase20:41299] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-18 21:55:53,048 INFO [M:0;jenkins-hbase20:41299] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-18 21:55:53,048 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-18 21:55:53,048 INFO [M:0;jenkins-hbase20:41299] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-08-18 21:55:53,048 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:55:53,049 DEBUG [M:0;jenkins-hbase20:41299] master.HMaster(1512): Stopping service threads 2023-08-18 21:55:53,049 INFO [M:0;jenkins-hbase20:41299] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-18 21:55:53,049 ERROR [M:0;jenkins-hbase20:41299] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-08-18 21:55:53,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-18 21:55:53,049 INFO [M:0;jenkins-hbase20:41299] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-18 21:55:53,049 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-18 21:55:53,050 DEBUG [M:0;jenkins-hbase20:41299] zookeeper.ZKUtil(398): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-18 21:55:53,050 WARN [M:0;jenkins-hbase20:41299] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-18 21:55:53,050 INFO [M:0;jenkins-hbase20:41299] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-18 21:55:53,050 INFO [M:0;jenkins-hbase20:41299] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-18 21:55:53,051 DEBUG [M:0;jenkins-hbase20:41299] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-18 21:55:53,051 INFO [M:0;jenkins-hbase20:41299] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:55:53,051 DEBUG [M:0;jenkins-hbase20:41299] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:55:53,051 DEBUG [M:0;jenkins-hbase20:41299] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-18 21:55:53,051 DEBUG [M:0;jenkins-hbase20:41299] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:55:53,051 INFO [M:0;jenkins-hbase20:41299] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=64.79 KB heapSize=78.52 KB 2023-08-18 21:55:53,065 INFO [M:0;jenkins-hbase20:41299] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=64.79 KB at sequenceid=160 (bloomFilter=true), to=hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/34bb6bdd6d704793bebf30130b7fefc0 2023-08-18 21:55:53,070 INFO [M:0;jenkins-hbase20:41299] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34bb6bdd6d704793bebf30130b7fefc0 2023-08-18 21:55:53,071 DEBUG [M:0;jenkins-hbase20:41299] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/34bb6bdd6d704793bebf30130b7fefc0 as hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/34bb6bdd6d704793bebf30130b7fefc0 2023-08-18 21:55:53,078 INFO [M:0;jenkins-hbase20:41299] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34bb6bdd6d704793bebf30130b7fefc0 2023-08-18 21:55:53,078 INFO [M:0;jenkins-hbase20:41299] regionserver.HStore(1080): Added hdfs://localhost:36783/user/jenkins/test-data/df839829-d5fc-43d3-98e8-1ca40c9eda09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/34bb6bdd6d704793bebf30130b7fefc0, entries=18, sequenceid=160, filesize=6.9 K 2023-08-18 21:55:53,079 INFO [M:0;jenkins-hbase20:41299] regionserver.HRegion(2948): Finished flush of dataSize ~64.79 KB/66344, heapSize ~78.51 KB/80392, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=160, compaction requested=false 2023-08-18 21:55:53,080 INFO [M:0;jenkins-hbase20:41299] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:55:53,080 DEBUG [M:0;jenkins-hbase20:41299] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-18 21:55:53,083 INFO [M:0;jenkins-hbase20:41299] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-18 21:55:53,084 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-18 21:55:53,084 INFO [M:0;jenkins-hbase20:41299] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41299 2023-08-18 21:55:53,091 DEBUG [M:0;jenkins-hbase20:41299] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,41299,1692395653902 already deleted, retry=false 2023-08-18 21:55:53,146 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x1000ce71c190001, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:55:53,146 INFO [RS:0;jenkins-hbase20:43445] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,43445,1692395653940; zookeeper connection closed. 2023-08-18 21:55:53,146 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x1000ce71c190001, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:55:53,147 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5b195420] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5b195420 2023-08-18 21:55:53,147 INFO [Listener at localhost/43617] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-18 21:55:53,246 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:55:53,246 DEBUG [Listener at localhost/43617-EventThread] zookeeper.ZKWatcher(600): master:41299-0x1000ce71c190000, quorum=127.0.0.1:56270, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:55:53,246 INFO [M:0;jenkins-hbase20:41299] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,41299,1692395653902; zookeeper connection closed. 2023-08-18 21:55:53,248 WARN [Listener at localhost/43617] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-18 21:55:53,256 INFO [Listener at localhost/43617] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:55:53,368 WARN [BP-265049636-148.251.75.209-1692395653446 heartbeating to localhost/127.0.0.1:36783] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-18 21:55:53,368 WARN [BP-265049636-148.251.75.209-1692395653446 heartbeating to localhost/127.0.0.1:36783] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-265049636-148.251.75.209-1692395653446 (Datanode Uuid a21648ec-45f5-4e59-87a6-ac1401e72ea7) service to localhost/127.0.0.1:36783 2023-08-18 21:55:53,370 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/cluster_08b0cf47-de67-7890-9b90-e2d5581194a5/dfs/data/data3/current/BP-265049636-148.251.75.209-1692395653446] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:55:53,371 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/cluster_08b0cf47-de67-7890-9b90-e2d5581194a5/dfs/data/data4/current/BP-265049636-148.251.75.209-1692395653446] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:55:53,373 WARN [Listener at localhost/43617] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-18 21:55:53,376 INFO [Listener at localhost/43617] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:55:53,483 WARN [BP-265049636-148.251.75.209-1692395653446 heartbeating to localhost/127.0.0.1:36783] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-18 21:55:53,483 WARN [BP-265049636-148.251.75.209-1692395653446 heartbeating to localhost/127.0.0.1:36783] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-265049636-148.251.75.209-1692395653446 (Datanode Uuid eb7654ad-1276-4680-9faa-de4cde2535a2) service to localhost/127.0.0.1:36783 2023-08-18 21:55:53,485 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/cluster_08b0cf47-de67-7890-9b90-e2d5581194a5/dfs/data/data1/current/BP-265049636-148.251.75.209-1692395653446] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:55:53,485 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/cluster_08b0cf47-de67-7890-9b90-e2d5581194a5/dfs/data/data2/current/BP-265049636-148.251.75.209-1692395653446] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:55:53,501 INFO [Listener at localhost/43617] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:55:53,623 INFO [Listener at localhost/43617] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-18 21:55:53,657 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-18 21:55:53,667 INFO [Listener at localhost/43617] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=76 (was 64) - Thread LEAK? -, OpenFileDescriptor=466 (was 435) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=151 (was 159), ProcessCount=168 (was 168), AvailableMemoryMB=2370 (was 2642) 2023-08-18 21:55:53,677 INFO [Listener at localhost/43617] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=77, OpenFileDescriptor=466, MaxFileDescriptor=60000, SystemLoadAverage=151, ProcessCount=168, AvailableMemoryMB=2369 2023-08-18 21:55:53,677 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-18 21:55:53,677 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/hadoop.log.dir so I do NOT create it in target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453 2023-08-18 21:55:53,677 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9775cc11-0219-4374-9d2c-36722513cb6e/hadoop.tmp.dir so I do NOT create it in target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453 2023-08-18 21:55:53,677 INFO [Listener at localhost/43617] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/cluster_c13a358c-eebb-5ab4-9c88-5baa03cbe20e, deleteOnExit=true 2023-08-18 21:55:53,677 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-18 21:55:53,678 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/test.cache.data in system properties and HBase conf 2023-08-18 21:55:53,678 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/hadoop.tmp.dir in system properties and HBase conf 2023-08-18 21:55:53,678 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/hadoop.log.dir in system properties and HBase conf 2023-08-18 21:55:53,678 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-18 21:55:53,678 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-18 21:55:53,678 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-18 21:55:53,678 DEBUG [Listener at localhost/43617] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-18 21:55:53,678 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-18 21:55:53,679 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-18 21:55:53,679 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-18 21:55:53,679 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-18 21:55:53,679 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-18 21:55:53,679 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-18 21:55:53,679 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-18 21:55:53,679 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-18 21:55:53,679 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-18 21:55:53,679 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/nfs.dump.dir in system properties and HBase conf 2023-08-18 21:55:53,680 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/java.io.tmpdir in system properties and HBase conf 2023-08-18 21:55:53,680 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-18 21:55:53,680 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-18 21:55:53,680 INFO [Listener at localhost/43617] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-18 21:55:53,682 WARN [Listener at localhost/43617] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-18 21:55:53,683 WARN [Listener at localhost/43617] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-18 21:55:53,708 WARN [Listener at localhost/43617] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:55:53,709 INFO [Listener at localhost/43617] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:55:53,713 INFO [Listener at localhost/43617] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/java.io.tmpdir/Jetty_localhost_38587_hdfs____.x85ko7/webapp 2023-08-18 21:55:53,791 INFO [Listener at localhost/43617] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38587 2023-08-18 21:55:53,795 WARN [Listener at localhost/43617] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-18 21:55:53,795 WARN [Listener at localhost/43617] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-18 21:55:53,829 WARN [Listener at localhost/42243] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:55:53,842 WARN [Listener at localhost/42243] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-18 21:55:53,845 WARN [Listener at localhost/42243] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:55:53,847 INFO [Listener at localhost/42243] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:55:53,856 INFO [Listener at localhost/42243] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/java.io.tmpdir/Jetty_localhost_44569_datanode____a6u5nj/webapp 2023-08-18 21:55:53,949 INFO [Listener at localhost/42243] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44569 2023-08-18 21:55:53,955 WARN [Listener at localhost/42251] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:55:53,977 WARN [Listener at localhost/42251] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-18 21:55:53,979 WARN [Listener at localhost/42251] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-18 21:55:53,980 INFO [Listener at localhost/42251] log.Slf4jLog(67): jetty-6.1.26 2023-08-18 21:55:53,994 INFO [Listener at localhost/42251] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/java.io.tmpdir/Jetty_localhost_41343_datanode____vhp77g/webapp 2023-08-18 21:55:54,049 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x466a6878d155cee3: Processing first storage report for DS-30907949-c0b9-4846-ad36-3b32c888dd70 from datanode ca8e2606-b8cf-44f3-a0d4-257cabf9afcc 2023-08-18 21:55:54,049 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x466a6878d155cee3: from storage DS-30907949-c0b9-4846-ad36-3b32c888dd70 node DatanodeRegistration(127.0.0.1:40419, datanodeUuid=ca8e2606-b8cf-44f3-a0d4-257cabf9afcc, infoPort=32793, infoSecurePort=0, ipcPort=42251, storageInfo=lv=-57;cid=testClusterID;nsid=1353780957;c=1692395753684), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:55:54,049 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x466a6878d155cee3: Processing first storage report for DS-13b056d4-9d59-4e4d-b236-845688355efb from datanode ca8e2606-b8cf-44f3-a0d4-257cabf9afcc 2023-08-18 21:55:54,049 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x466a6878d155cee3: from storage DS-13b056d4-9d59-4e4d-b236-845688355efb node DatanodeRegistration(127.0.0.1:40419, datanodeUuid=ca8e2606-b8cf-44f3-a0d4-257cabf9afcc, infoPort=32793, infoSecurePort=0, ipcPort=42251, storageInfo=lv=-57;cid=testClusterID;nsid=1353780957;c=1692395753684), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:55:54,088 INFO [Listener at localhost/42251] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41343 2023-08-18 21:55:54,096 WARN [Listener at localhost/43753] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-18 21:55:54,162 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb7fa6f9ed69e2c2: Processing first storage report for DS-d1723429-6f74-4645-82a2-7456a058b2dc from datanode d2d9faad-0efc-4f67-91ee-5cb29d6be581 2023-08-18 21:55:54,162 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb7fa6f9ed69e2c2: from storage DS-d1723429-6f74-4645-82a2-7456a058b2dc node DatanodeRegistration(127.0.0.1:44579, datanodeUuid=d2d9faad-0efc-4f67-91ee-5cb29d6be581, infoPort=35271, infoSecurePort=0, ipcPort=43753, storageInfo=lv=-57;cid=testClusterID;nsid=1353780957;c=1692395753684), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-18 21:55:54,162 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb7fa6f9ed69e2c2: Processing first storage report for DS-e367cf77-2253-42c1-8c49-155aff1a8904 from datanode d2d9faad-0efc-4f67-91ee-5cb29d6be581 2023-08-18 21:55:54,162 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb7fa6f9ed69e2c2: from storage DS-e367cf77-2253-42c1-8c49-155aff1a8904 node DatanodeRegistration(127.0.0.1:44579, datanodeUuid=d2d9faad-0efc-4f67-91ee-5cb29d6be581, infoPort=35271, infoSecurePort=0, ipcPort=43753, storageInfo=lv=-57;cid=testClusterID;nsid=1353780957;c=1692395753684), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-18 21:55:54,205 DEBUG [Listener at localhost/43753] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453 2023-08-18 21:55:54,208 INFO [Listener at localhost/43753] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/cluster_c13a358c-eebb-5ab4-9c88-5baa03cbe20e/zookeeper_0, clientPort=59322, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/cluster_c13a358c-eebb-5ab4-9c88-5baa03cbe20e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/cluster_c13a358c-eebb-5ab4-9c88-5baa03cbe20e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-18 21:55:54,209 INFO [Listener at localhost/43753] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59322 2023-08-18 21:55:54,209 INFO [Listener at localhost/43753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:55:54,210 INFO [Listener at localhost/43753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:55:54,224 INFO [Listener at localhost/43753] util.FSUtils(471): Created version file at hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba with version=8 2023-08-18 21:55:54,224 INFO [Listener at localhost/43753] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:35033/user/jenkins/test-data/e3c70f62-c48a-e187-cfc6-a2e1eae7d05d/hbase-staging 2023-08-18 21:55:54,226 INFO [Listener at localhost/43753] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-08-18 21:55:54,226 INFO [Listener at localhost/43753] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:55:54,226 INFO [Listener at localhost/43753] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-18 21:55:54,226 INFO [Listener at localhost/43753] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-18 21:55:54,226 INFO [Listener at localhost/43753] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:55:54,226 INFO [Listener at localhost/43753] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-18 21:55:54,226 INFO [Listener at localhost/43753] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-18 21:55:54,227 INFO [Listener at localhost/43753] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34521 2023-08-18 21:55:54,228 INFO [Listener at localhost/43753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:55:54,229 INFO [Listener at localhost/43753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:55:54,230 INFO [Listener at localhost/43753] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34521 connecting to ZooKeeper ensemble=127.0.0.1:59322 2023-08-18 21:55:54,234 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:345210x0, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-18 21:55:54,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34521-0x1000ce8a4020000 connected 2023-08-18 21:55:54,244 DEBUG [Listener at localhost/43753] zookeeper.ZKUtil(164): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-18 21:55:54,244 DEBUG [Listener at localhost/43753] zookeeper.ZKUtil(164): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:55:54,245 DEBUG [Listener at localhost/43753] zookeeper.ZKUtil(164): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-18 21:55:54,246 DEBUG [Listener at localhost/43753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34521 2023-08-18 21:55:54,246 DEBUG [Listener at localhost/43753] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34521 2023-08-18 21:55:54,246 DEBUG [Listener at localhost/43753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34521 2023-08-18 21:55:54,247 DEBUG [Listener at localhost/43753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34521 2023-08-18 21:55:54,247 DEBUG [Listener at localhost/43753] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34521 2023-08-18 21:55:54,247 INFO [Listener at localhost/43753] master.HMaster(444): hbase.rootdir=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba, hbase.cluster.distributed=false 2023-08-18 21:55:54,261 INFO [Listener at localhost/43753] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-08-18 21:55:54,261 INFO [Listener at localhost/43753] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:55:54,261 INFO [Listener at localhost/43753] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-18 21:55:54,261 INFO [Listener at localhost/43753] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-18 21:55:54,261 INFO [Listener at localhost/43753] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-18 21:55:54,261 INFO [Listener at localhost/43753] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-18 21:55:54,261 INFO [Listener at localhost/43753] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-18 21:55:54,264 INFO [Listener at localhost/43753] ipc.NettyRpcServer(120): Bind to /148.251.75.209:36781 2023-08-18 21:55:54,264 INFO [Listener at localhost/43753] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-18 21:55:54,266 DEBUG [Listener at localhost/43753] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-18 21:55:54,266 INFO [Listener at localhost/43753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:55:54,267 INFO [Listener at localhost/43753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:55:54,268 INFO [Listener at localhost/43753] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36781 connecting to ZooKeeper ensemble=127.0.0.1:59322 2023-08-18 21:55:54,270 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): regionserver:367810x0, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-18 21:55:54,273 DEBUG [Listener at localhost/43753] zookeeper.ZKUtil(164): regionserver:367810x0, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-18 21:55:54,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36781-0x1000ce8a4020001 connected 2023-08-18 21:55:54,274 DEBUG [Listener at localhost/43753] zookeeper.ZKUtil(164): regionserver:36781-0x1000ce8a4020001, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:55:54,275 DEBUG [Listener at localhost/43753] zookeeper.ZKUtil(164): regionserver:36781-0x1000ce8a4020001, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-18 21:55:54,275 DEBUG [Listener at localhost/43753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36781 2023-08-18 21:55:54,276 DEBUG [Listener at localhost/43753] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36781 2023-08-18 21:55:54,276 DEBUG [Listener at localhost/43753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36781 2023-08-18 21:55:54,276 DEBUG [Listener at localhost/43753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36781 2023-08-18 21:55:54,277 DEBUG [Listener at localhost/43753] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36781 2023-08-18 21:55:54,279 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,34521,1692395754225 2023-08-18 21:55:54,280 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-18 21:55:54,281 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,34521,1692395754225 2023-08-18 21:55:54,281 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-18 21:55:54,281 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): regionserver:36781-0x1000ce8a4020001, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-18 21:55:54,281 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:55:54,283 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-18 21:55:54,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-18 21:55:54,283 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,34521,1692395754225 from backup master directory 2023-08-18 21:55:54,284 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,34521,1692395754225 2023-08-18 21:55:54,284 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-18 21:55:54,284 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-18 21:55:54,284 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,34521,1692395754225 2023-08-18 21:55:54,296 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/hbase.id with ID: 1ff79b25-8646-487a-a26d-d3be1fee7e96 2023-08-18 21:55:54,304 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:55:54,306 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:55:54,312 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7023bd41 to 127.0.0.1:59322 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-18 21:55:54,321 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ab6c15b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-18 21:55:54,321 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-18 21:55:54,322 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-18 21:55:54,322 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-18 21:55:54,323 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/MasterData/data/master/store-tmp 2023-08-18 21:55:54,331 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:55:54,331 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-18 21:55:54,331 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:55:54,331 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:55:54,331 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-18 21:55:54,331 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:55:54,331 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:55:54,331 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-18 21:55:54,331 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/MasterData/WALs/jenkins-hbase20.apache.org,34521,1692395754225 2023-08-18 21:55:54,334 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34521%2C1692395754225, suffix=, logDir=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/MasterData/WALs/jenkins-hbase20.apache.org,34521,1692395754225, archiveDir=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/MasterData/oldWALs, maxLogs=10 2023-08-18 21:55:54,346 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40419,DS-30907949-c0b9-4846-ad36-3b32c888dd70,DISK] 2023-08-18 21:55:54,346 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44579,DS-d1723429-6f74-4645-82a2-7456a058b2dc,DISK] 2023-08-18 21:55:54,348 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/MasterData/WALs/jenkins-hbase20.apache.org,34521,1692395754225/jenkins-hbase20.apache.org%2C34521%2C1692395754225.1692395754334 2023-08-18 21:55:54,348 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40419,DS-30907949-c0b9-4846-ad36-3b32c888dd70,DISK], DatanodeInfoWithStorage[127.0.0.1:44579,DS-d1723429-6f74-4645-82a2-7456a058b2dc,DISK]] 2023-08-18 21:55:54,348 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-18 21:55:54,348 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:55:54,348 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:55:54,348 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:55:54,350 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:55:54,351 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-18 21:55:54,351 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-18 21:55:54,352 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:55:54,352 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:55:54,353 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:55:54,355 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-18 21:55:54,356 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-18 21:55:54,357 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=878605, jitterRate=0.11720424890518188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-18 21:55:54,357 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-18 21:55:54,357 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-18 21:55:54,358 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-18 21:55:54,358 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-18 21:55:54,358 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-18 21:55:54,358 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-18 21:55:54,359 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-18 21:55:54,359 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-18 21:55:54,359 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-18 21:55:54,360 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-18 21:55:54,368 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-18 21:55:54,368 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-18 21:55:54,369 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-18 21:55:54,369 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-18 21:55:54,369 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-18 21:55:54,371 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:55:54,371 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-18 21:55:54,372 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-18 21:55:54,373 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-18 21:55:54,373 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-18 21:55:54,373 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): regionserver:36781-0x1000ce8a4020001, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-18 21:55:54,373 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:55:54,374 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,34521,1692395754225, sessionid=0x1000ce8a4020000, setting cluster-up flag (Was=false) 2023-08-18 21:55:54,377 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:55:54,379 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-18 21:55:54,380 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,34521,1692395754225 2023-08-18 21:55:54,382 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:55:54,384 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-18 21:55:54,385 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,34521,1692395754225 2023-08-18 21:55:54,386 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/.hbase-snapshot/.tmp 2023-08-18 21:55:54,388 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-18 21:55:54,388 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:55:54,388 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:55:54,388 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:55:54,389 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-08-18 21:55:54,389 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-08-18 21:55:54,389 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:55:54,389 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-08-18 21:55:54,389 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:55:54,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1692395784397 2023-08-18 21:55:54,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-18 21:55:54,398 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-18 21:55:54,398 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-18 21:55:54,398 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-18 21:55:54,398 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-18 21:55:54,398 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-18 21:55:54,399 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-18 21:55:54,399 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-18 21:55:54,399 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-18 21:55:54,400 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-18 21:55:54,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-18 21:55:54,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-18 21:55:54,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-18 21:55:54,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-18 21:55:54,400 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1692395754400,5,FailOnTimeoutGroup] 2023-08-18 21:55:54,400 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1692395754400,5,FailOnTimeoutGroup] 2023-08-18 21:55:54,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-18 21:55:54,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-18 21:55:54,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-18 21:55:54,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-18 21:55:54,401 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-18 21:55:54,412 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-18 21:55:54,412 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-18 21:55:54,412 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba 2023-08-18 21:55:54,421 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:55:54,422 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-18 21:55:54,423 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/info 2023-08-18 21:55:54,424 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-18 21:55:54,424 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:55:54,424 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-18 21:55:54,426 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/rep_barrier 2023-08-18 21:55:54,426 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-18 21:55:54,426 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:55:54,426 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-18 21:55:54,428 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/table 2023-08-18 21:55:54,428 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-18 21:55:54,428 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:55:54,429 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740 2023-08-18 21:55:54,430 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740 2023-08-18 21:55:54,432 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-18 21:55:54,435 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-18 21:55:54,437 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-18 21:55:54,438 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=730633, jitterRate=-0.07095259428024292}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-18 21:55:54,438 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-18 21:55:54,438 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-18 21:55:54,438 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-18 21:55:54,438 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-18 21:55:54,438 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-18 21:55:54,438 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-18 21:55:54,438 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-18 21:55:54,438 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-18 21:55:54,439 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-18 21:55:54,439 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-18 21:55:54,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-18 21:55:54,440 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-18 21:55:54,441 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-18 21:55:54,480 INFO [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(951): ClusterId : 1ff79b25-8646-487a-a26d-d3be1fee7e96 2023-08-18 21:55:54,481 DEBUG [RS:0;jenkins-hbase20:36781] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-18 21:55:54,483 DEBUG [RS:0;jenkins-hbase20:36781] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-18 21:55:54,483 DEBUG [RS:0;jenkins-hbase20:36781] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-18 21:55:54,484 DEBUG [RS:0;jenkins-hbase20:36781] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-18 21:55:54,485 DEBUG [RS:0;jenkins-hbase20:36781] zookeeper.ReadOnlyZKClient(139): Connect 0x60f06075 to 127.0.0.1:59322 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-18 21:55:54,488 DEBUG [RS:0;jenkins-hbase20:36781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e37921b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-18 21:55:54,488 DEBUG [RS:0;jenkins-hbase20:36781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a080b05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-08-18 21:55:54,495 DEBUG [RS:0;jenkins-hbase20:36781] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:36781 2023-08-18 21:55:54,495 INFO [RS:0;jenkins-hbase20:36781] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-18 21:55:54,495 INFO [RS:0;jenkins-hbase20:36781] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-18 21:55:54,495 DEBUG [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(1022): About to register with Master. 2023-08-18 21:55:54,496 INFO [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,34521,1692395754225 with isa=jenkins-hbase20.apache.org/148.251.75.209:36781, startcode=1692395754260 2023-08-18 21:55:54,496 DEBUG [RS:0;jenkins-hbase20:36781] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-18 21:55:54,506 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46357, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-08-18 21:55:54,509 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34521] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,36781,1692395754260 2023-08-18 21:55:54,514 DEBUG [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba 2023-08-18 21:55:54,514 DEBUG [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42243 2023-08-18 21:55:54,514 DEBUG [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-18 21:55:54,516 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-18 21:55:54,520 DEBUG [RS:0;jenkins-hbase20:36781] zookeeper.ZKUtil(162): regionserver:36781-0x1000ce8a4020001, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36781,1692395754260 2023-08-18 21:55:54,520 WARN [RS:0;jenkins-hbase20:36781] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-18 21:55:54,520 INFO [RS:0;jenkins-hbase20:36781] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-18 21:55:54,521 DEBUG [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/WALs/jenkins-hbase20.apache.org,36781,1692395754260 2023-08-18 21:55:54,523 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,36781,1692395754260] 2023-08-18 21:55:54,533 DEBUG [RS:0;jenkins-hbase20:36781] zookeeper.ZKUtil(162): regionserver:36781-0x1000ce8a4020001, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36781,1692395754260 2023-08-18 21:55:54,533 DEBUG [RS:0;jenkins-hbase20:36781] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-18 21:55:54,534 INFO [RS:0;jenkins-hbase20:36781] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-18 21:55:54,535 INFO [RS:0;jenkins-hbase20:36781] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-18 21:55:54,535 INFO [RS:0;jenkins-hbase20:36781] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-18 21:55:54,535 INFO [RS:0;jenkins-hbase20:36781] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-18 21:55:54,535 INFO [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-18 21:55:54,537 INFO [RS:0;jenkins-hbase20:36781] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-18 21:55:54,537 DEBUG [RS:0;jenkins-hbase20:36781] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:55:54,537 DEBUG [RS:0;jenkins-hbase20:36781] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:55:54,537 DEBUG [RS:0;jenkins-hbase20:36781] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:55:54,537 DEBUG [RS:0;jenkins-hbase20:36781] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:55:54,537 DEBUG [RS:0;jenkins-hbase20:36781] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:55:54,537 DEBUG [RS:0;jenkins-hbase20:36781] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-08-18 21:55:54,537 DEBUG [RS:0;jenkins-hbase20:36781] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:55:54,537 DEBUG [RS:0;jenkins-hbase20:36781] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:55:54,537 DEBUG [RS:0;jenkins-hbase20:36781] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:55:54,537 DEBUG [RS:0;jenkins-hbase20:36781] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-08-18 21:55:54,538 INFO [RS:0;jenkins-hbase20:36781] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-18 21:55:54,538 INFO [RS:0;jenkins-hbase20:36781] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-18 21:55:54,539 INFO [RS:0;jenkins-hbase20:36781] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-18 21:55:54,551 INFO [RS:0;jenkins-hbase20:36781] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-18 21:55:54,551 INFO [RS:0;jenkins-hbase20:36781] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36781,1692395754260-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-18 21:55:54,561 INFO [RS:0;jenkins-hbase20:36781] regionserver.Replication(203): jenkins-hbase20.apache.org,36781,1692395754260 started 2023-08-18 21:55:54,561 INFO [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,36781,1692395754260, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:36781, sessionid=0x1000ce8a4020001 2023-08-18 21:55:54,561 DEBUG [RS:0;jenkins-hbase20:36781] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-18 21:55:54,561 DEBUG [RS:0;jenkins-hbase20:36781] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,36781,1692395754260 2023-08-18 21:55:54,561 DEBUG [RS:0;jenkins-hbase20:36781] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,36781,1692395754260' 2023-08-18 21:55:54,561 DEBUG [RS:0;jenkins-hbase20:36781] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-18 21:55:54,562 DEBUG [RS:0;jenkins-hbase20:36781] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-18 21:55:54,562 DEBUG [RS:0;jenkins-hbase20:36781] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-18 21:55:54,562 DEBUG [RS:0;jenkins-hbase20:36781] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-18 21:55:54,562 DEBUG [RS:0;jenkins-hbase20:36781] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,36781,1692395754260 2023-08-18 21:55:54,562 DEBUG [RS:0;jenkins-hbase20:36781] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,36781,1692395754260' 2023-08-18 21:55:54,562 DEBUG [RS:0;jenkins-hbase20:36781] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-18 21:55:54,563 DEBUG [RS:0;jenkins-hbase20:36781] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-18 21:55:54,563 DEBUG [RS:0;jenkins-hbase20:36781] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-18 21:55:54,563 INFO [RS:0;jenkins-hbase20:36781] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-18 21:55:54,563 INFO [RS:0;jenkins-hbase20:36781] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-18 21:55:54,592 DEBUG [jenkins-hbase20:34521] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-18 21:55:54,592 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,36781,1692395754260, state=OPENING 2023-08-18 21:55:54,594 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-18 21:55:54,594 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:55:54,595 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-18 21:55:54,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36781,1692395754260}] 2023-08-18 21:55:54,601 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-18 21:55:54,665 INFO [RS:0;jenkins-hbase20:36781] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36781%2C1692395754260, suffix=, logDir=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/WALs/jenkins-hbase20.apache.org,36781,1692395754260, archiveDir=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/oldWALs, maxLogs=32 2023-08-18 21:55:54,683 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44579,DS-d1723429-6f74-4645-82a2-7456a058b2dc,DISK] 2023-08-18 21:55:54,683 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40419,DS-30907949-c0b9-4846-ad36-3b32c888dd70,DISK] 2023-08-18 21:55:54,686 INFO [RS:0;jenkins-hbase20:36781] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/WALs/jenkins-hbase20.apache.org,36781,1692395754260/jenkins-hbase20.apache.org%2C36781%2C1692395754260.1692395754667 2023-08-18 21:55:54,687 DEBUG [RS:0;jenkins-hbase20:36781] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44579,DS-d1723429-6f74-4645-82a2-7456a058b2dc,DISK], DatanodeInfoWithStorage[127.0.0.1:40419,DS-30907949-c0b9-4846-ad36-3b32c888dd70,DISK]] 2023-08-18 21:55:54,748 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,36781,1692395754260 2023-08-18 21:55:54,748 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-18 21:55:54,750 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-18 21:55:54,754 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-18 21:55:54,754 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-18 21:55:54,756 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36781%2C1692395754260.meta, suffix=.meta, logDir=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/WALs/jenkins-hbase20.apache.org,36781,1692395754260, archiveDir=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/oldWALs, maxLogs=32 2023-08-18 21:55:54,771 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44579,DS-d1723429-6f74-4645-82a2-7456a058b2dc,DISK] 2023-08-18 21:55:54,772 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40419,DS-30907949-c0b9-4846-ad36-3b32c888dd70,DISK] 2023-08-18 21:55:54,777 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/WALs/jenkins-hbase20.apache.org,36781,1692395754260/jenkins-hbase20.apache.org%2C36781%2C1692395754260.meta.1692395754756.meta 2023-08-18 21:55:54,777 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44579,DS-d1723429-6f74-4645-82a2-7456a058b2dc,DISK], DatanodeInfoWithStorage[127.0.0.1:40419,DS-30907949-c0b9-4846-ad36-3b32c888dd70,DISK]] 2023-08-18 21:55:54,777 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-18 21:55:54,777 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-18 21:55:54,777 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-18 21:55:54,777 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-18 21:55:54,777 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-18 21:55:54,777 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:55:54,778 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-18 21:55:54,778 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-18 21:55:54,779 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-18 21:55:54,780 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/info 2023-08-18 21:55:54,780 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/info 2023-08-18 21:55:54,780 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-18 21:55:54,781 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:55:54,781 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-18 21:55:54,781 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/rep_barrier 2023-08-18 21:55:54,782 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/rep_barrier 2023-08-18 21:55:54,782 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-18 21:55:54,782 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:55:54,782 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-18 21:55:54,783 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/table 2023-08-18 21:55:54,783 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/table 2023-08-18 21:55:54,783 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-18 21:55:54,784 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:55:54,784 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740 2023-08-18 21:55:54,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740 2023-08-18 21:55:54,788 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-18 21:55:54,790 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-18 21:55:54,791 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=830358, jitterRate=0.05585569143295288}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-18 21:55:54,791 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-18 21:55:54,796 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1692395754748 2023-08-18 21:55:54,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-18 21:55:54,800 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-18 21:55:54,801 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,36781,1692395754260, state=OPEN 2023-08-18 21:55:54,802 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-18 21:55:54,802 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-18 21:55:54,804 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-18 21:55:54,804 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36781,1692395754260 in 207 msec 2023-08-18 21:55:54,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-18 21:55:54,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 365 msec 2023-08-18 21:55:54,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 420 msec 2023-08-18 21:55:54,807 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1692395754807, completionTime=-1 2023-08-18 21:55:54,807 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-18 21:55:54,807 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-18 21:55:54,810 DEBUG [hconnection-0x6006b2d5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-18 21:55:54,812 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-18 21:55:54,813 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-18 21:55:54,814 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1692395814814 2023-08-18 21:55:54,814 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1692395874814 2023-08-18 21:55:54,814 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 6 msec 2023-08-18 21:55:54,830 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34521,1692395754225-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-18 21:55:54,830 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34521,1692395754225-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-18 21:55:54,830 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34521,1692395754225-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-18 21:55:54,830 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:34521, period=300000, unit=MILLISECONDS is enabled. 2023-08-18 21:55:54,830 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-18 21:55:54,830 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-18 21:55:54,830 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-18 21:55:54,831 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-18 21:55:54,834 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-18 21:55:54,834 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-18 21:55:54,835 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-18 21:55:54,837 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/.tmp/data/hbase/namespace/f216e55818e43f9d19702e7682762638 2023-08-18 21:55:54,838 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/.tmp/data/hbase/namespace/f216e55818e43f9d19702e7682762638 empty. 2023-08-18 21:55:54,838 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/.tmp/data/hbase/namespace/f216e55818e43f9d19702e7682762638 2023-08-18 21:55:54,838 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-18 21:55:54,850 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-18 21:55:54,853 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => f216e55818e43f9d19702e7682762638, NAME => 'hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/.tmp 2023-08-18 21:55:54,862 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:55:54,862 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing f216e55818e43f9d19702e7682762638, disabling compactions & flushes 2023-08-18 21:55:54,862 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638. 2023-08-18 21:55:54,862 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638. 2023-08-18 21:55:54,862 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638. after waiting 0 ms 2023-08-18 21:55:54,862 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638. 2023-08-18 21:55:54,862 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638. 2023-08-18 21:55:54,862 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for f216e55818e43f9d19702e7682762638: 2023-08-18 21:55:54,864 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-18 21:55:54,866 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692395754866"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692395754866"}]},"ts":"1692395754866"} 2023-08-18 21:55:54,867 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-18 21:55:54,868 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-18 21:55:54,868 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692395754868"}]},"ts":"1692395754868"} 2023-08-18 21:55:54,869 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-18 21:55:54,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f216e55818e43f9d19702e7682762638, ASSIGN}] 2023-08-18 21:55:54,874 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f216e55818e43f9d19702e7682762638, ASSIGN 2023-08-18 21:55:54,875 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f216e55818e43f9d19702e7682762638, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36781,1692395754260; forceNewPlan=false, retain=false 2023-08-18 21:55:55,026 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f216e55818e43f9d19702e7682762638, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36781,1692395754260 2023-08-18 21:55:55,026 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692395755026"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1692395755026"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692395755026"}]},"ts":"1692395755026"} 2023-08-18 21:55:55,028 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f216e55818e43f9d19702e7682762638, server=jenkins-hbase20.apache.org,36781,1692395754260}] 2023-08-18 21:55:55,183 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638. 2023-08-18 21:55:55,183 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f216e55818e43f9d19702e7682762638, NAME => 'hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638.', STARTKEY => '', ENDKEY => ''} 2023-08-18 21:55:55,184 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f216e55818e43f9d19702e7682762638 2023-08-18 21:55:55,184 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-18 21:55:55,184 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f216e55818e43f9d19702e7682762638 2023-08-18 21:55:55,184 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f216e55818e43f9d19702e7682762638 2023-08-18 21:55:55,185 INFO [StoreOpener-f216e55818e43f9d19702e7682762638-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f216e55818e43f9d19702e7682762638 2023-08-18 21:55:55,187 DEBUG [StoreOpener-f216e55818e43f9d19702e7682762638-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/namespace/f216e55818e43f9d19702e7682762638/info 2023-08-18 21:55:55,187 DEBUG [StoreOpener-f216e55818e43f9d19702e7682762638-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/namespace/f216e55818e43f9d19702e7682762638/info 2023-08-18 21:55:55,187 INFO [StoreOpener-f216e55818e43f9d19702e7682762638-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f216e55818e43f9d19702e7682762638 columnFamilyName info 2023-08-18 21:55:55,188 INFO [StoreOpener-f216e55818e43f9d19702e7682762638-1] regionserver.HStore(310): Store=f216e55818e43f9d19702e7682762638/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-18 21:55:55,189 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/namespace/f216e55818e43f9d19702e7682762638 2023-08-18 21:55:55,191 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/namespace/f216e55818e43f9d19702e7682762638 2023-08-18 21:55:55,194 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f216e55818e43f9d19702e7682762638 2023-08-18 21:55:55,195 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/namespace/f216e55818e43f9d19702e7682762638/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-18 21:55:55,196 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f216e55818e43f9d19702e7682762638; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=865718, jitterRate=0.10081775486469269}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-18 21:55:55,196 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f216e55818e43f9d19702e7682762638: 2023-08-18 21:55:55,197 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638., pid=6, masterSystemTime=1692395755180 2023-08-18 21:55:55,199 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638. 2023-08-18 21:55:55,199 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638. 2023-08-18 21:55:55,199 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f216e55818e43f9d19702e7682762638, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36781,1692395754260 2023-08-18 21:55:55,200 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692395755199"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1692395755199"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692395755199"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692395755199"}]},"ts":"1692395755199"} 2023-08-18 21:55:55,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-18 21:55:55,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f216e55818e43f9d19702e7682762638, server=jenkins-hbase20.apache.org,36781,1692395754260 in 174 msec 2023-08-18 21:55:55,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-18 21:55:55,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f216e55818e43f9d19702e7682762638, ASSIGN in 332 msec 2023-08-18 21:55:55,207 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-18 21:55:55,207 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692395755207"}]},"ts":"1692395755207"} 2023-08-18 21:55:55,208 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-18 21:55:55,211 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-18 21:55:55,213 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 382 msec 2023-08-18 21:55:55,233 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-18 21:55:55,234 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-18 21:55:55,234 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:55:55,242 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-18 21:55:55,251 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-18 21:55:55,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-08-18 21:55:55,265 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-18 21:55:55,271 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-18 21:55:55,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-08-18 21:55:55,282 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-18 21:55:55,283 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-18 21:55:55,283 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.999sec 2023-08-18 21:55:55,283 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-18 21:55:55,283 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-18 21:55:55,284 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-18 21:55:55,284 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34521,1692395754225-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-18 21:55:55,284 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34521,1692395754225-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-18 21:55:55,286 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-18 21:55:55,380 DEBUG [Listener at localhost/43753] zookeeper.ReadOnlyZKClient(139): Connect 0x5ad1bb07 to 127.0.0.1:59322 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-18 21:55:55,385 DEBUG [Listener at localhost/43753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@669be046, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-18 21:55:55,387 DEBUG [hconnection-0x8204339-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-18 21:55:55,389 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-18 21:55:55,391 INFO [Listener at localhost/43753] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,34521,1692395754225 2023-08-18 21:55:55,391 INFO [Listener at localhost/43753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-18 21:55:55,405 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-18 21:55:55,405 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:55:55,406 INFO [Listener at localhost/43753] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-18 21:55:55,406 INFO [Listener at localhost/43753] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-18 21:55:55,408 INFO [Listener at localhost/43753] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=test.com%2C8080%2C1, suffix=, logDir=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/WALs/test.com,8080,1, archiveDir=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/oldWALs, maxLogs=32 2023-08-18 21:55:55,425 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44579,DS-d1723429-6f74-4645-82a2-7456a058b2dc,DISK] 2023-08-18 21:55:55,425 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40419,DS-30907949-c0b9-4846-ad36-3b32c888dd70,DISK] 2023-08-18 21:55:55,427 INFO [Listener at localhost/43753] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/WALs/test.com,8080,1/test.com%2C8080%2C1.1692395755408 2023-08-18 21:55:55,430 DEBUG [Listener at localhost/43753] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44579,DS-d1723429-6f74-4645-82a2-7456a058b2dc,DISK], DatanodeInfoWithStorage[127.0.0.1:40419,DS-30907949-c0b9-4846-ad36-3b32c888dd70,DISK]] 2023-08-18 21:55:55,445 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40419,DS-30907949-c0b9-4846-ad36-3b32c888dd70,DISK] 2023-08-18 21:55:55,445 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44579,DS-d1723429-6f74-4645-82a2-7456a058b2dc,DISK] 2023-08-18 21:55:55,450 INFO [Listener at localhost/43753] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/WALs/test.com,8080,1/test.com%2C8080%2C1.1692395755408 with entries=0, filesize=83 B; new WAL /user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/WALs/test.com,8080,1/test.com%2C8080%2C1.1692395755430 2023-08-18 21:55:55,450 DEBUG [Listener at localhost/43753] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40419,DS-30907949-c0b9-4846-ad36-3b32c888dd70,DISK], DatanodeInfoWithStorage[127.0.0.1:44579,DS-d1723429-6f74-4645-82a2-7456a058b2dc,DISK]] 2023-08-18 21:55:55,450 DEBUG [Listener at localhost/43753] wal.AbstractFSWAL(716): hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/WALs/test.com,8080,1/test.com%2C8080%2C1.1692395755408 is not closed yet, will try archiving it next time 2023-08-18 21:55:55,456 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/WALs/test.com,8080,1/test.com%2C8080%2C1.1692395755408 to hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/oldWALs/test.com%2C8080%2C1.1692395755408 2023-08-18 21:55:55,459 DEBUG [Listener at localhost/43753] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/oldWALs 2023-08-18 21:55:55,459 INFO [Listener at localhost/43753] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL test.com%2C8080%2C1:(num 1692395755430) 2023-08-18 21:55:55,459 INFO [Listener at localhost/43753] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-18 21:55:55,459 DEBUG [Listener at localhost/43753] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ad1bb07 to 127.0.0.1:59322 2023-08-18 21:55:55,459 DEBUG [Listener at localhost/43753] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:55:55,460 DEBUG [Listener at localhost/43753] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-18 21:55:55,460 DEBUG [Listener at localhost/43753] util.JVMClusterUtil(257): Found active master hash=850429270, stopped=false 2023-08-18 21:55:55,461 INFO [Listener at localhost/43753] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,34521,1692395754225 2023-08-18 21:55:55,462 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-18 21:55:55,462 INFO [Listener at localhost/43753] procedure2.ProcedureExecutor(629): Stopping 2023-08-18 21:55:55,462 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:55:55,462 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): regionserver:36781-0x1000ce8a4020001, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-18 21:55:55,463 DEBUG [Listener at localhost/43753] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7023bd41 to 127.0.0.1:59322 2023-08-18 21:55:55,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36781-0x1000ce8a4020001, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:55:55,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-18 21:55:55,464 DEBUG [Listener at localhost/43753] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:55:55,464 INFO [Listener at localhost/43753] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,36781,1692395754260' ***** 2023-08-18 21:55:55,464 INFO [Listener at localhost/43753] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-18 21:55:55,466 INFO [RS:0;jenkins-hbase20:36781] regionserver.HeapMemoryManager(220): Stopping 2023-08-18 21:55:55,466 INFO [RS:0;jenkins-hbase20:36781] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-18 21:55:55,466 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-18 21:55:55,466 INFO [RS:0;jenkins-hbase20:36781] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-18 21:55:55,467 INFO [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(3305): Received CLOSE for f216e55818e43f9d19702e7682762638 2023-08-18 21:55:55,470 INFO [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,36781,1692395754260 2023-08-18 21:55:55,470 DEBUG [RS:0;jenkins-hbase20:36781] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60f06075 to 127.0.0.1:59322 2023-08-18 21:55:55,471 DEBUG [RS:0;jenkins-hbase20:36781] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:55:55,471 INFO [RS:0;jenkins-hbase20:36781] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-18 21:55:55,471 INFO [RS:0;jenkins-hbase20:36781] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-18 21:55:55,471 INFO [RS:0;jenkins-hbase20:36781] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-18 21:55:55,471 INFO [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-18 21:55:55,471 INFO [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-08-18 21:55:55,471 DEBUG [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(1478): Online Regions={f216e55818e43f9d19702e7682762638=hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638., 1588230740=hbase:meta,,1.1588230740} 2023-08-18 21:55:55,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f216e55818e43f9d19702e7682762638, disabling compactions & flushes 2023-08-18 21:55:55,472 DEBUG [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(1504): Waiting on 1588230740, f216e55818e43f9d19702e7682762638 2023-08-18 21:55:55,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638. 2023-08-18 21:55:55,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638. 2023-08-18 21:55:55,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638. after waiting 0 ms 2023-08-18 21:55:55,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638. 2023-08-18 21:55:55,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing f216e55818e43f9d19702e7682762638 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-18 21:55:55,473 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-18 21:55:55,473 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-18 21:55:55,473 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-18 21:55:55,473 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-18 21:55:55,473 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-18 21:55:55,474 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=1.26 KB heapSize=2.89 KB 2023-08-18 21:55:55,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/namespace/f216e55818e43f9d19702e7682762638/.tmp/info/67eeabca68594286ac04ad9ea6d52486 2023-08-18 21:55:55,489 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.17 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/.tmp/info/3820e9bbaef94779a5bfb22d8b0bfe02 2023-08-18 21:55:55,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/namespace/f216e55818e43f9d19702e7682762638/.tmp/info/67eeabca68594286ac04ad9ea6d52486 as hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/namespace/f216e55818e43f9d19702e7682762638/info/67eeabca68594286ac04ad9ea6d52486 2023-08-18 21:55:55,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/namespace/f216e55818e43f9d19702e7682762638/info/67eeabca68594286ac04ad9ea6d52486, entries=2, sequenceid=6, filesize=4.8 K 2023-08-18 21:55:55,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f216e55818e43f9d19702e7682762638 in 34ms, sequenceid=6, compaction requested=false 2023-08-18 21:55:55,514 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=94 B at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/.tmp/table/b90015130dd14cf9b7fcd4f3bb384b68 2023-08-18 21:55:55,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/namespace/f216e55818e43f9d19702e7682762638/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-18 21:55:55,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638. 2023-08-18 21:55:55,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f216e55818e43f9d19702e7682762638: 2023-08-18 21:55:55,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1692395754830.f216e55818e43f9d19702e7682762638. 2023-08-18 21:55:55,520 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/.tmp/info/3820e9bbaef94779a5bfb22d8b0bfe02 as hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/info/3820e9bbaef94779a5bfb22d8b0bfe02 2023-08-18 21:55:55,526 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/info/3820e9bbaef94779a5bfb22d8b0bfe02, entries=10, sequenceid=9, filesize=5.9 K 2023-08-18 21:55:55,527 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/.tmp/table/b90015130dd14cf9b7fcd4f3bb384b68 as hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/table/b90015130dd14cf9b7fcd4f3bb384b68 2023-08-18 21:55:55,533 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/table/b90015130dd14cf9b7fcd4f3bb384b68, entries=2, sequenceid=9, filesize=4.7 K 2023-08-18 21:55:55,534 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.26 KB/1292, heapSize ~2.61 KB/2672, currentSize=0 B/0 for 1588230740 in 61ms, sequenceid=9, compaction requested=false 2023-08-18 21:55:55,546 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/data/hbase/meta/1588230740/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-08-18 21:55:55,546 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-18 21:55:55,546 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-18 21:55:55,546 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-18 21:55:55,546 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-18 21:55:55,549 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-08-18 21:55:55,549 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-08-18 21:55:55,672 INFO [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,36781,1692395754260; all regions closed. 2023-08-18 21:55:55,681 DEBUG [RS:0;jenkins-hbase20:36781] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/oldWALs 2023-08-18 21:55:55,682 INFO [RS:0;jenkins-hbase20:36781] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C36781%2C1692395754260.meta:.meta(num 1692395754756) 2023-08-18 21:55:55,687 DEBUG [RS:0;jenkins-hbase20:36781] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/oldWALs 2023-08-18 21:55:55,687 INFO [RS:0;jenkins-hbase20:36781] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C36781%2C1692395754260:(num 1692395754667) 2023-08-18 21:55:55,687 DEBUG [RS:0;jenkins-hbase20:36781] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:55:55,687 INFO [RS:0;jenkins-hbase20:36781] regionserver.LeaseManager(133): Closed leases 2023-08-18 21:55:55,687 INFO [RS:0;jenkins-hbase20:36781] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-08-18 21:55:55,688 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-18 21:55:55,688 INFO [RS:0;jenkins-hbase20:36781] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:36781 2023-08-18 21:55:55,691 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): regionserver:36781-0x1000ce8a4020001, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,36781,1692395754260 2023-08-18 21:55:55,691 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): regionserver:36781-0x1000ce8a4020001, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-18 21:55:55,691 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-18 21:55:55,692 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,36781,1692395754260] 2023-08-18 21:55:55,692 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,36781,1692395754260; numProcessing=1 2023-08-18 21:55:55,693 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,36781,1692395754260 already deleted, retry=false 2023-08-18 21:55:55,693 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,36781,1692395754260 expired; onlineServers=0 2023-08-18 21:55:55,693 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,34521,1692395754225' ***** 2023-08-18 21:55:55,693 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-18 21:55:55,694 DEBUG [M:0;jenkins-hbase20:34521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@368f17d8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-08-18 21:55:55,694 INFO [M:0;jenkins-hbase20:34521] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,34521,1692395754225 2023-08-18 21:55:55,694 INFO [M:0;jenkins-hbase20:34521] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,34521,1692395754225; all regions closed. 2023-08-18 21:55:55,694 DEBUG [M:0;jenkins-hbase20:34521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-18 21:55:55,694 DEBUG [M:0;jenkins-hbase20:34521] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-18 21:55:55,694 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-18 21:55:55,694 DEBUG [M:0;jenkins-hbase20:34521] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-18 21:55:55,694 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1692395754400] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1692395754400,5,FailOnTimeoutGroup] 2023-08-18 21:55:55,694 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1692395754400] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1692395754400,5,FailOnTimeoutGroup] 2023-08-18 21:55:55,694 INFO [M:0;jenkins-hbase20:34521] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-18 21:55:55,696 INFO [M:0;jenkins-hbase20:34521] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-18 21:55:55,697 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-18 21:55:55,697 INFO [M:0;jenkins-hbase20:34521] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-08-18 21:55:55,697 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-18 21:55:55,697 DEBUG [M:0;jenkins-hbase20:34521] master.HMaster(1512): Stopping service threads 2023-08-18 21:55:55,697 INFO [M:0;jenkins-hbase20:34521] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-18 21:55:55,697 ERROR [M:0;jenkins-hbase20:34521] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-7,5,PEWorkerGroup] 2023-08-18 21:55:55,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-18 21:55:55,697 INFO [M:0;jenkins-hbase20:34521] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-18 21:55:55,698 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-18 21:55:55,698 DEBUG [M:0;jenkins-hbase20:34521] zookeeper.ZKUtil(398): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-18 21:55:55,698 WARN [M:0;jenkins-hbase20:34521] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-18 21:55:55,698 INFO [M:0;jenkins-hbase20:34521] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-18 21:55:55,698 INFO [M:0;jenkins-hbase20:34521] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-18 21:55:55,699 DEBUG [M:0;jenkins-hbase20:34521] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-18 21:55:55,699 INFO [M:0;jenkins-hbase20:34521] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:55:55,699 DEBUG [M:0;jenkins-hbase20:34521] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:55:55,699 DEBUG [M:0;jenkins-hbase20:34521] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-18 21:55:55,699 DEBUG [M:0;jenkins-hbase20:34521] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:55:55,699 INFO [M:0;jenkins-hbase20:34521] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=24.09 KB heapSize=29.59 KB 2023-08-18 21:55:55,713 INFO [M:0;jenkins-hbase20:34521] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24.09 KB at sequenceid=66 (bloomFilter=true), to=hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b66740945ee541b0bac455fead23210a 2023-08-18 21:55:55,718 DEBUG [M:0;jenkins-hbase20:34521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b66740945ee541b0bac455fead23210a as hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b66740945ee541b0bac455fead23210a 2023-08-18 21:55:55,723 INFO [M:0;jenkins-hbase20:34521] regionserver.HStore(1080): Added hdfs://localhost:42243/user/jenkins/test-data/7505c2d6-cd2b-177a-9701-5dea4ef1b1ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b66740945ee541b0bac455fead23210a, entries=8, sequenceid=66, filesize=6.3 K 2023-08-18 21:55:55,724 INFO [M:0;jenkins-hbase20:34521] regionserver.HRegion(2948): Finished flush of dataSize ~24.09 KB/24669, heapSize ~29.57 KB/30280, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=66, compaction requested=false 2023-08-18 21:55:55,726 INFO [M:0;jenkins-hbase20:34521] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-18 21:55:55,726 DEBUG [M:0;jenkins-hbase20:34521] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-18 21:55:55,732 INFO [M:0;jenkins-hbase20:34521] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-18 21:55:55,732 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-18 21:55:55,733 INFO [M:0;jenkins-hbase20:34521] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34521 2023-08-18 21:55:55,735 DEBUG [M:0;jenkins-hbase20:34521] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,34521,1692395754225 already deleted, retry=false 2023-08-18 21:55:55,863 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:55:55,863 INFO [M:0;jenkins-hbase20:34521] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,34521,1692395754225; zookeeper connection closed. 2023-08-18 21:55:55,863 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): master:34521-0x1000ce8a4020000, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:55:55,964 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): regionserver:36781-0x1000ce8a4020001, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:55:55,964 INFO [RS:0;jenkins-hbase20:36781] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,36781,1692395754260; zookeeper connection closed. 2023-08-18 21:55:55,964 DEBUG [Listener at localhost/43753-EventThread] zookeeper.ZKWatcher(600): regionserver:36781-0x1000ce8a4020001, quorum=127.0.0.1:59322, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-18 21:55:55,965 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@545f6b81] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@545f6b81 2023-08-18 21:55:55,965 INFO [Listener at localhost/43753] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-18 21:55:55,965 WARN [Listener at localhost/43753] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-18 21:55:55,968 INFO [Listener at localhost/43753] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:55:56,072 WARN [BP-1745156628-148.251.75.209-1692395753684 heartbeating to localhost/127.0.0.1:42243] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-18 21:55:56,072 WARN [BP-1745156628-148.251.75.209-1692395753684 heartbeating to localhost/127.0.0.1:42243] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1745156628-148.251.75.209-1692395753684 (Datanode Uuid d2d9faad-0efc-4f67-91ee-5cb29d6be581) service to localhost/127.0.0.1:42243 2023-08-18 21:55:56,073 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/cluster_c13a358c-eebb-5ab4-9c88-5baa03cbe20e/dfs/data/data3/current/BP-1745156628-148.251.75.209-1692395753684] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:55:56,073 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/cluster_c13a358c-eebb-5ab4-9c88-5baa03cbe20e/dfs/data/data4/current/BP-1745156628-148.251.75.209-1692395753684] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:55:56,074 WARN [Listener at localhost/43753] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-18 21:55:56,084 INFO [Listener at localhost/43753] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:55:56,187 WARN [BP-1745156628-148.251.75.209-1692395753684 heartbeating to localhost/127.0.0.1:42243] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-18 21:55:56,187 WARN [BP-1745156628-148.251.75.209-1692395753684 heartbeating to localhost/127.0.0.1:42243] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1745156628-148.251.75.209-1692395753684 (Datanode Uuid ca8e2606-b8cf-44f3-a0d4-257cabf9afcc) service to localhost/127.0.0.1:42243 2023-08-18 21:55:56,188 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/cluster_c13a358c-eebb-5ab4-9c88-5baa03cbe20e/dfs/data/data1/current/BP-1745156628-148.251.75.209-1692395753684] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:55:56,188 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b31d725-cb22-1b31-10d8-ce1eff47d453/cluster_c13a358c-eebb-5ab4-9c88-5baa03cbe20e/dfs/data/data2/current/BP-1745156628-148.251.75.209-1692395753684] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-18 21:55:56,207 INFO [Listener at localhost/43753] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-18 21:55:56,316 INFO [Listener at localhost/43753] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-18 21:55:56,327 INFO [Listener at localhost/43753] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-18 21:55:56,336 INFO [Listener at localhost/43753] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=100 (was 77) - Thread LEAK? -, OpenFileDescriptor=485 (was 466) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=163 (was 151) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=2349 (was 2369)