2023-07-29 00:52:57,664 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06 2023-07-29 00:52:57,682 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRolling timeout: 13 mins 2023-07-29 00:52:57,722 INFO [Time-limited test] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=401, ProcessCount=171, AvailableMemoryMB=11177 2023-07-29 00:52:57,729 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-29 00:52:57,729 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594, deleteOnExit=true 2023-07-29 00:52:57,730 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-29 00:52:57,730 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/test.cache.data in system properties and HBase conf 2023-07-29 00:52:57,731 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/hadoop.tmp.dir in system properties and HBase conf 2023-07-29 00:52:57,731 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/hadoop.log.dir in system properties and HBase conf 2023-07-29 00:52:57,732 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-29 00:52:57,732 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-29 00:52:57,733 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-29 00:52:57,875 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-29 00:52:58,320 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-29 00:52:58,325 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-29 00:52:58,326 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-29 00:52:58,326 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-29 00:52:58,327 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-29 00:52:58,327 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-29 00:52:58,328 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-29 00:52:58,328 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-29 00:52:58,328 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-29 00:52:58,329 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-29 00:52:58,329 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/nfs.dump.dir in system properties and HBase conf 2023-07-29 00:52:58,330 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/java.io.tmpdir in system properties and HBase conf 2023-07-29 00:52:58,330 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-29 00:52:58,330 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-29 00:52:58,331 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-29 00:52:58,927 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-29 00:52:58,930 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-29 00:52:59,219 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-29 00:52:59,394 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-29 00:52:59,412 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:52:59,454 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:52:59,487 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/java.io.tmpdir/Jetty_localhost_localdomain_41501_hdfs____bvakhf/webapp 2023-07-29 00:52:59,634 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:41501 2023-07-29 00:52:59,642 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-29 00:52:59,643 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-29 00:52:59,963 WARN [Listener at localhost.localdomain/40329] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:53:00,062 WARN [Listener at localhost.localdomain/40329] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-29 00:53:00,082 WARN [Listener at localhost.localdomain/40329] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:53:00,089 INFO [Listener at localhost.localdomain/40329] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:53:00,094 INFO [Listener at localhost.localdomain/40329] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/java.io.tmpdir/Jetty_localhost_44747_datanode____fg7a01/webapp 2023-07-29 00:53:00,170 INFO [Listener at localhost.localdomain/40329] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44747 2023-07-29 00:53:00,444 WARN [Listener at localhost.localdomain/36631] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:53:00,451 WARN [Listener at localhost.localdomain/36631] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-29 00:53:00,454 WARN [Listener at localhost.localdomain/36631] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:53:00,456 INFO [Listener at localhost.localdomain/36631] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:53:00,460 INFO [Listener at localhost.localdomain/36631] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/java.io.tmpdir/Jetty_localhost_37145_datanode____.u35eob/webapp 2023-07-29 00:53:00,536 INFO [Listener at localhost.localdomain/36631] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37145 2023-07-29 00:53:00,546 WARN [Listener at localhost.localdomain/32977] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:53:00,788 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6943b8f5d98b40ca: Processing first storage report for DS-7531ffdc-2f3b-44f8-81cc-2f75ebc39d63 from datanode b2ead6fb-7259-440d-8f89-7e040174ecfb 2023-07-29 00:53:00,789 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6943b8f5d98b40ca: from storage DS-7531ffdc-2f3b-44f8-81cc-2f75ebc39d63 node DatanodeRegistration(127.0.0.1:41195, datanodeUuid=b2ead6fb-7259-440d-8f89-7e040174ecfb, infoPort=33001, infoSecurePort=0, ipcPort=32977, storageInfo=lv=-57;cid=testClusterID;nsid=1840597430;c=1690591979000), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-29 00:53:00,789 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x37366b336b5a6c27: Processing first storage report for DS-bd19aa1b-1eea-413a-84ce-92ae500f69e0 from datanode 13af7f10-f731-4389-8c7d-56a350d44681 2023-07-29 00:53:00,789 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x37366b336b5a6c27: from storage DS-bd19aa1b-1eea-413a-84ce-92ae500f69e0 node DatanodeRegistration(127.0.0.1:39307, datanodeUuid=13af7f10-f731-4389-8c7d-56a350d44681, infoPort=38787, infoSecurePort=0, ipcPort=36631, storageInfo=lv=-57;cid=testClusterID;nsid=1840597430;c=1690591979000), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:53:00,789 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6943b8f5d98b40ca: Processing first storage report for DS-b29f1f6a-771e-46d5-95c3-6a69904da8f9 from datanode b2ead6fb-7259-440d-8f89-7e040174ecfb 2023-07-29 00:53:00,789 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6943b8f5d98b40ca: from storage DS-b29f1f6a-771e-46d5-95c3-6a69904da8f9 node DatanodeRegistration(127.0.0.1:41195, datanodeUuid=b2ead6fb-7259-440d-8f89-7e040174ecfb, infoPort=33001, infoSecurePort=0, ipcPort=32977, storageInfo=lv=-57;cid=testClusterID;nsid=1840597430;c=1690591979000), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:53:00,790 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x37366b336b5a6c27: Processing first storage report for DS-078a8834-f509-42d0-9fc7-5df2e4f152ee from datanode 13af7f10-f731-4389-8c7d-56a350d44681 2023-07-29 00:53:00,790 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x37366b336b5a6c27: from storage DS-078a8834-f509-42d0-9fc7-5df2e4f152ee node DatanodeRegistration(127.0.0.1:39307, datanodeUuid=13af7f10-f731-4389-8c7d-56a350d44681, infoPort=38787, infoSecurePort=0, ipcPort=36631, storageInfo=lv=-57;cid=testClusterID;nsid=1840597430;c=1690591979000), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:53:00,920 DEBUG [Listener at localhost.localdomain/32977] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06 2023-07-29 00:53:00,975 INFO [Listener at localhost.localdomain/32977] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594/zookeeper_0, clientPort=52662, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-29 00:53:00,994 INFO [Listener at localhost.localdomain/32977] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52662 2023-07-29 00:53:01,005 INFO [Listener at localhost.localdomain/32977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:01,008 INFO [Listener at localhost.localdomain/32977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:01,647 INFO [Listener at localhost.localdomain/32977] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9 with version=8 2023-07-29 00:53:01,647 INFO [Listener at localhost.localdomain/32977] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/hbase-staging 2023-07-29 00:53:01,887 INFO [Listener at localhost.localdomain/32977] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-29 00:53:02,274 INFO [Listener at localhost.localdomain/32977] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-07-29 00:53:02,313 INFO [Listener at localhost.localdomain/32977] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:53:02,313 INFO [Listener at localhost.localdomain/32977] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-29 00:53:02,314 INFO [Listener at localhost.localdomain/32977] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-29 00:53:02,314 INFO [Listener at localhost.localdomain/32977] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:53:02,314 INFO [Listener at localhost.localdomain/32977] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-29 00:53:02,478 INFO [Listener at localhost.localdomain/32977] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-29 00:53:02,551 DEBUG [Listener at localhost.localdomain/32977] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-29 00:53:02,654 INFO [Listener at localhost.localdomain/32977] ipc.NettyRpcServer(120): Bind to /136.243.18.41:35365 2023-07-29 00:53:02,666 INFO [Listener at localhost.localdomain/32977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:02,670 INFO [Listener at localhost.localdomain/32977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:02,695 INFO [Listener at localhost.localdomain/32977] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35365 connecting to ZooKeeper ensemble=127.0.0.1:52662 2023-07-29 00:53:02,741 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:353650x0, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-29 00:53:02,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35365-0x101ae8fe8c00000 connected 2023-07-29 00:53:02,773 DEBUG [Listener at localhost.localdomain/32977] zookeeper.ZKUtil(164): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-29 00:53:02,774 DEBUG [Listener at localhost.localdomain/32977] zookeeper.ZKUtil(164): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:53:02,777 DEBUG [Listener at localhost.localdomain/32977] zookeeper.ZKUtil(164): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-29 00:53:02,784 DEBUG [Listener at localhost.localdomain/32977] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35365 2023-07-29 00:53:02,784 DEBUG [Listener at localhost.localdomain/32977] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35365 2023-07-29 00:53:02,785 DEBUG [Listener at localhost.localdomain/32977] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35365 2023-07-29 00:53:02,785 DEBUG [Listener at localhost.localdomain/32977] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35365 2023-07-29 00:53:02,785 DEBUG [Listener at localhost.localdomain/32977] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35365 2023-07-29 00:53:02,792 INFO [Listener at localhost.localdomain/32977] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9, hbase.cluster.distributed=false 2023-07-29 00:53:02,852 INFO [Listener at localhost.localdomain/32977] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-29 00:53:02,852 INFO [Listener at localhost.localdomain/32977] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:53:02,853 INFO [Listener at localhost.localdomain/32977] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-29 00:53:02,853 INFO [Listener at localhost.localdomain/32977] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-29 00:53:02,853 INFO [Listener at localhost.localdomain/32977] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:53:02,853 INFO [Listener at localhost.localdomain/32977] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-29 00:53:02,857 INFO [Listener at localhost.localdomain/32977] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-29 00:53:02,860 INFO [Listener at localhost.localdomain/32977] ipc.NettyRpcServer(120): Bind to /136.243.18.41:39077 2023-07-29 00:53:02,862 INFO [Listener at localhost.localdomain/32977] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-29 00:53:02,867 DEBUG [Listener at localhost.localdomain/32977] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-29 00:53:02,868 INFO [Listener at localhost.localdomain/32977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:02,870 INFO [Listener at localhost.localdomain/32977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:02,872 INFO [Listener at localhost.localdomain/32977] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39077 connecting to ZooKeeper ensemble=127.0.0.1:52662 2023-07-29 00:53:02,875 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): regionserver:390770x0, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-29 00:53:02,876 DEBUG [Listener at localhost.localdomain/32977] zookeeper.ZKUtil(164): regionserver:390770x0, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-29 00:53:02,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39077-0x101ae8fe8c00001 connected 2023-07-29 00:53:02,878 DEBUG [Listener at localhost.localdomain/32977] zookeeper.ZKUtil(164): regionserver:39077-0x101ae8fe8c00001, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:53:02,879 DEBUG [Listener at localhost.localdomain/32977] zookeeper.ZKUtil(164): regionserver:39077-0x101ae8fe8c00001, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-29 00:53:02,879 DEBUG [Listener at localhost.localdomain/32977] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39077 2023-07-29 00:53:02,880 DEBUG [Listener at localhost.localdomain/32977] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39077 2023-07-29 00:53:02,880 DEBUG [Listener at localhost.localdomain/32977] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39077 2023-07-29 00:53:02,881 DEBUG [Listener at localhost.localdomain/32977] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39077 2023-07-29 00:53:02,881 DEBUG [Listener at localhost.localdomain/32977] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39077 2023-07-29 00:53:02,883 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,35365,1690591981754 2023-07-29 00:53:02,891 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-29 00:53:02,892 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,35365,1690591981754 2023-07-29 00:53:02,908 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-29 00:53:02,908 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): regionserver:39077-0x101ae8fe8c00001, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-29 00:53:02,908 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:02,909 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-29 00:53:02,910 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,35365,1690591981754 from backup master directory 2023-07-29 00:53:02,910 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-29 00:53:02,913 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,35365,1690591981754 2023-07-29 00:53:02,913 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-29 00:53:02,914 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-29 00:53:02,914 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,35365,1690591981754 2023-07-29 00:53:02,918 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-29 00:53:02,919 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-29 00:53:03,003 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/hbase.id with ID: 93d87c29-87e0-4e5d-b584-394fd787fc88 2023-07-29 00:53:03,049 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:03,064 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:03,105 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x631b2437 to 127.0.0.1:52662 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-29 00:53:03,133 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e380915, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-29 00:53:03,151 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-29 00:53:03,153 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-29 00:53:03,160 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-29 00:53:03,188 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/data/master/store-tmp 2023-07-29 00:53:03,217 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:03,218 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-29 00:53:03,218 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:53:03,218 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:53:03,218 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-29 00:53:03,218 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:53:03,218 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:53:03,218 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-29 00:53:03,220 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/WALs/jenkins-hbase17.apache.org,35365,1690591981754 2023-07-29 00:53:03,242 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C35365%2C1690591981754, suffix=, logDir=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/WALs/jenkins-hbase17.apache.org,35365,1690591981754, archiveDir=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/oldWALs, maxLogs=10 2023-07-29 00:53:03,269 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-29 00:53:03,269 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-29 00:53:03,271 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:53) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:190) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:116) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:719) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:128) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:881) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:574) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.init(AbstractFSWAL.java:515) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:160) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:295) at org.apache.hadoop.hbase.master.region.MasterRegion.createWAL(MasterRegion.java:200) at org.apache.hadoop.hbase.master.region.MasterRegion.bootstrap(MasterRegion.java:220) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:348) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:03,299 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:417) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:03,300 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39307,DS-bd19aa1b-1eea-413a-84ce-92ae500f69e0,DISK] 2023-07-29 00:53:03,300 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41195,DS-7531ffdc-2f3b-44f8-81cc-2f75ebc39d63,DISK] 2023-07-29 00:53:03,306 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:03,361 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/WALs/jenkins-hbase17.apache.org,35365,1690591981754/jenkins-hbase17.apache.org%2C35365%2C1690591981754.1690591983251 2023-07-29 00:53:03,362 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39307,DS-bd19aa1b-1eea-413a-84ce-92ae500f69e0,DISK], DatanodeInfoWithStorage[127.0.0.1:41195,DS-7531ffdc-2f3b-44f8-81cc-2f75ebc39d63,DISK]] 2023-07-29 00:53:03,363 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-29 00:53:03,363 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:03,366 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:53:03,367 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:53:03,416 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:53:03,422 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-29 00:53:03,441 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-29 00:53:03,451 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:03,456 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:53:03,458 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:53:03,471 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:53:03,475 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-29 00:53:03,475 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=742871, jitterRate=-0.05539123713970184}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-29 00:53:03,476 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-29 00:53:03,477 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-29 00:53:03,493 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-29 00:53:03,493 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-29 00:53:03,495 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-29 00:53:03,496 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-29 00:53:03,521 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 24 msec 2023-07-29 00:53:03,521 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-29 00:53:03,542 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-29 00:53:03,546 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-29 00:53:03,566 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-29 00:53:03,568 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-29 00:53:03,571 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-29 00:53:03,575 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-29 00:53:03,578 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-29 00:53:03,581 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:03,582 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-29 00:53:03,582 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-29 00:53:03,593 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-29 00:53:03,596 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-29 00:53:03,596 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): regionserver:39077-0x101ae8fe8c00001, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-29 00:53:03,596 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:03,597 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,35365,1690591981754, sessionid=0x101ae8fe8c00000, setting cluster-up flag (Was=false) 2023-07-29 00:53:03,608 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:03,612 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-29 00:53:03,613 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,35365,1690591981754 2023-07-29 00:53:03,616 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:03,619 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-29 00:53:03,620 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,35365,1690591981754 2023-07-29 00:53:03,623 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/.hbase-snapshot/.tmp 2023-07-29 00:53:03,686 INFO [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(951): ClusterId : 93d87c29-87e0-4e5d-b584-394fd787fc88 2023-07-29 00:53:03,690 DEBUG [RS:0;jenkins-hbase17:39077] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-29 00:53:03,695 DEBUG [RS:0;jenkins-hbase17:39077] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-29 00:53:03,695 DEBUG [RS:0;jenkins-hbase17:39077] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-29 00:53:03,697 DEBUG [RS:0;jenkins-hbase17:39077] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-29 00:53:03,698 DEBUG [RS:0;jenkins-hbase17:39077] zookeeper.ReadOnlyZKClient(139): Connect 0x778d56e1 to 127.0.0.1:52662 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-29 00:53:03,703 DEBUG [RS:0;jenkins-hbase17:39077] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@794aa660, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-29 00:53:03,704 DEBUG [RS:0;jenkins-hbase17:39077] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d753d91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-29 00:53:03,723 DEBUG [RS:0;jenkins-hbase17:39077] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:39077 2023-07-29 00:53:03,727 INFO [RS:0;jenkins-hbase17:39077] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-29 00:53:03,727 INFO [RS:0;jenkins-hbase17:39077] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-29 00:53:03,727 DEBUG [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(1022): About to register with Master. 2023-07-29 00:53:03,730 INFO [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,35365,1690591981754 with isa=jenkins-hbase17.apache.org/136.243.18.41:39077, startcode=1690591982851 2023-07-29 00:53:03,731 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-29 00:53:03,740 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:53:03,740 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:53:03,740 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:53:03,741 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:53:03,741 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-07-29 00:53:03,741 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:03,741 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-29 00:53:03,741 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:03,742 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690592013742 2023-07-29 00:53:03,744 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-29 00:53:03,746 DEBUG [RS:0;jenkins-hbase17:39077] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-29 00:53:03,749 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-29 00:53:03,750 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-29 00:53:03,755 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-29 00:53:03,755 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-29 00:53:03,761 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-29 00:53:03,762 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-29 00:53:03,762 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-29 00:53:03,762 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-29 00:53:03,764 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:03,769 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-29 00:53:03,770 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-29 00:53:03,771 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-29 00:53:03,775 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-29 00:53:03,776 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-29 00:53:03,777 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690591983777,5,FailOnTimeoutGroup] 2023-07-29 00:53:03,777 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690591983777,5,FailOnTimeoutGroup] 2023-07-29 00:53:03,777 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:03,778 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-29 00:53:03,780 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:03,780 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:03,794 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-29 00:53:03,795 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-29 00:53:03,796 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9 2023-07-29 00:53:03,810 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36621, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-29 00:53:03,816 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:03,822 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-29 00:53:03,825 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35365] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,39077,1690591982851 2023-07-29 00:53:03,825 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/info 2023-07-29 00:53:03,826 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-29 00:53:03,828 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:03,828 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-29 00:53:03,831 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/rep_barrier 2023-07-29 00:53:03,832 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-29 00:53:03,833 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:03,833 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-29 00:53:03,836 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/table 2023-07-29 00:53:03,837 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-29 00:53:03,838 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:03,840 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740 2023-07-29 00:53:03,841 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740 2023-07-29 00:53:03,844 DEBUG [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9 2023-07-29 00:53:03,844 DEBUG [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40329 2023-07-29 00:53:03,844 DEBUG [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-29 00:53:03,845 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-29 00:53:03,847 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-29 00:53:03,848 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-29 00:53:03,849 DEBUG [RS:0;jenkins-hbase17:39077] zookeeper.ZKUtil(162): regionserver:39077-0x101ae8fe8c00001, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,39077,1690591982851 2023-07-29 00:53:03,849 WARN [RS:0;jenkins-hbase17:39077] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-29 00:53:03,850 INFO [RS:0;jenkins-hbase17:39077] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-29 00:53:03,850 DEBUG [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851 2023-07-29 00:53:03,852 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,39077,1690591982851] 2023-07-29 00:53:03,853 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-29 00:53:03,855 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=852531, jitterRate=0.08404989540576935}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-29 00:53:03,855 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-29 00:53:03,855 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-29 00:53:03,855 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-29 00:53:03,855 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-29 00:53:03,855 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-29 00:53:03,855 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-29 00:53:03,857 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-29 00:53:03,857 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-29 00:53:03,861 DEBUG [RS:0;jenkins-hbase17:39077] zookeeper.ZKUtil(162): regionserver:39077-0x101ae8fe8c00001, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,39077,1690591982851 2023-07-29 00:53:03,862 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-29 00:53:03,863 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-29 00:53:03,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-29 00:53:03,871 DEBUG [RS:0;jenkins-hbase17:39077] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-29 00:53:03,878 INFO [RS:0;jenkins-hbase17:39077] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-29 00:53:03,881 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-29 00:53:03,884 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-29 00:53:03,898 INFO [RS:0;jenkins-hbase17:39077] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-29 00:53:03,900 INFO [RS:0;jenkins-hbase17:39077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-29 00:53:03,900 INFO [RS:0;jenkins-hbase17:39077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:03,901 INFO [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-29 00:53:03,907 INFO [RS:0;jenkins-hbase17:39077] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:03,908 DEBUG [RS:0;jenkins-hbase17:39077] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:03,908 DEBUG [RS:0;jenkins-hbase17:39077] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:03,908 DEBUG [RS:0;jenkins-hbase17:39077] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:03,908 DEBUG [RS:0;jenkins-hbase17:39077] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:03,909 DEBUG [RS:0;jenkins-hbase17:39077] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:03,909 DEBUG [RS:0;jenkins-hbase17:39077] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-29 00:53:03,909 DEBUG [RS:0;jenkins-hbase17:39077] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:03,909 DEBUG [RS:0;jenkins-hbase17:39077] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:03,909 DEBUG [RS:0;jenkins-hbase17:39077] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:03,909 DEBUG [RS:0;jenkins-hbase17:39077] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:03,910 INFO [RS:0;jenkins-hbase17:39077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:03,910 INFO [RS:0;jenkins-hbase17:39077] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:03,910 INFO [RS:0;jenkins-hbase17:39077] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:03,923 INFO [RS:0;jenkins-hbase17:39077] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-29 00:53:03,925 INFO [RS:0;jenkins-hbase17:39077] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,39077,1690591982851-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:03,937 INFO [RS:0;jenkins-hbase17:39077] regionserver.Replication(203): jenkins-hbase17.apache.org,39077,1690591982851 started 2023-07-29 00:53:03,937 INFO [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,39077,1690591982851, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:39077, sessionid=0x101ae8fe8c00001 2023-07-29 00:53:03,938 DEBUG [RS:0;jenkins-hbase17:39077] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-29 00:53:03,938 DEBUG [RS:0;jenkins-hbase17:39077] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,39077,1690591982851 2023-07-29 00:53:03,938 DEBUG [RS:0;jenkins-hbase17:39077] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,39077,1690591982851' 2023-07-29 00:53:03,938 DEBUG [RS:0;jenkins-hbase17:39077] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-29 00:53:03,939 DEBUG [RS:0;jenkins-hbase17:39077] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-29 00:53:03,939 DEBUG [RS:0;jenkins-hbase17:39077] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-29 00:53:03,939 DEBUG [RS:0;jenkins-hbase17:39077] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-29 00:53:03,939 DEBUG [RS:0;jenkins-hbase17:39077] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,39077,1690591982851 2023-07-29 00:53:03,939 DEBUG [RS:0;jenkins-hbase17:39077] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,39077,1690591982851' 2023-07-29 00:53:03,939 DEBUG [RS:0;jenkins-hbase17:39077] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-29 00:53:03,940 DEBUG [RS:0;jenkins-hbase17:39077] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-29 00:53:03,940 DEBUG [RS:0;jenkins-hbase17:39077] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-29 00:53:03,940 INFO [RS:0;jenkins-hbase17:39077] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-29 00:53:03,940 INFO [RS:0;jenkins-hbase17:39077] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-29 00:53:04,036 DEBUG [jenkins-hbase17:35365] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-29 00:53:04,041 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,39077,1690591982851, state=OPENING 2023-07-29 00:53:04,053 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-29 00:53:04,054 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:04,055 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-29 00:53:04,056 INFO [RS:0;jenkins-hbase17:39077] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C39077%2C1690591982851, suffix=, logDir=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851, archiveDir=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/oldWALs, maxLogs=32 2023-07-29 00:53:04,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,39077,1690591982851}] 2023-07-29 00:53:04,074 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39307,DS-bd19aa1b-1eea-413a-84ce-92ae500f69e0,DISK] 2023-07-29 00:53:04,074 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41195,DS-7531ffdc-2f3b-44f8-81cc-2f75ebc39d63,DISK] 2023-07-29 00:53:04,078 INFO [RS:0;jenkins-hbase17:39077] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.1690591984059 2023-07-29 00:53:04,079 DEBUG [RS:0;jenkins-hbase17:39077] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39307,DS-bd19aa1b-1eea-413a-84ce-92ae500f69e0,DISK], DatanodeInfoWithStorage[127.0.0.1:41195,DS-7531ffdc-2f3b-44f8-81cc-2f75ebc39d63,DISK]] 2023-07-29 00:53:04,245 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,39077,1690591982851 2023-07-29 00:53:04,246 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-29 00:53:04,249 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-29 00:53:04,263 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-29 00:53:04,263 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-29 00:53:04,267 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C39077%2C1690591982851.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851, archiveDir=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/oldWALs, maxLogs=32 2023-07-29 00:53:04,282 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39307,DS-bd19aa1b-1eea-413a-84ce-92ae500f69e0,DISK] 2023-07-29 00:53:04,282 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41195,DS-7531ffdc-2f3b-44f8-81cc-2f75ebc39d63,DISK] 2023-07-29 00:53:04,288 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.meta.1690591984268.meta 2023-07-29 00:53:04,289 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39307,DS-bd19aa1b-1eea-413a-84ce-92ae500f69e0,DISK], DatanodeInfoWithStorage[127.0.0.1:41195,DS-7531ffdc-2f3b-44f8-81cc-2f75ebc39d63,DISK]] 2023-07-29 00:53:04,290 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-29 00:53:04,291 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-29 00:53:04,307 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-29 00:53:04,311 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-29 00:53:04,315 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-29 00:53:04,316 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:04,316 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-29 00:53:04,316 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-29 00:53:04,319 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-29 00:53:04,320 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/info 2023-07-29 00:53:04,320 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/info 2023-07-29 00:53:04,321 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-29 00:53:04,322 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:04,322 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-29 00:53:04,323 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/rep_barrier 2023-07-29 00:53:04,323 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/rep_barrier 2023-07-29 00:53:04,324 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-29 00:53:04,325 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:04,325 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-29 00:53:04,326 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/table 2023-07-29 00:53:04,327 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/table 2023-07-29 00:53:04,327 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-29 00:53:04,328 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:04,330 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740 2023-07-29 00:53:04,332 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740 2023-07-29 00:53:04,336 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-29 00:53:04,339 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-29 00:53:04,340 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=762079, jitterRate=-0.030966728925704956}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-29 00:53:04,340 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-29 00:53:04,350 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690591984238 2023-07-29 00:53:04,366 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-29 00:53:04,367 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-29 00:53:04,368 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,39077,1690591982851, state=OPEN 2023-07-29 00:53:04,370 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-29 00:53:04,370 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-29 00:53:04,374 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-29 00:53:04,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,39077,1690591982851 in 311 msec 2023-07-29 00:53:04,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-29 00:53:04,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 505 msec 2023-07-29 00:53:04,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 714 msec 2023-07-29 00:53:04,386 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690591984386, completionTime=-1 2023-07-29 00:53:04,387 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-29 00:53:04,387 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-29 00:53:04,439 DEBUG [hconnection-0x9e92faf-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-29 00:53:04,442 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-29 00:53:04,457 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-29 00:53:04,457 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690592044457 2023-07-29 00:53:04,457 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690592104457 2023-07-29 00:53:04,457 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 70 msec 2023-07-29 00:53:04,477 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35365,1690591981754-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:04,477 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35365,1690591981754-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:04,478 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35365,1690591981754-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:04,479 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:35365, period=300000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:04,479 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:04,484 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-29 00:53:04,491 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-29 00:53:04,492 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-29 00:53:04,500 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-29 00:53:04,505 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-29 00:53:04,508 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-29 00:53:04,528 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/.tmp/data/hbase/namespace/52082d66600e4b7ba7b53336abd9a32c 2023-07-29 00:53:04,531 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/.tmp/data/hbase/namespace/52082d66600e4b7ba7b53336abd9a32c empty. 2023-07-29 00:53:04,531 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/.tmp/data/hbase/namespace/52082d66600e4b7ba7b53336abd9a32c 2023-07-29 00:53:04,531 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-29 00:53:04,555 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-29 00:53:04,557 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 52082d66600e4b7ba7b53336abd9a32c, NAME => 'hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/.tmp 2023-07-29 00:53:04,573 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:04,573 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 52082d66600e4b7ba7b53336abd9a32c, disabling compactions & flushes 2023-07-29 00:53:04,573 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c. 2023-07-29 00:53:04,573 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c. 2023-07-29 00:53:04,573 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c. after waiting 0 ms 2023-07-29 00:53:04,573 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c. 2023-07-29 00:53:04,573 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c. 2023-07-29 00:53:04,573 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 52082d66600e4b7ba7b53336abd9a32c: 2023-07-29 00:53:04,578 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-29 00:53:04,592 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690591984581"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690591984581"}]},"ts":"1690591984581"} 2023-07-29 00:53:04,616 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-29 00:53:04,618 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-29 00:53:04,624 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690591984619"}]},"ts":"1690591984619"} 2023-07-29 00:53:04,629 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-29 00:53:04,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=52082d66600e4b7ba7b53336abd9a32c, ASSIGN}] 2023-07-29 00:53:04,640 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=52082d66600e4b7ba7b53336abd9a32c, ASSIGN 2023-07-29 00:53:04,642 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=52082d66600e4b7ba7b53336abd9a32c, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,39077,1690591982851; forceNewPlan=false, retain=false 2023-07-29 00:53:04,794 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=52082d66600e4b7ba7b53336abd9a32c, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,39077,1690591982851 2023-07-29 00:53:04,795 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690591984793"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690591984793"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690591984793"}]},"ts":"1690591984793"} 2023-07-29 00:53:04,802 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 52082d66600e4b7ba7b53336abd9a32c, server=jenkins-hbase17.apache.org,39077,1690591982851}] 2023-07-29 00:53:04,970 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c. 2023-07-29 00:53:04,972 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 52082d66600e4b7ba7b53336abd9a32c, NAME => 'hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c.', STARTKEY => '', ENDKEY => ''} 2023-07-29 00:53:04,974 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 52082d66600e4b7ba7b53336abd9a32c 2023-07-29 00:53:04,974 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:04,974 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 52082d66600e4b7ba7b53336abd9a32c 2023-07-29 00:53:04,974 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 52082d66600e4b7ba7b53336abd9a32c 2023-07-29 00:53:04,976 INFO [StoreOpener-52082d66600e4b7ba7b53336abd9a32c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 52082d66600e4b7ba7b53336abd9a32c 2023-07-29 00:53:04,979 DEBUG [StoreOpener-52082d66600e4b7ba7b53336abd9a32c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/namespace/52082d66600e4b7ba7b53336abd9a32c/info 2023-07-29 00:53:04,979 DEBUG [StoreOpener-52082d66600e4b7ba7b53336abd9a32c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/namespace/52082d66600e4b7ba7b53336abd9a32c/info 2023-07-29 00:53:04,980 INFO [StoreOpener-52082d66600e4b7ba7b53336abd9a32c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52082d66600e4b7ba7b53336abd9a32c columnFamilyName info 2023-07-29 00:53:04,981 INFO [StoreOpener-52082d66600e4b7ba7b53336abd9a32c-1] regionserver.HStore(310): Store=52082d66600e4b7ba7b53336abd9a32c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:04,983 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/namespace/52082d66600e4b7ba7b53336abd9a32c 2023-07-29 00:53:04,984 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/namespace/52082d66600e4b7ba7b53336abd9a32c 2023-07-29 00:53:04,991 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 52082d66600e4b7ba7b53336abd9a32c 2023-07-29 00:53:04,995 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/namespace/52082d66600e4b7ba7b53336abd9a32c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-29 00:53:04,996 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 52082d66600e4b7ba7b53336abd9a32c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=698664, jitterRate=-0.11160299181938171}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-29 00:53:04,996 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 52082d66600e4b7ba7b53336abd9a32c: 2023-07-29 00:53:04,998 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c., pid=6, masterSystemTime=1690591984957 2023-07-29 00:53:05,001 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c. 2023-07-29 00:53:05,002 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c. 2023-07-29 00:53:05,003 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=52082d66600e4b7ba7b53336abd9a32c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,39077,1690591982851 2023-07-29 00:53:05,003 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690591985002"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690591985002"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690591985002"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690591985002"}]},"ts":"1690591985002"} 2023-07-29 00:53:05,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-29 00:53:05,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 52082d66600e4b7ba7b53336abd9a32c, server=jenkins-hbase17.apache.org,39077,1690591982851 in 206 msec 2023-07-29 00:53:05,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-29 00:53:05,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=52082d66600e4b7ba7b53336abd9a32c, ASSIGN in 375 msec 2023-07-29 00:53:05,016 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-29 00:53:05,016 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690591985016"}]},"ts":"1690591985016"} 2023-07-29 00:53:05,019 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-29 00:53:05,022 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-29 00:53:05,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 529 msec 2023-07-29 00:53:05,104 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-29 00:53:05,107 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-29 00:53:05,107 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:05,151 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-29 00:53:05,169 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-29 00:53:05,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-07-29 00:53:05,186 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-29 00:53:05,198 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-29 00:53:05,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-29 00:53:05,211 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-29 00:53:05,213 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-29 00:53:05,213 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.298sec 2023-07-29 00:53:05,215 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-29 00:53:05,218 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-29 00:53:05,218 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-29 00:53:05,220 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35365,1690591981754-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-29 00:53:05,221 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35365,1690591981754-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-29 00:53:05,233 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-29 00:53:05,295 DEBUG [Listener at localhost.localdomain/32977] zookeeper.ReadOnlyZKClient(139): Connect 0x7742515d to 127.0.0.1:52662 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-29 00:53:05,301 DEBUG [Listener at localhost.localdomain/32977] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13bebf6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-29 00:53:05,345 DEBUG [hconnection-0x3bf78aac-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-29 00:53:05,362 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-29 00:53:05,372 INFO [Listener at localhost.localdomain/32977] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,35365,1690591981754 2023-07-29 00:53:05,372 INFO [Listener at localhost.localdomain/32977] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:05,378 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-29 00:53:05,378 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:05,379 INFO [Listener at localhost.localdomain/32977] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-29 00:53:05,390 WARN [Listener at localhost.localdomain/32977] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-29 00:53:05,392 WARN [Listener at localhost.localdomain/32977] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:53:05,393 INFO [Listener at localhost.localdomain/32977] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:53:05,398 INFO [Listener at localhost.localdomain/32977] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/java.io.tmpdir/Jetty_localhost_44797_datanode____.qcs3no/webapp 2023-07-29 00:53:05,474 INFO [Listener at localhost.localdomain/32977] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44797 2023-07-29 00:53:05,483 WARN [Listener at localhost.localdomain/37831] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:53:05,505 WARN [Listener at localhost.localdomain/37831] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-29 00:53:05,509 WARN [Listener at localhost.localdomain/37831] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:53:05,511 INFO [Listener at localhost.localdomain/37831] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:53:05,515 INFO [Listener at localhost.localdomain/37831] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/java.io.tmpdir/Jetty_localhost_46165_datanode____.fzgiln/webapp 2023-07-29 00:53:05,567 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcd9e2cb774fd22cd: Processing first storage report for DS-63037578-75d9-48bc-897b-bcca0f9fabf3 from datanode 3bfcdb71-0cb3-471a-90a3-c29bceca1114 2023-07-29 00:53:05,567 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcd9e2cb774fd22cd: from storage DS-63037578-75d9-48bc-897b-bcca0f9fabf3 node DatanodeRegistration(127.0.0.1:33549, datanodeUuid=3bfcdb71-0cb3-471a-90a3-c29bceca1114, infoPort=41965, infoSecurePort=0, ipcPort=37831, storageInfo=lv=-57;cid=testClusterID;nsid=1840597430;c=1690591979000), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:53:05,567 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcd9e2cb774fd22cd: Processing first storage report for DS-d99b04e8-c31e-4aa6-970c-0772bf54f396 from datanode 3bfcdb71-0cb3-471a-90a3-c29bceca1114 2023-07-29 00:53:05,567 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcd9e2cb774fd22cd: from storage DS-d99b04e8-c31e-4aa6-970c-0772bf54f396 node DatanodeRegistration(127.0.0.1:33549, datanodeUuid=3bfcdb71-0cb3-471a-90a3-c29bceca1114, infoPort=41965, infoSecurePort=0, ipcPort=37831, storageInfo=lv=-57;cid=testClusterID;nsid=1840597430;c=1690591979000), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-29 00:53:05,605 INFO [Listener at localhost.localdomain/37831] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46165 2023-07-29 00:53:05,615 WARN [Listener at localhost.localdomain/38865] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:53:05,636 WARN [Listener at localhost.localdomain/38865] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-29 00:53:05,639 WARN [Listener at localhost.localdomain/38865] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:53:05,642 INFO [Listener at localhost.localdomain/38865] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:53:05,654 INFO [Listener at localhost.localdomain/38865] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/java.io.tmpdir/Jetty_localhost_37621_datanode____.bcuumg/webapp 2023-07-29 00:53:05,697 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x99491bb50725c839: Processing first storage report for DS-deb7ba8b-11fe-4ef0-bd3a-14fedee4b5c0 from datanode e70d314a-40ae-4d9b-9745-1599f5b85d47 2023-07-29 00:53:05,697 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x99491bb50725c839: from storage DS-deb7ba8b-11fe-4ef0-bd3a-14fedee4b5c0 node DatanodeRegistration(127.0.0.1:37011, datanodeUuid=e70d314a-40ae-4d9b-9745-1599f5b85d47, infoPort=39729, infoSecurePort=0, ipcPort=38865, storageInfo=lv=-57;cid=testClusterID;nsid=1840597430;c=1690591979000), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-29 00:53:05,697 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x99491bb50725c839: Processing first storage report for DS-3afe8b5e-2fad-4395-a198-48e80a255900 from datanode e70d314a-40ae-4d9b-9745-1599f5b85d47 2023-07-29 00:53:05,697 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x99491bb50725c839: from storage DS-3afe8b5e-2fad-4395-a198-48e80a255900 node DatanodeRegistration(127.0.0.1:37011, datanodeUuid=e70d314a-40ae-4d9b-9745-1599f5b85d47, infoPort=39729, infoSecurePort=0, ipcPort=38865, storageInfo=lv=-57;cid=testClusterID;nsid=1840597430;c=1690591979000), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:53:05,761 INFO [Listener at localhost.localdomain/38865] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37621 2023-07-29 00:53:05,797 WARN [Listener at localhost.localdomain/37227] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:53:06,183 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc7741bc750d56f26: Processing first storage report for DS-6ca3aff9-3cf7-4f42-85f6-86f8b43fc46e from datanode dc57a255-b8a7-4c13-9f85-6231191da52c 2023-07-29 00:53:06,183 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc7741bc750d56f26: from storage DS-6ca3aff9-3cf7-4f42-85f6-86f8b43fc46e node DatanodeRegistration(127.0.0.1:37069, datanodeUuid=dc57a255-b8a7-4c13-9f85-6231191da52c, infoPort=32795, infoSecurePort=0, ipcPort=37227, storageInfo=lv=-57;cid=testClusterID;nsid=1840597430;c=1690591979000), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:53:06,183 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc7741bc750d56f26: Processing first storage report for DS-d7002874-9de5-43f4-a6c9-3be19c8e147f from datanode dc57a255-b8a7-4c13-9f85-6231191da52c 2023-07-29 00:53:06,183 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc7741bc750d56f26: from storage DS-d7002874-9de5-43f4-a6c9-3be19c8e147f node DatanodeRegistration(127.0.0.1:37069, datanodeUuid=dc57a255-b8a7-4c13-9f85-6231191da52c, infoPort=32795, infoSecurePort=0, ipcPort=37227, storageInfo=lv=-57;cid=testClusterID;nsid=1840597430;c=1690591979000), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:53:06,224 DEBUG [Listener at localhost.localdomain/37227] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-29 00:53:06,227 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-29 00:53:06,236 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35365] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-07-29 00:53:06,236 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35365] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-07-29 00:53:06,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35365] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-29 00:53:06,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35365] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath 2023-07-29 00:53:06,245 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_PRE_OPERATION 2023-07-29 00:53:06,247 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-29 00:53:06,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35365] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRollOnDatanodeDeath" procId is: 9 2023-07-29 00:53:06,251 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/e331decf8eccebacf1516d8bd5eb44ba 2023-07-29 00:53:06,252 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/e331decf8eccebacf1516d8bd5eb44ba empty. 2023-07-29 00:53:06,254 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/e331decf8eccebacf1516d8bd5eb44ba 2023-07-29 00:53:06,254 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRollOnDatanodeDeath regions 2023-07-29 00:53:06,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-29 00:53:06,274 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/.tabledesc/.tableinfo.0000000001 2023-07-29 00:53:06,276 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(7675): creating {ENCODED => e331decf8eccebacf1516d8bd5eb44ba, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/.tmp 2023-07-29 00:53:06,291 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:06,291 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1604): Closing e331decf8eccebacf1516d8bd5eb44ba, disabling compactions & flushes 2023-07-29 00:53:06,291 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba. 2023-07-29 00:53:06,291 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba. 2023-07-29 00:53:06,291 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba. after waiting 0 ms 2023-07-29 00:53:06,291 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba. 2023-07-29 00:53:06,291 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba. 2023-07-29 00:53:06,291 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1558): Region close journal for e331decf8eccebacf1516d8bd5eb44ba: 2023-07-29 00:53:06,296 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ADD_TO_META 2023-07-29 00:53:06,298 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1690591986298"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690591986298"}]},"ts":"1690591986298"} 2023-07-29 00:53:06,301 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-29 00:53:06,303 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-29 00:53:06,303 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690591986303"}]},"ts":"1690591986303"} 2023-07-29 00:53:06,306 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLING in hbase:meta 2023-07-29 00:53:06,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=e331decf8eccebacf1516d8bd5eb44ba, ASSIGN}] 2023-07-29 00:53:06,311 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=e331decf8eccebacf1516d8bd5eb44ba, ASSIGN 2023-07-29 00:53:06,313 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=e331decf8eccebacf1516d8bd5eb44ba, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,39077,1690591982851; forceNewPlan=false, retain=false 2023-07-29 00:53:06,466 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e331decf8eccebacf1516d8bd5eb44ba, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,39077,1690591982851 2023-07-29 00:53:06,467 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1690591986466"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690591986466"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690591986466"}]},"ts":"1690591986466"} 2023-07-29 00:53:06,472 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure e331decf8eccebacf1516d8bd5eb44ba, server=jenkins-hbase17.apache.org,39077,1690591982851}] 2023-07-29 00:53:06,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba. 2023-07-29 00:53:06,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e331decf8eccebacf1516d8bd5eb44ba, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba.', STARTKEY => '', ENDKEY => ''} 2023-07-29 00:53:06,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRollOnDatanodeDeath e331decf8eccebacf1516d8bd5eb44ba 2023-07-29 00:53:06,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:06,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for e331decf8eccebacf1516d8bd5eb44ba 2023-07-29 00:53:06,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for e331decf8eccebacf1516d8bd5eb44ba 2023-07-29 00:53:06,647 INFO [StoreOpener-e331decf8eccebacf1516d8bd5eb44ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e331decf8eccebacf1516d8bd5eb44ba 2023-07-29 00:53:06,649 DEBUG [StoreOpener-e331decf8eccebacf1516d8bd5eb44ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/default/TestLogRolling-testLogRollOnDatanodeDeath/e331decf8eccebacf1516d8bd5eb44ba/info 2023-07-29 00:53:06,649 DEBUG [StoreOpener-e331decf8eccebacf1516d8bd5eb44ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/default/TestLogRolling-testLogRollOnDatanodeDeath/e331decf8eccebacf1516d8bd5eb44ba/info 2023-07-29 00:53:06,650 INFO [StoreOpener-e331decf8eccebacf1516d8bd5eb44ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e331decf8eccebacf1516d8bd5eb44ba columnFamilyName info 2023-07-29 00:53:06,651 INFO [StoreOpener-e331decf8eccebacf1516d8bd5eb44ba-1] regionserver.HStore(310): Store=e331decf8eccebacf1516d8bd5eb44ba/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:06,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/default/TestLogRolling-testLogRollOnDatanodeDeath/e331decf8eccebacf1516d8bd5eb44ba 2023-07-29 00:53:06,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/default/TestLogRolling-testLogRollOnDatanodeDeath/e331decf8eccebacf1516d8bd5eb44ba 2023-07-29 00:53:06,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for e331decf8eccebacf1516d8bd5eb44ba 2023-07-29 00:53:06,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/default/TestLogRolling-testLogRollOnDatanodeDeath/e331decf8eccebacf1516d8bd5eb44ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-29 00:53:06,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened e331decf8eccebacf1516d8bd5eb44ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=757176, jitterRate=-0.03720131516456604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-29 00:53:06,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for e331decf8eccebacf1516d8bd5eb44ba: 2023-07-29 00:53:06,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba., pid=11, masterSystemTime=1690591986627 2023-07-29 00:53:06,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba. 2023-07-29 00:53:06,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba. 2023-07-29 00:53:06,672 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e331decf8eccebacf1516d8bd5eb44ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,39077,1690591982851 2023-07-29 00:53:06,672 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1690591986671"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690591986671"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690591986671"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690591986671"}]},"ts":"1690591986671"} 2023-07-29 00:53:06,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-29 00:53:06,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure e331decf8eccebacf1516d8bd5eb44ba, server=jenkins-hbase17.apache.org,39077,1690591982851 in 203 msec 2023-07-29 00:53:06,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-29 00:53:06,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=e331decf8eccebacf1516d8bd5eb44ba, ASSIGN in 369 msec 2023-07-29 00:53:06,684 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-29 00:53:06,684 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690591986684"}]},"ts":"1690591986684"} 2023-07-29 00:53:06,686 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLED in hbase:meta 2023-07-29 00:53:06,689 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_POST_OPERATION 2023-07-29 00:53:06,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath in 449 msec 2023-07-29 00:53:09,839 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-29 00:53:09,913 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-29 00:53:09,914 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-29 00:53:09,915 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRollOnDatanodeDeath' 2023-07-29 00:53:11,884 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-29 00:53:11,886 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-29 00:53:16,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-29 00:53:16,266 INFO [Listener at localhost.localdomain/37227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRollOnDatanodeDeath, procId: 9 completed 2023-07-29 00:53:16,266 DEBUG [Listener at localhost.localdomain/37227] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestLogRolling-testLogRollOnDatanodeDeath get assigned. Timeout = 60000ms 2023-07-29 00:53:16,268 INFO [Listener at localhost.localdomain/37227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-29 00:53:16,272 INFO [Listener at localhost.localdomain/37227] hbase.HBaseTestingUtility(3484): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned to meta. Checking AM states. 2023-07-29 00:53:16,272 INFO [Listener at localhost.localdomain/37227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-29 00:53:16,272 INFO [Listener at localhost.localdomain/37227] hbase.HBaseTestingUtility(3504): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned. 2023-07-29 00:53:16,282 DEBUG [Listener at localhost.localdomain/37227] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRollOnDatanodeDeath 2023-07-29 00:53:16,283 DEBUG [Listener at localhost.localdomain/37227] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba. 2023-07-29 00:53:16,284 WARN [Listener at localhost.localdomain/37227] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-29 00:53:16,287 INFO [Listener at localhost.localdomain/37227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-29 00:53:16,292 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-2100025860_17 at /127.0.0.1:38274 [Receiving block BP-1378009104-136.243.18.41-1690591979000:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:41195:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:38274 dst: /127.0.0.1:41195 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:16,292 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_175944368_17 at /127.0.0.1:38288 [Receiving block BP-1378009104-136.243.18.41-1690591979000:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:41195:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:38288 dst: /127.0.0.1:41195 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:16,292 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_175944368_17 at /127.0.0.1:38290 [Receiving block BP-1378009104-136.243.18.41-1690591979000:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:41195:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:38290 dst: /127.0.0.1:41195 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:16,392 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_175944368_17 at /127.0.0.1:43776 [Receiving block BP-1378009104-136.243.18.41-1690591979000:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:39307:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:43776 dst: /127.0.0.1:39307 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:16,394 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-2100025860_17 at /127.0.0.1:43738 [Receiving block BP-1378009104-136.243.18.41-1690591979000:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:39307:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:43738 dst: /127.0.0.1:39307 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:16,393 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_175944368_17 at /127.0.0.1:43766 [Receiving block BP-1378009104-136.243.18.41-1690591979000:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:39307:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:43766 dst: /127.0.0.1:39307 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:16,393 WARN [BP-1378009104-136.243.18.41-1690591979000 heartbeating to localhost.localdomain/127.0.0.1:40329] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-29 00:53:16,397 WARN [BP-1378009104-136.243.18.41-1690591979000 heartbeating to localhost.localdomain/127.0.0.1:40329] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1378009104-136.243.18.41-1690591979000 (Datanode Uuid 13af7f10-f731-4389-8c7d-56a350d44681) service to localhost.localdomain/127.0.0.1:40329 2023-07-29 00:53:16,399 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594/dfs/data/data1/current/BP-1378009104-136.243.18.41-1690591979000] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:53:16,399 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594/dfs/data/data2/current/BP-1378009104-136.243.18.41-1690591979000] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:53:16,408 WARN [Listener at localhost.localdomain/37227] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-29 00:53:16,411 WARN [Listener at localhost.localdomain/37227] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:53:16,412 INFO [Listener at localhost.localdomain/37227] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:53:16,417 INFO [Listener at localhost.localdomain/37227] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/java.io.tmpdir/Jetty_localhost_43047_datanode____.8kikat/webapp 2023-07-29 00:53:16,490 INFO [Listener at localhost.localdomain/37227] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43047 2023-07-29 00:53:16,498 WARN [Listener at localhost.localdomain/39709] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:53:16,501 WARN [AsyncFSWAL-0-hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9-prefix:jenkins-hbase17.apache.org,39077,1690591982851] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:16,502 DEBUG [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase17.apache.org%2C39077%2C1690591982851:(num 1690591984059) roll requested 2023-07-29 00:53:16,520 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37069,DS-6ca3aff9-3cf7-4f42-85f6-86f8b43fc46e,DISK] 2023-07-29 00:53:16,520 WARN [regionserver/jenkins-hbase17:0.logRoller] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(571): create fan-out dfs output /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.1690591996502 failed, retry = 0 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: /127.0.0.1:39307 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:16,577 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x39b961c2968e3f8: Processing first storage report for DS-bd19aa1b-1eea-413a-84ce-92ae500f69e0 from datanode 13af7f10-f731-4389-8c7d-56a350d44681 2023-07-29 00:53:16,578 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x39b961c2968e3f8: from storage DS-bd19aa1b-1eea-413a-84ce-92ae500f69e0 node DatanodeRegistration(127.0.0.1:45105, datanodeUuid=13af7f10-f731-4389-8c7d-56a350d44681, infoPort=39579, infoSecurePort=0, ipcPort=39709, storageInfo=lv=-57;cid=testClusterID;nsid=1840597430;c=1690591979000), blocks: 6, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-29 00:53:16,578 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x39b961c2968e3f8: Processing first storage report for DS-078a8834-f509-42d0-9fc7-5df2e4f152ee from datanode 13af7f10-f731-4389-8c7d-56a350d44681 2023-07-29 00:53:16,578 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x39b961c2968e3f8: from storage DS-078a8834-f509-42d0-9fc7-5df2e4f152ee node DatanodeRegistration(127.0.0.1:45105, datanodeUuid=13af7f10-f731-4389-8c7d-56a350d44681, infoPort=39579, infoSecurePort=0, ipcPort=39709, storageInfo=lv=-57;cid=testClusterID;nsid=1840597430;c=1690591979000), blocks: 6, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:53:16,623 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_175944368_17 at /127.0.0.1:55836 [Receiving block BP-1378009104-136.243.18.41-1690591979000:blk_1073741838_1014]] datanode.DataXceiver(323): 127.0.0.1:37069:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:55836 dst: /127.0.0.1:37069 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:16,632 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41195,DS-7531ffdc-2f3b-44f8-81cc-2f75ebc39d63,DISK] 2023-07-29 00:53:16,632 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45105,DS-bd19aa1b-1eea-413a-84ce-92ae500f69e0,DISK] 2023-07-29 00:53:16,638 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.1690591984059 with entries=6, filesize=3.20 KB; new WAL /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.1690591996502 2023-07-29 00:53:16,639 DEBUG [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41195,DS-7531ffdc-2f3b-44f8-81cc-2f75ebc39d63,DISK], DatanodeInfoWithStorage[127.0.0.1:45105,DS-bd19aa1b-1eea-413a-84ce-92ae500f69e0,DISK]] 2023-07-29 00:53:16,639 DEBUG [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.1690591984059 is not closed yet, will try archiving it next time 2023-07-29 00:53:16,640 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-29 00:53:16,641 INFO [Listener at localhost.localdomain/39709] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-29 00:53:16,642 DEBUG [Listener at localhost.localdomain/39709] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7742515d to 127.0.0.1:52662 2023-07-29 00:53:16,642 DEBUG [Listener at localhost.localdomain/39709] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:53:16,642 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:16,642 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:16,643 DEBUG [Listener at localhost.localdomain/39709] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-29 00:53:16,643 DEBUG [Listener at localhost.localdomain/39709] util.JVMClusterUtil(257): Found active master hash=447104336, stopped=false 2023-07-29 00:53:16,643 INFO [Listener at localhost.localdomain/39709] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,35365,1690591981754 2023-07-29 00:53:16,645 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): regionserver:39077-0x101ae8fe8c00001, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-29 00:53:16,645 INFO [Listener at localhost.localdomain/39709] procedure2.ProcedureExecutor(629): Stopping 2023-07-29 00:53:16,646 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-29 00:53:16,646 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:16,646 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.1690591984059 2023-07-29 00:53:16,646 DEBUG [Listener at localhost.localdomain/39709] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x631b2437 to 127.0.0.1:52662 2023-07-29 00:53:16,647 DEBUG [Listener at localhost.localdomain/39709] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:53:16,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39077-0x101ae8fe8c00001, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:53:16,647 INFO [Listener at localhost.localdomain/39709] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,39077,1690591982851' ***** 2023-07-29 00:53:16,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:53:16,647 INFO [Listener at localhost.localdomain/39709] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-29 00:53:16,647 INFO [RS:0;jenkins-hbase17:39077] regionserver.HeapMemoryManager(220): Stopping 2023-07-29 00:53:16,648 INFO [RS:0;jenkins-hbase17:39077] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-29 00:53:16,648 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-29 00:53:16,648 INFO [RS:0;jenkins-hbase17:39077] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-29 00:53:16,649 INFO [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(3305): Received CLOSE for 52082d66600e4b7ba7b53336abd9a32c 2023-07-29 00:53:16,649 INFO [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(3305): Received CLOSE for e331decf8eccebacf1516d8bd5eb44ba 2023-07-29 00:53:16,650 INFO [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,39077,1690591982851 2023-07-29 00:53:16,650 DEBUG [RS:0;jenkins-hbase17:39077] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x778d56e1 to 127.0.0.1:52662 2023-07-29 00:53:16,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 52082d66600e4b7ba7b53336abd9a32c, disabling compactions & flushes 2023-07-29 00:53:16,650 DEBUG [RS:0;jenkins-hbase17:39077] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:53:16,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c. 2023-07-29 00:53:16,650 INFO [RS:0;jenkins-hbase17:39077] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-29 00:53:16,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c. 2023-07-29 00:53:16,650 INFO [RS:0;jenkins-hbase17:39077] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-29 00:53:16,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c. after waiting 0 ms 2023-07-29 00:53:16,651 INFO [RS:0;jenkins-hbase17:39077] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-29 00:53:16,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c. 2023-07-29 00:53:16,651 INFO [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-29 00:53:16,651 INFO [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-29 00:53:16,651 DEBUG [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(1478): Online Regions={52082d66600e4b7ba7b53336abd9a32c=hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c., e331decf8eccebacf1516d8bd5eb44ba=TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba., 1588230740=hbase:meta,,1.1588230740} 2023-07-29 00:53:16,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-29 00:53:16,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-29 00:53:16,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-29 00:53:16,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 52082d66600e4b7ba7b53336abd9a32c 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-29 00:53:16,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-29 00:53:16,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-29 00:53:16,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.93 KB heapSize=5.45 KB 2023-07-29 00:53:16,653 WARN [IPC Server handler 0 on default port 40329] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.1690591984059 has not been closed. Lease recovery is in progress. RecoveryId = 1016 for block blk_1073741832_1008 2023-07-29 00:53:16,653 DEBUG [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(1504): Waiting on 1588230740, 52082d66600e4b7ba7b53336abd9a32c, e331decf8eccebacf1516d8bd5eb44ba 2023-07-29 00:53:16,656 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.1690591984059 after 9ms 2023-07-29 00:53:16,661 WARN [AsyncFSWAL-0-hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9-prefix:jenkins-hbase17.apache.org,39077,1690591982851.meta] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:16,662 DEBUG [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase17.apache.org%2C39077%2C1690591982851.meta:.meta(num 1690591984268) roll requested 2023-07-29 00:53:16,680 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37011,DS-deb7ba8b-11fe-4ef0-bd3a-14fedee4b5c0,DISK] 2023-07-29 00:53:16,680 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33549,DS-63037578-75d9-48bc-897b-bcca0f9fabf3,DISK] 2023-07-29 00:53:16,684 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.meta.1690591984268.meta with entries=12, filesize=3.87 KB; new WAL /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.meta.1690591996662.meta 2023-07-29 00:53:16,684 DEBUG [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37011,DS-deb7ba8b-11fe-4ef0-bd3a-14fedee4b5c0,DISK], DatanodeInfoWithStorage[127.0.0.1:33549,DS-63037578-75d9-48bc-897b-bcca0f9fabf3,DISK]] 2023-07-29 00:53:16,684 DEBUG [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.meta.1690591984268.meta is not closed yet, will try archiving it next time 2023-07-29 00:53:16,684 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:16,685 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:16,686 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.meta.1690591984268.meta 2023-07-29 00:53:16,687 WARN [IPC Server handler 1 on default port 40329] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.meta.1690591984268.meta has not been closed. Lease recovery is in progress. RecoveryId = 1018 for block blk_1073741833_1009 2023-07-29 00:53:16,687 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.meta.1690591984268.meta after 1ms 2023-07-29 00:53:16,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/namespace/52082d66600e4b7ba7b53336abd9a32c/.tmp/info/01304e8a97ed4c339a337ec49ca31fcc 2023-07-29 00:53:16,728 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.69 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/.tmp/info/856c6957b4644f79a63b08231af10140 2023-07-29 00:53:16,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/namespace/52082d66600e4b7ba7b53336abd9a32c/.tmp/info/01304e8a97ed4c339a337ec49ca31fcc as hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/namespace/52082d66600e4b7ba7b53336abd9a32c/info/01304e8a97ed4c339a337ec49ca31fcc 2023-07-29 00:53:16,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/namespace/52082d66600e4b7ba7b53336abd9a32c/info/01304e8a97ed4c339a337ec49ca31fcc, entries=2, sequenceid=6, filesize=4.8 K 2023-07-29 00:53:16,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 52082d66600e4b7ba7b53336abd9a32c in 140ms, sequenceid=6, compaction requested=false 2023-07-29 00:53:16,793 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=240 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/.tmp/table/9c2a0c642b9948e7bec9ad26ce8c29c3 2023-07-29 00:53:16,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/namespace/52082d66600e4b7ba7b53336abd9a32c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-29 00:53:16,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c. 2023-07-29 00:53:16,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 52082d66600e4b7ba7b53336abd9a32c: 2023-07-29 00:53:16,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690591984491.52082d66600e4b7ba7b53336abd9a32c. 2023-07-29 00:53:16,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing e331decf8eccebacf1516d8bd5eb44ba, disabling compactions & flushes 2023-07-29 00:53:16,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba. 2023-07-29 00:53:16,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba. 2023-07-29 00:53:16,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba. after waiting 0 ms 2023-07-29 00:53:16,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba. 2023-07-29 00:53:16,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing e331decf8eccebacf1516d8bd5eb44ba 1/1 column families, dataSize=2.05 KB heapSize=2.45 KB 2023-07-29 00:53:16,811 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/.tmp/info/856c6957b4644f79a63b08231af10140 as hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/info/856c6957b4644f79a63b08231af10140 2023-07-29 00:53:16,823 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/info/856c6957b4644f79a63b08231af10140, entries=20, sequenceid=14, filesize=7.4 K 2023-07-29 00:53:16,826 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/.tmp/table/9c2a0c642b9948e7bec9ad26ce8c29c3 as hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/table/9c2a0c642b9948e7bec9ad26ce8c29c3 2023-07-29 00:53:16,853 DEBUG [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(1504): Waiting on 1588230740, e331decf8eccebacf1516d8bd5eb44ba 2023-07-29 00:53:16,910 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-29 00:53:16,911 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-29 00:53:17,017 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/table/9c2a0c642b9948e7bec9ad26ce8c29c3, entries=4, sequenceid=14, filesize=4.8 K 2023-07-29 00:53:17,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.05 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/default/TestLogRolling-testLogRollOnDatanodeDeath/e331decf8eccebacf1516d8bd5eb44ba/.tmp/info/a499713a8f854162a156505163c95930 2023-07-29 00:53:17,018 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/2998, heapSize ~5.16 KB/5288, currentSize=0 B/0 for 1588230740 in 366ms, sequenceid=14, compaction requested=false 2023-07-29 00:53:17,030 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-07-29 00:53:17,031 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-29 00:53:17,032 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-29 00:53:17,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/default/TestLogRolling-testLogRollOnDatanodeDeath/e331decf8eccebacf1516d8bd5eb44ba/.tmp/info/a499713a8f854162a156505163c95930 as hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/default/TestLogRolling-testLogRollOnDatanodeDeath/e331decf8eccebacf1516d8bd5eb44ba/info/a499713a8f854162a156505163c95930 2023-07-29 00:53:17,032 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-29 00:53:17,033 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-29 00:53:17,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/default/TestLogRolling-testLogRollOnDatanodeDeath/e331decf8eccebacf1516d8bd5eb44ba/info/a499713a8f854162a156505163c95930, entries=2, sequenceid=6, filesize=6.8 K 2023-07-29 00:53:17,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.05 KB/2102, heapSize ~2.44 KB/2496, currentSize=0 B/0 for e331decf8eccebacf1516d8bd5eb44ba in 235ms, sequenceid=6, compaction requested=false 2023-07-29 00:53:17,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/data/default/TestLogRolling-testLogRollOnDatanodeDeath/e331decf8eccebacf1516d8bd5eb44ba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-29 00:53:17,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba. 2023-07-29 00:53:17,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for e331decf8eccebacf1516d8bd5eb44ba: 2023-07-29 00:53:17,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1690591986236.e331decf8eccebacf1516d8bd5eb44ba. 2023-07-29 00:53:17,053 INFO [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,39077,1690591982851; all regions closed. 2023-07-29 00:53:17,911 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-29 00:53:20,657 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.1690591984059 after 4010ms 2023-07-29 00:53:20,658 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.1690591984059 to hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/oldWALs/jenkins-hbase17.apache.org%2C39077%2C1690591982851.1690591984059 2023-07-29 00:53:20,688 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.meta.1690591984268.meta after 4002ms 2023-07-29 00:53:20,690 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/WALs/jenkins-hbase17.apache.org,39077,1690591982851/jenkins-hbase17.apache.org%2C39077%2C1690591982851.meta.1690591984268.meta to hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/oldWALs/jenkins-hbase17.apache.org%2C39077%2C1690591982851.meta.1690591984268.meta 2023-07-29 00:53:20,700 DEBUG [RS:0;jenkins-hbase17:39077] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/oldWALs 2023-07-29 00:53:20,700 INFO [RS:0;jenkins-hbase17:39077] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C39077%2C1690591982851.meta:.meta(num 1690591996662) 2023-07-29 00:53:20,711 DEBUG [RS:0;jenkins-hbase17:39077] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/oldWALs 2023-07-29 00:53:20,711 INFO [RS:0;jenkins-hbase17:39077] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C39077%2C1690591982851:(num 1690591996502) 2023-07-29 00:53:20,711 DEBUG [RS:0;jenkins-hbase17:39077] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:53:20,711 INFO [RS:0;jenkins-hbase17:39077] regionserver.LeaseManager(133): Closed leases 2023-07-29 00:53:20,711 INFO [RS:0;jenkins-hbase17:39077] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-29 00:53:20,711 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-29 00:53:20,712 INFO [RS:0;jenkins-hbase17:39077] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:39077 2023-07-29 00:53:20,719 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): regionserver:39077-0x101ae8fe8c00001, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,39077,1690591982851 2023-07-29 00:53:20,719 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-29 00:53:20,719 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): regionserver:39077-0x101ae8fe8c00001, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-29 00:53:20,720 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,39077,1690591982851] 2023-07-29 00:53:20,720 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,39077,1690591982851; numProcessing=1 2023-07-29 00:53:20,722 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,39077,1690591982851 already deleted, retry=false 2023-07-29 00:53:20,722 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,39077,1690591982851 expired; onlineServers=0 2023-07-29 00:53:20,722 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,35365,1690591981754' ***** 2023-07-29 00:53:20,722 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-29 00:53:20,723 DEBUG [M:0;jenkins-hbase17:35365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b9b4f6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-29 00:53:20,723 INFO [M:0;jenkins-hbase17:35365] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,35365,1690591981754 2023-07-29 00:53:20,723 INFO [M:0;jenkins-hbase17:35365] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,35365,1690591981754; all regions closed. 2023-07-29 00:53:20,723 DEBUG [M:0;jenkins-hbase17:35365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:53:20,723 DEBUG [M:0;jenkins-hbase17:35365] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-29 00:53:20,723 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-29 00:53:20,723 DEBUG [M:0;jenkins-hbase17:35365] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-29 00:53:20,724 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690591983777] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690591983777,5,FailOnTimeoutGroup] 2023-07-29 00:53:20,724 INFO [M:0;jenkins-hbase17:35365] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-29 00:53:20,724 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690591983777] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690591983777,5,FailOnTimeoutGroup] 2023-07-29 00:53:20,725 INFO [M:0;jenkins-hbase17:35365] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-29 00:53:20,725 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-29 00:53:20,725 INFO [M:0;jenkins-hbase17:35365] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-07-29 00:53:20,725 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:20,726 DEBUG [M:0;jenkins-hbase17:35365] master.HMaster(1512): Stopping service threads 2023-07-29 00:53:20,726 INFO [M:0;jenkins-hbase17:35365] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-29 00:53:20,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-29 00:53:20,726 ERROR [M:0;jenkins-hbase17:35365] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] 2023-07-29 00:53:20,727 INFO [M:0;jenkins-hbase17:35365] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-29 00:53:20,727 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-29 00:53:20,728 DEBUG [M:0;jenkins-hbase17:35365] zookeeper.ZKUtil(398): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-29 00:53:20,728 WARN [M:0;jenkins-hbase17:35365] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-29 00:53:20,728 INFO [M:0;jenkins-hbase17:35365] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-29 00:53:20,728 INFO [M:0;jenkins-hbase17:35365] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-29 00:53:20,729 DEBUG [M:0;jenkins-hbase17:35365] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-29 00:53:20,729 INFO [M:0;jenkins-hbase17:35365] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:53:20,729 DEBUG [M:0;jenkins-hbase17:35365] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:53:20,729 DEBUG [M:0;jenkins-hbase17:35365] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-29 00:53:20,729 DEBUG [M:0;jenkins-hbase17:35365] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:53:20,729 INFO [M:0;jenkins-hbase17:35365] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.12 KB heapSize=45.77 KB 2023-07-29 00:53:20,730 WARN [AsyncFSWAL-0-hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData-prefix:jenkins-hbase17.apache.org,35365,1690591981754] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:20,730 DEBUG [master:store-WAL-Roller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase17.apache.org%2C35365%2C1690591981754:(num 1690591983251) roll requested 2023-07-29 00:53:20,750 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33549,DS-63037578-75d9-48bc-897b-bcca0f9fabf3,DISK] 2023-07-29 00:53:20,750 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37011,DS-deb7ba8b-11fe-4ef0-bd3a-14fedee4b5c0,DISK] 2023-07-29 00:53:20,753 INFO [master:store-WAL-Roller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/WALs/jenkins-hbase17.apache.org,35365,1690591981754/jenkins-hbase17.apache.org%2C35365%2C1690591981754.1690591983251 with entries=89, filesize=43.97 KB; new WAL /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/WALs/jenkins-hbase17.apache.org,35365,1690591981754/jenkins-hbase17.apache.org%2C35365%2C1690591981754.1690592000730 2023-07-29 00:53:20,754 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33549,DS-63037578-75d9-48bc-897b-bcca0f9fabf3,DISK], DatanodeInfoWithStorage[127.0.0.1:37011,DS-deb7ba8b-11fe-4ef0-bd3a-14fedee4b5c0,DISK]] 2023-07-29 00:53:20,754 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/WALs/jenkins-hbase17.apache.org,35365,1690591981754/jenkins-hbase17.apache.org%2C35365%2C1690591981754.1690591983251 is not closed yet, will try archiving it next time 2023-07-29 00:53:20,754 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:20,754 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-29 00:53:20,754 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/WALs/jenkins-hbase17.apache.org,35365,1690591981754/jenkins-hbase17.apache.org%2C35365%2C1690591981754.1690591983251 2023-07-29 00:53:20,755 WARN [IPC Server handler 2 on default port 40329] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/WALs/jenkins-hbase17.apache.org,35365,1690591981754/jenkins-hbase17.apache.org%2C35365%2C1690591981754.1690591983251 has not been closed. Lease recovery is in progress. RecoveryId = 1024 for block blk_1073741829_1005 2023-07-29 00:53:20,756 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/WALs/jenkins-hbase17.apache.org,35365,1690591981754/jenkins-hbase17.apache.org%2C35365%2C1690591981754.1690591983251 after 2ms 2023-07-29 00:53:20,771 INFO [M:0;jenkins-hbase17:35365] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.12 KB at sequenceid=91 (bloomFilter=true), to=hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f6fad2b88ca94e8cb6435732b60c0aaf 2023-07-29 00:53:20,779 DEBUG [M:0;jenkins-hbase17:35365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f6fad2b88ca94e8cb6435732b60c0aaf as hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f6fad2b88ca94e8cb6435732b60c0aaf 2023-07-29 00:53:20,786 INFO [M:0;jenkins-hbase17:35365] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f6fad2b88ca94e8cb6435732b60c0aaf, entries=11, sequenceid=91, filesize=7.0 K 2023-07-29 00:53:20,787 INFO [M:0;jenkins-hbase17:35365] regionserver.HRegion(2948): Finished flush of dataSize ~38.12 KB/39035, heapSize ~45.75 KB/46848, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 58ms, sequenceid=91, compaction requested=false 2023-07-29 00:53:20,789 INFO [M:0;jenkins-hbase17:35365] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:53:20,789 DEBUG [M:0;jenkins-hbase17:35365] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-29 00:53:20,820 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): regionserver:39077-0x101ae8fe8c00001, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:53:20,820 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): regionserver:39077-0x101ae8fe8c00001, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:53:20,820 INFO [RS:0;jenkins-hbase17:39077] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,39077,1690591982851; zookeeper connection closed. 2023-07-29 00:53:20,821 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@75620108] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@75620108 2023-07-29 00:53:20,822 INFO [Listener at localhost.localdomain/39709] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-29 00:53:22,344 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-29 00:53:22,385 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-29 00:53:24,758 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/WALs/jenkins-hbase17.apache.org,35365,1690591981754/jenkins-hbase17.apache.org%2C35365%2C1690591981754.1690591983251 after 4004ms 2023-07-29 00:53:24,759 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/WALs/jenkins-hbase17.apache.org,35365,1690591981754/jenkins-hbase17.apache.org%2C35365%2C1690591981754.1690591983251 to hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/oldWALs/jenkins-hbase17.apache.org%2C35365%2C1690591981754.1690591983251 2023-07-29 00:53:24,766 INFO [WAL-Archive-0] region.MasterRegionUtils(50): Moved hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/MasterData/oldWALs/jenkins-hbase17.apache.org%2C35365%2C1690591981754.1690591983251 to hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/oldWALs/jenkins-hbase17.apache.org%2C35365%2C1690591981754.1690591983251$masterlocalwal$ 2023-07-29 00:53:24,767 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-29 00:53:24,767 INFO [M:0;jenkins-hbase17:35365] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-29 00:53:24,767 INFO [M:0;jenkins-hbase17:35365] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:35365 2023-07-29 00:53:24,770 DEBUG [M:0;jenkins-hbase17:35365] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,35365,1690591981754 already deleted, retry=false 2023-07-29 00:53:24,872 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:53:24,872 INFO [M:0;jenkins-hbase17:35365] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,35365,1690591981754; zookeeper connection closed. 2023-07-29 00:53:24,872 DEBUG [Listener at localhost.localdomain/32977-EventThread] zookeeper.ZKWatcher(600): master:35365-0x101ae8fe8c00000, quorum=127.0.0.1:52662, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:53:24,876 WARN [Listener at localhost.localdomain/39709] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-29 00:53:24,887 INFO [Listener at localhost.localdomain/39709] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-29 00:53:24,992 WARN [BP-1378009104-136.243.18.41-1690591979000 heartbeating to localhost.localdomain/127.0.0.1:40329] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-29 00:53:24,992 WARN [BP-1378009104-136.243.18.41-1690591979000 heartbeating to localhost.localdomain/127.0.0.1:40329] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1378009104-136.243.18.41-1690591979000 (Datanode Uuid 13af7f10-f731-4389-8c7d-56a350d44681) service to localhost.localdomain/127.0.0.1:40329 2023-07-29 00:53:24,993 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594/dfs/data/data1/current/BP-1378009104-136.243.18.41-1690591979000] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:53:24,994 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594/dfs/data/data2/current/BP-1378009104-136.243.18.41-1690591979000] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:53:24,999 WARN [Listener at localhost.localdomain/39709] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-29 00:53:25,007 INFO [Listener at localhost.localdomain/39709] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-29 00:53:25,116 WARN [BP-1378009104-136.243.18.41-1690591979000 heartbeating to localhost.localdomain/127.0.0.1:40329] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-29 00:53:25,116 WARN [BP-1378009104-136.243.18.41-1690591979000 heartbeating to localhost.localdomain/127.0.0.1:40329] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1378009104-136.243.18.41-1690591979000 (Datanode Uuid dc57a255-b8a7-4c13-9f85-6231191da52c) service to localhost.localdomain/127.0.0.1:40329 2023-07-29 00:53:25,118 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594/dfs/data/data9/current/BP-1378009104-136.243.18.41-1690591979000] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:53:25,119 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594/dfs/data/data10/current/BP-1378009104-136.243.18.41-1690591979000] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:53:25,122 WARN [Listener at localhost.localdomain/39709] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-29 00:53:25,128 INFO [Listener at localhost.localdomain/39709] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-29 00:53:25,236 WARN [BP-1378009104-136.243.18.41-1690591979000 heartbeating to localhost.localdomain/127.0.0.1:40329] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-29 00:53:25,236 WARN [BP-1378009104-136.243.18.41-1690591979000 heartbeating to localhost.localdomain/127.0.0.1:40329] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1378009104-136.243.18.41-1690591979000 (Datanode Uuid e70d314a-40ae-4d9b-9745-1599f5b85d47) service to localhost.localdomain/127.0.0.1:40329 2023-07-29 00:53:25,237 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594/dfs/data/data7/current/BP-1378009104-136.243.18.41-1690591979000] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:53:25,238 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594/dfs/data/data8/current/BP-1378009104-136.243.18.41-1690591979000] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:53:25,240 WARN [Listener at localhost.localdomain/39709] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-29 00:53:25,246 INFO [Listener at localhost.localdomain/39709] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-29 00:53:25,352 WARN [BP-1378009104-136.243.18.41-1690591979000 heartbeating to localhost.localdomain/127.0.0.1:40329] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-29 00:53:25,353 WARN [BP-1378009104-136.243.18.41-1690591979000 heartbeating to localhost.localdomain/127.0.0.1:40329] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1378009104-136.243.18.41-1690591979000 (Datanode Uuid 3bfcdb71-0cb3-471a-90a3-c29bceca1114) service to localhost.localdomain/127.0.0.1:40329 2023-07-29 00:53:25,354 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594/dfs/data/data5/current/BP-1378009104-136.243.18.41-1690591979000] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:53:25,355 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594/dfs/data/data6/current/BP-1378009104-136.243.18.41-1690591979000] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:53:25,358 WARN [Listener at localhost.localdomain/39709] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-29 00:53:25,362 INFO [Listener at localhost.localdomain/39709] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-29 00:53:25,464 WARN [BP-1378009104-136.243.18.41-1690591979000 heartbeating to localhost.localdomain/127.0.0.1:40329] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-29 00:53:25,464 WARN [BP-1378009104-136.243.18.41-1690591979000 heartbeating to localhost.localdomain/127.0.0.1:40329] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1378009104-136.243.18.41-1690591979000 (Datanode Uuid b2ead6fb-7259-440d-8f89-7e040174ecfb) service to localhost.localdomain/127.0.0.1:40329 2023-07-29 00:53:25,466 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594/dfs/data/data3/current/BP-1378009104-136.243.18.41-1690591979000] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:53:25,467 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/cluster_1353411a-0fa4-63fa-f307-6bfa9778a594/dfs/data/data4/current/BP-1378009104-136.243.18.41-1690591979000] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:53:25,502 INFO [Listener at localhost.localdomain/39709] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-29 00:53:25,625 INFO [Listener at localhost.localdomain/39709] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-29 00:53:25,666 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-29 00:53:25,676 INFO [Listener at localhost.localdomain/39709] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=78 (was 10) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (29130290) connection to localhost.localdomain/127.0.0.1:40329 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@7656e90 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/39709 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase17:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost.localdomain:40329 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:40329 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (29130290) connection to localhost.localdomain/127.0.0.1:40329 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase17:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase17:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (29130290) connection to localhost.localdomain/127.0.0.1:40329 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=461 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=296 (was 401), ProcessCount=171 (was 171), AvailableMemoryMB=10501 (was 11177) 2023-07-29 00:53:25,685 INFO [Listener at localhost.localdomain/39709] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=78, OpenFileDescriptor=461, MaxFileDescriptor=60000, SystemLoadAverage=296, ProcessCount=171, AvailableMemoryMB=10500 2023-07-29 00:53:25,685 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-29 00:53:25,685 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/hadoop.log.dir so I do NOT create it in target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f 2023-07-29 00:53:25,685 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aeea9d0b-d479-49d8-87c4-1443c34b0b06/hadoop.tmp.dir so I do NOT create it in target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f 2023-07-29 00:53:25,685 INFO [Listener at localhost.localdomain/39709] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/cluster_66001958-879e-b87a-53bd-e70fd2a75f47, deleteOnExit=true 2023-07-29 00:53:25,685 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-29 00:53:25,685 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/test.cache.data in system properties and HBase conf 2023-07-29 00:53:25,685 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/hadoop.tmp.dir in system properties and HBase conf 2023-07-29 00:53:25,686 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/hadoop.log.dir in system properties and HBase conf 2023-07-29 00:53:25,686 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-29 00:53:25,686 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-29 00:53:25,686 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-29 00:53:25,686 DEBUG [Listener at localhost.localdomain/39709] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-29 00:53:25,686 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-29 00:53:25,686 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-29 00:53:25,686 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-29 00:53:25,687 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-29 00:53:25,687 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-29 00:53:25,687 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-29 00:53:25,687 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-29 00:53:25,687 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-29 00:53:25,687 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-29 00:53:25,687 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/nfs.dump.dir in system properties and HBase conf 2023-07-29 00:53:25,687 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/java.io.tmpdir in system properties and HBase conf 2023-07-29 00:53:25,687 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-29 00:53:25,687 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-29 00:53:25,688 INFO [Listener at localhost.localdomain/39709] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-29 00:53:25,691 WARN [Listener at localhost.localdomain/39709] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-29 00:53:25,692 WARN [Listener at localhost.localdomain/39709] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-29 00:53:25,722 WARN [Listener at localhost.localdomain/39709] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:53:25,724 INFO [Listener at localhost.localdomain/39709] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:53:25,729 INFO [Listener at localhost.localdomain/39709] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/java.io.tmpdir/Jetty_localhost_localdomain_37171_hdfs____.geowfz/webapp 2023-07-29 00:53:25,801 INFO [Listener at localhost.localdomain/39709] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:37171 2023-07-29 00:53:25,805 WARN [Listener at localhost.localdomain/39709] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-29 00:53:25,805 WARN [Listener at localhost.localdomain/39709] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-29 00:53:25,833 WARN [Listener at localhost.localdomain/34795] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:53:25,844 WARN [Listener at localhost.localdomain/34795] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-29 00:53:25,847 WARN [Listener at localhost.localdomain/34795] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:53:25,849 INFO [Listener at localhost.localdomain/34795] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:53:25,853 INFO [Listener at localhost.localdomain/34795] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/java.io.tmpdir/Jetty_localhost_33905_datanode____nhsjnp/webapp 2023-07-29 00:53:25,924 INFO [Listener at localhost.localdomain/34795] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33905 2023-07-29 00:53:25,930 WARN [Listener at localhost.localdomain/45691] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:53:25,939 WARN [Listener at localhost.localdomain/45691] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-29 00:53:25,942 WARN [Listener at localhost.localdomain/45691] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:53:25,943 INFO [Listener at localhost.localdomain/45691] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:53:25,947 INFO [Listener at localhost.localdomain/45691] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/java.io.tmpdir/Jetty_localhost_34873_datanode____cbs67u/webapp 2023-07-29 00:53:25,987 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x376caee741de4f2e: Processing first storage report for DS-6ad71e06-f94f-4b45-b9bf-64ce9934c115 from datanode 8206b9c2-4850-4aee-8804-cc623193ec85 2023-07-29 00:53:25,987 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x376caee741de4f2e: from storage DS-6ad71e06-f94f-4b45-b9bf-64ce9934c115 node DatanodeRegistration(127.0.0.1:35365, datanodeUuid=8206b9c2-4850-4aee-8804-cc623193ec85, infoPort=40377, infoSecurePort=0, ipcPort=45691, storageInfo=lv=-57;cid=testClusterID;nsid=1635540321;c=1690592005694), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-29 00:53:25,987 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x376caee741de4f2e: Processing first storage report for DS-a56c3025-d996-4dc7-858e-48bb20988a3f from datanode 8206b9c2-4850-4aee-8804-cc623193ec85 2023-07-29 00:53:25,987 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x376caee741de4f2e: from storage DS-a56c3025-d996-4dc7-858e-48bb20988a3f node DatanodeRegistration(127.0.0.1:35365, datanodeUuid=8206b9c2-4850-4aee-8804-cc623193ec85, infoPort=40377, infoSecurePort=0, ipcPort=45691, storageInfo=lv=-57;cid=testClusterID;nsid=1635540321;c=1690592005694), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:53:26,026 INFO [Listener at localhost.localdomain/45691] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34873 2023-07-29 00:53:26,032 WARN [Listener at localhost.localdomain/41921] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:53:26,089 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3cf36d1440156b44: Processing first storage report for DS-813192f0-acde-4c18-93a2-120089776908 from datanode 37e5134c-9fd7-47f3-9aba-f16a90eb1164 2023-07-29 00:53:26,090 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3cf36d1440156b44: from storage DS-813192f0-acde-4c18-93a2-120089776908 node DatanodeRegistration(127.0.0.1:34351, datanodeUuid=37e5134c-9fd7-47f3-9aba-f16a90eb1164, infoPort=35517, infoSecurePort=0, ipcPort=41921, storageInfo=lv=-57;cid=testClusterID;nsid=1635540321;c=1690592005694), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:53:26,090 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3cf36d1440156b44: Processing first storage report for DS-735fe300-4685-499d-ba8c-63a2d4f82e1b from datanode 37e5134c-9fd7-47f3-9aba-f16a90eb1164 2023-07-29 00:53:26,090 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3cf36d1440156b44: from storage DS-735fe300-4685-499d-ba8c-63a2d4f82e1b node DatanodeRegistration(127.0.0.1:34351, datanodeUuid=37e5134c-9fd7-47f3-9aba-f16a90eb1164, infoPort=35517, infoSecurePort=0, ipcPort=41921, storageInfo=lv=-57;cid=testClusterID;nsid=1635540321;c=1690592005694), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:53:26,141 DEBUG [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f 2023-07-29 00:53:26,146 INFO [Listener at localhost.localdomain/41921] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/cluster_66001958-879e-b87a-53bd-e70fd2a75f47/zookeeper_0, clientPort=61768, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/cluster_66001958-879e-b87a-53bd-e70fd2a75f47/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/cluster_66001958-879e-b87a-53bd-e70fd2a75f47/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-29 00:53:26,149 INFO [Listener at localhost.localdomain/41921] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61768 2023-07-29 00:53:26,149 INFO [Listener at localhost.localdomain/41921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:26,150 INFO [Listener at localhost.localdomain/41921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:26,165 INFO [Listener at localhost.localdomain/41921] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33 with version=8 2023-07-29 00:53:26,165 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/hbase-staging 2023-07-29 00:53:26,167 INFO [Listener at localhost.localdomain/41921] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-07-29 00:53:26,167 INFO [Listener at localhost.localdomain/41921] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:53:26,168 INFO [Listener at localhost.localdomain/41921] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-29 00:53:26,168 INFO [Listener at localhost.localdomain/41921] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-29 00:53:26,168 INFO [Listener at localhost.localdomain/41921] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:53:26,168 INFO [Listener at localhost.localdomain/41921] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-29 00:53:26,168 INFO [Listener at localhost.localdomain/41921] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-29 00:53:26,169 INFO [Listener at localhost.localdomain/41921] ipc.NettyRpcServer(120): Bind to /136.243.18.41:41077 2023-07-29 00:53:26,170 INFO [Listener at localhost.localdomain/41921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:26,171 INFO [Listener at localhost.localdomain/41921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:26,172 INFO [Listener at localhost.localdomain/41921] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41077 connecting to ZooKeeper ensemble=127.0.0.1:61768 2023-07-29 00:53:26,177 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:410770x0, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-29 00:53:26,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41077-0x101ae904b200000 connected 2023-07-29 00:53:26,191 DEBUG [Listener at localhost.localdomain/41921] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-29 00:53:26,192 DEBUG [Listener at localhost.localdomain/41921] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:53:26,193 DEBUG [Listener at localhost.localdomain/41921] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-29 00:53:26,194 DEBUG [Listener at localhost.localdomain/41921] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41077 2023-07-29 00:53:26,194 DEBUG [Listener at localhost.localdomain/41921] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41077 2023-07-29 00:53:26,194 DEBUG [Listener at localhost.localdomain/41921] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41077 2023-07-29 00:53:26,195 DEBUG [Listener at localhost.localdomain/41921] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41077 2023-07-29 00:53:26,195 DEBUG [Listener at localhost.localdomain/41921] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41077 2023-07-29 00:53:26,195 INFO [Listener at localhost.localdomain/41921] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33, hbase.cluster.distributed=false 2023-07-29 00:53:26,206 INFO [Listener at localhost.localdomain/41921] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-29 00:53:26,206 INFO [Listener at localhost.localdomain/41921] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:53:26,206 INFO [Listener at localhost.localdomain/41921] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-29 00:53:26,206 INFO [Listener at localhost.localdomain/41921] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-29 00:53:26,207 INFO [Listener at localhost.localdomain/41921] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:53:26,207 INFO [Listener at localhost.localdomain/41921] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-29 00:53:26,207 INFO [Listener at localhost.localdomain/41921] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-29 00:53:26,209 INFO [Listener at localhost.localdomain/41921] ipc.NettyRpcServer(120): Bind to /136.243.18.41:44161 2023-07-29 00:53:26,209 INFO [Listener at localhost.localdomain/41921] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-29 00:53:26,210 DEBUG [Listener at localhost.localdomain/41921] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-29 00:53:26,211 INFO [Listener at localhost.localdomain/41921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:26,213 INFO [Listener at localhost.localdomain/41921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:26,213 INFO [Listener at localhost.localdomain/41921] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44161 connecting to ZooKeeper ensemble=127.0.0.1:61768 2023-07-29 00:53:26,216 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:441610x0, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-29 00:53:26,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44161-0x101ae904b200001 connected 2023-07-29 00:53:26,217 DEBUG [Listener at localhost.localdomain/41921] zookeeper.ZKUtil(164): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-29 00:53:26,218 DEBUG [Listener at localhost.localdomain/41921] zookeeper.ZKUtil(164): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:53:26,219 DEBUG [Listener at localhost.localdomain/41921] zookeeper.ZKUtil(164): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-29 00:53:26,219 DEBUG [Listener at localhost.localdomain/41921] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44161 2023-07-29 00:53:26,219 DEBUG [Listener at localhost.localdomain/41921] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44161 2023-07-29 00:53:26,219 DEBUG [Listener at localhost.localdomain/41921] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44161 2023-07-29 00:53:26,220 DEBUG [Listener at localhost.localdomain/41921] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44161 2023-07-29 00:53:26,220 DEBUG [Listener at localhost.localdomain/41921] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44161 2023-07-29 00:53:26,221 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,41077,1690592006167 2023-07-29 00:53:26,222 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-29 00:53:26,222 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,41077,1690592006167 2023-07-29 00:53:26,223 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-29 00:53:26,223 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-29 00:53:26,223 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:26,225 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-29 00:53:26,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-29 00:53:26,225 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,41077,1690592006167 from backup master directory 2023-07-29 00:53:26,226 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,41077,1690592006167 2023-07-29 00:53:26,226 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-29 00:53:26,226 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-29 00:53:26,226 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,41077,1690592006167 2023-07-29 00:53:26,247 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/hbase.id with ID: 727ec2b7-7191-4b67-a355-c8ff9961adf0 2023-07-29 00:53:26,262 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:26,264 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:26,274 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5e7aef02 to 127.0.0.1:61768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-29 00:53:26,278 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2944525f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-29 00:53:26,278 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-29 00:53:26,278 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-29 00:53:26,279 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-29 00:53:26,280 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/MasterData/data/master/store-tmp 2023-07-29 00:53:26,293 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:26,293 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-29 00:53:26,293 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:53:26,293 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:53:26,293 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-29 00:53:26,293 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:53:26,293 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:53:26,293 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-29 00:53:26,294 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/MasterData/WALs/jenkins-hbase17.apache.org,41077,1690592006167 2023-07-29 00:53:26,298 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C41077%2C1690592006167, suffix=, logDir=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/MasterData/WALs/jenkins-hbase17.apache.org,41077,1690592006167, archiveDir=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/MasterData/oldWALs, maxLogs=10 2023-07-29 00:53:26,312 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-813192f0-acde-4c18-93a2-120089776908,DISK] 2023-07-29 00:53:26,314 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35365,DS-6ad71e06-f94f-4b45-b9bf-64ce9934c115,DISK] 2023-07-29 00:53:26,317 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/MasterData/WALs/jenkins-hbase17.apache.org,41077,1690592006167/jenkins-hbase17.apache.org%2C41077%2C1690592006167.1690592006298 2023-07-29 00:53:26,317 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34351,DS-813192f0-acde-4c18-93a2-120089776908,DISK], DatanodeInfoWithStorage[127.0.0.1:35365,DS-6ad71e06-f94f-4b45-b9bf-64ce9934c115,DISK]] 2023-07-29 00:53:26,317 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-29 00:53:26,317 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:26,318 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:53:26,318 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:53:26,320 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:53:26,322 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-29 00:53:26,323 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-29 00:53:26,324 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:26,325 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:53:26,326 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:53:26,330 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:53:26,333 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-29 00:53:26,334 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=783801, jitterRate=-0.0033465921878814697}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-29 00:53:26,334 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-29 00:53:26,334 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-29 00:53:26,335 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-29 00:53:26,335 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-29 00:53:26,335 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-29 00:53:26,336 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-29 00:53:26,336 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-07-29 00:53:26,337 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-29 00:53:26,338 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-29 00:53:26,340 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-29 00:53:26,349 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-29 00:53:26,349 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-29 00:53:26,350 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-29 00:53:26,350 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-29 00:53:26,351 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-29 00:53:26,353 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:26,354 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-29 00:53:26,354 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-29 00:53:26,355 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-29 00:53:26,356 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-29 00:53:26,356 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-29 00:53:26,356 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:26,357 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,41077,1690592006167, sessionid=0x101ae904b200000, setting cluster-up flag (Was=false) 2023-07-29 00:53:26,360 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:26,362 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-29 00:53:26,363 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,41077,1690592006167 2023-07-29 00:53:26,365 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:26,368 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-29 00:53:26,369 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,41077,1690592006167 2023-07-29 00:53:26,369 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/.hbase-snapshot/.tmp 2023-07-29 00:53:26,371 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-29 00:53:26,372 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:53:26,372 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:53:26,372 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:53:26,372 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:53:26,372 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-07-29 00:53:26,372 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:26,372 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-29 00:53:26,372 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:26,377 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690592036377 2023-07-29 00:53:26,378 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-29 00:53:26,378 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-29 00:53:26,378 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-29 00:53:26,378 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-29 00:53:26,378 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-29 00:53:26,378 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-29 00:53:26,378 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:26,379 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-29 00:53:26,379 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-29 00:53:26,379 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-29 00:53:26,379 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-29 00:53:26,380 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-29 00:53:26,381 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-29 00:53:26,381 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-29 00:53:26,381 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-29 00:53:26,383 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690592006382,5,FailOnTimeoutGroup] 2023-07-29 00:53:26,384 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690592006383,5,FailOnTimeoutGroup] 2023-07-29 00:53:26,384 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:26,384 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-29 00:53:26,384 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:26,384 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:26,399 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-29 00:53:26,400 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-29 00:53:26,400 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33 2023-07-29 00:53:26,409 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:26,410 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-29 00:53:26,413 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/info 2023-07-29 00:53:26,414 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-29 00:53:26,415 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:26,415 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-29 00:53:26,416 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/rep_barrier 2023-07-29 00:53:26,417 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-29 00:53:26,417 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:26,418 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-29 00:53:26,419 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/table 2023-07-29 00:53:26,420 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-29 00:53:26,420 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:26,422 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740 2023-07-29 00:53:26,423 INFO [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(951): ClusterId : 727ec2b7-7191-4b67-a355-c8ff9961adf0 2023-07-29 00:53:26,424 DEBUG [RS:0;jenkins-hbase17:44161] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-29 00:53:26,424 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740 2023-07-29 00:53:26,426 DEBUG [RS:0;jenkins-hbase17:44161] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-29 00:53:26,426 DEBUG [RS:0;jenkins-hbase17:44161] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-29 00:53:26,428 DEBUG [RS:0;jenkins-hbase17:44161] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-29 00:53:26,429 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-29 00:53:26,429 DEBUG [RS:0;jenkins-hbase17:44161] zookeeper.ReadOnlyZKClient(139): Connect 0x72653249 to 127.0.0.1:61768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-29 00:53:26,432 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-29 00:53:26,433 DEBUG [RS:0;jenkins-hbase17:44161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ca2c275, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-29 00:53:26,434 DEBUG [RS:0;jenkins-hbase17:44161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@789d5939, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-29 00:53:26,435 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-29 00:53:26,436 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=780762, jitterRate=-0.007210046052932739}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-29 00:53:26,436 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-29 00:53:26,436 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-29 00:53:26,436 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-29 00:53:26,436 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-29 00:53:26,437 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-29 00:53:26,437 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-29 00:53:26,437 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-29 00:53:26,437 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-29 00:53:26,438 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-29 00:53:26,438 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-29 00:53:26,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-29 00:53:26,440 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-29 00:53:26,442 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-29 00:53:26,445 DEBUG [RS:0;jenkins-hbase17:44161] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:44161 2023-07-29 00:53:26,445 INFO [RS:0;jenkins-hbase17:44161] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-29 00:53:26,445 INFO [RS:0;jenkins-hbase17:44161] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-29 00:53:26,445 DEBUG [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(1022): About to register with Master. 2023-07-29 00:53:26,446 INFO [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,41077,1690592006167 with isa=jenkins-hbase17.apache.org/136.243.18.41:44161, startcode=1690592006206 2023-07-29 00:53:26,446 DEBUG [RS:0;jenkins-hbase17:44161] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-29 00:53:26,449 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51919, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-29 00:53:26,450 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41077] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:26,450 DEBUG [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33 2023-07-29 00:53:26,450 DEBUG [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:34795 2023-07-29 00:53:26,450 DEBUG [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-29 00:53:26,452 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-29 00:53:26,452 DEBUG [RS:0;jenkins-hbase17:44161] zookeeper.ZKUtil(162): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:26,452 WARN [RS:0;jenkins-hbase17:44161] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-29 00:53:26,452 INFO [RS:0;jenkins-hbase17:44161] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-29 00:53:26,453 DEBUG [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:26,453 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,44161,1690592006206] 2023-07-29 00:53:26,457 DEBUG [RS:0;jenkins-hbase17:44161] zookeeper.ZKUtil(162): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:26,458 DEBUG [RS:0;jenkins-hbase17:44161] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-29 00:53:26,458 INFO [RS:0;jenkins-hbase17:44161] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-29 00:53:26,460 INFO [RS:0;jenkins-hbase17:44161] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-29 00:53:26,464 INFO [RS:0;jenkins-hbase17:44161] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-29 00:53:26,464 INFO [RS:0;jenkins-hbase17:44161] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:26,464 INFO [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-29 00:53:26,466 INFO [RS:0;jenkins-hbase17:44161] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:26,466 DEBUG [RS:0;jenkins-hbase17:44161] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:26,466 DEBUG [RS:0;jenkins-hbase17:44161] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:26,466 DEBUG [RS:0;jenkins-hbase17:44161] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:26,466 DEBUG [RS:0;jenkins-hbase17:44161] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:26,466 DEBUG [RS:0;jenkins-hbase17:44161] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:26,467 DEBUG [RS:0;jenkins-hbase17:44161] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-29 00:53:26,467 DEBUG [RS:0;jenkins-hbase17:44161] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:26,467 DEBUG [RS:0;jenkins-hbase17:44161] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:26,467 DEBUG [RS:0;jenkins-hbase17:44161] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:26,467 DEBUG [RS:0;jenkins-hbase17:44161] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:53:26,468 INFO [RS:0;jenkins-hbase17:44161] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:26,468 INFO [RS:0;jenkins-hbase17:44161] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:26,469 INFO [RS:0;jenkins-hbase17:44161] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:26,478 INFO [RS:0;jenkins-hbase17:44161] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-29 00:53:26,478 INFO [RS:0;jenkins-hbase17:44161] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,44161,1690592006206-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:26,489 INFO [RS:0;jenkins-hbase17:44161] regionserver.Replication(203): jenkins-hbase17.apache.org,44161,1690592006206 started 2023-07-29 00:53:26,489 INFO [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,44161,1690592006206, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:44161, sessionid=0x101ae904b200001 2023-07-29 00:53:26,489 DEBUG [RS:0;jenkins-hbase17:44161] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-29 00:53:26,489 DEBUG [RS:0;jenkins-hbase17:44161] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:26,489 DEBUG [RS:0;jenkins-hbase17:44161] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,44161,1690592006206' 2023-07-29 00:53:26,489 DEBUG [RS:0;jenkins-hbase17:44161] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-29 00:53:26,490 DEBUG [RS:0;jenkins-hbase17:44161] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-29 00:53:26,490 DEBUG [RS:0;jenkins-hbase17:44161] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-29 00:53:26,490 DEBUG [RS:0;jenkins-hbase17:44161] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-29 00:53:26,490 DEBUG [RS:0;jenkins-hbase17:44161] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:26,490 DEBUG [RS:0;jenkins-hbase17:44161] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,44161,1690592006206' 2023-07-29 00:53:26,490 DEBUG [RS:0;jenkins-hbase17:44161] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-29 00:53:26,490 DEBUG [RS:0;jenkins-hbase17:44161] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-29 00:53:26,491 DEBUG [RS:0;jenkins-hbase17:44161] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-29 00:53:26,491 INFO [RS:0;jenkins-hbase17:44161] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-29 00:53:26,491 INFO [RS:0;jenkins-hbase17:44161] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-29 00:53:26,592 DEBUG [jenkins-hbase17:41077] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-29 00:53:26,594 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,44161,1690592006206, state=OPENING 2023-07-29 00:53:26,595 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-29 00:53:26,596 INFO [RS:0;jenkins-hbase17:44161] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C44161%2C1690592006206, suffix=, logDir=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206, archiveDir=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/oldWALs, maxLogs=32 2023-07-29 00:53:26,597 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:26,599 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,44161,1690592006206}] 2023-07-29 00:53:26,599 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-29 00:53:26,617 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-813192f0-acde-4c18-93a2-120089776908,DISK] 2023-07-29 00:53:26,617 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35365,DS-6ad71e06-f94f-4b45-b9bf-64ce9934c115,DISK] 2023-07-29 00:53:26,619 INFO [RS:0;jenkins-hbase17:44161] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206/jenkins-hbase17.apache.org%2C44161%2C1690592006206.1690592006601 2023-07-29 00:53:26,619 DEBUG [RS:0;jenkins-hbase17:44161] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35365,DS-6ad71e06-f94f-4b45-b9bf-64ce9934c115,DISK], DatanodeInfoWithStorage[127.0.0.1:34351,DS-813192f0-acde-4c18-93a2-120089776908,DISK]] 2023-07-29 00:53:26,756 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:26,756 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-29 00:53:26,761 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-29 00:53:26,770 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-29 00:53:26,770 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-29 00:53:26,773 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C44161%2C1690592006206.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206, archiveDir=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/oldWALs, maxLogs=32 2023-07-29 00:53:26,794 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-813192f0-acde-4c18-93a2-120089776908,DISK] 2023-07-29 00:53:26,794 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35365,DS-6ad71e06-f94f-4b45-b9bf-64ce9934c115,DISK] 2023-07-29 00:53:26,797 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206/jenkins-hbase17.apache.org%2C44161%2C1690592006206.meta.1690592006775.meta 2023-07-29 00:53:26,797 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34351,DS-813192f0-acde-4c18-93a2-120089776908,DISK], DatanodeInfoWithStorage[127.0.0.1:35365,DS-6ad71e06-f94f-4b45-b9bf-64ce9934c115,DISK]] 2023-07-29 00:53:26,797 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-29 00:53:26,797 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-29 00:53:26,798 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-29 00:53:26,799 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-29 00:53:26,799 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-29 00:53:26,799 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:26,799 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-29 00:53:26,799 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-29 00:53:26,801 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-29 00:53:26,802 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/info 2023-07-29 00:53:26,802 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/info 2023-07-29 00:53:26,803 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-29 00:53:26,804 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:26,804 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-29 00:53:26,805 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/rep_barrier 2023-07-29 00:53:26,805 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/rep_barrier 2023-07-29 00:53:26,806 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-29 00:53:26,807 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:26,807 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-29 00:53:26,808 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/table 2023-07-29 00:53:26,808 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/table 2023-07-29 00:53:26,810 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-29 00:53:26,810 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:26,811 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740 2023-07-29 00:53:26,814 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740 2023-07-29 00:53:26,816 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-29 00:53:26,819 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-29 00:53:26,820 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=825565, jitterRate=0.049760594964027405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-29 00:53:26,820 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-29 00:53:26,822 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690592006756 2023-07-29 00:53:26,826 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-29 00:53:26,827 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-29 00:53:26,827 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,44161,1690592006206, state=OPEN 2023-07-29 00:53:26,829 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-29 00:53:26,829 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-29 00:53:26,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-29 00:53:26,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,44161,1690592006206 in 231 msec 2023-07-29 00:53:26,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-29 00:53:26,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 393 msec 2023-07-29 00:53:26,837 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 465 msec 2023-07-29 00:53:26,837 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690592006837, completionTime=-1 2023-07-29 00:53:26,838 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-29 00:53:26,838 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-29 00:53:26,842 DEBUG [hconnection-0x48ea7e4c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-29 00:53:26,844 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59412, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-29 00:53:26,845 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-29 00:53:26,845 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690592066845 2023-07-29 00:53:26,845 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690592126845 2023-07-29 00:53:26,846 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 7 msec 2023-07-29 00:53:26,851 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,41077,1690592006167-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:26,852 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,41077,1690592006167-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:26,852 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,41077,1690592006167-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:26,852 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:41077, period=300000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:26,852 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-29 00:53:26,852 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-29 00:53:26,852 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-29 00:53:26,853 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-29 00:53:26,853 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-29 00:53:26,855 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-29 00:53:26,856 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-29 00:53:26,858 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/.tmp/data/hbase/namespace/3e132e71015a0af5c9c9cc18ee74b1f5 2023-07-29 00:53:26,858 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/.tmp/data/hbase/namespace/3e132e71015a0af5c9c9cc18ee74b1f5 empty. 2023-07-29 00:53:26,859 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/.tmp/data/hbase/namespace/3e132e71015a0af5c9c9cc18ee74b1f5 2023-07-29 00:53:26,859 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-29 00:53:26,875 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-29 00:53:26,876 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3e132e71015a0af5c9c9cc18ee74b1f5, NAME => 'hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/.tmp 2023-07-29 00:53:26,887 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:26,887 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 3e132e71015a0af5c9c9cc18ee74b1f5, disabling compactions & flushes 2023-07-29 00:53:26,887 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. 2023-07-29 00:53:26,888 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. 2023-07-29 00:53:26,888 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. after waiting 0 ms 2023-07-29 00:53:26,888 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. 2023-07-29 00:53:26,888 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. 2023-07-29 00:53:26,888 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 3e132e71015a0af5c9c9cc18ee74b1f5: 2023-07-29 00:53:26,890 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-29 00:53:26,892 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690592006892"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690592006892"}]},"ts":"1690592006892"} 2023-07-29 00:53:26,895 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-29 00:53:26,896 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-29 00:53:26,896 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690592006896"}]},"ts":"1690592006896"} 2023-07-29 00:53:26,898 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-29 00:53:26,902 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3e132e71015a0af5c9c9cc18ee74b1f5, ASSIGN}] 2023-07-29 00:53:26,904 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3e132e71015a0af5c9c9cc18ee74b1f5, ASSIGN 2023-07-29 00:53:26,905 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3e132e71015a0af5c9c9cc18ee74b1f5, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44161,1690592006206; forceNewPlan=false, retain=false 2023-07-29 00:53:27,056 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3e132e71015a0af5c9c9cc18ee74b1f5, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:27,056 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690592007056"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690592007056"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690592007056"}]},"ts":"1690592007056"} 2023-07-29 00:53:27,060 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3e132e71015a0af5c9c9cc18ee74b1f5, server=jenkins-hbase17.apache.org,44161,1690592006206}] 2023-07-29 00:53:27,228 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. 2023-07-29 00:53:27,228 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3e132e71015a0af5c9c9cc18ee74b1f5, NAME => 'hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5.', STARTKEY => '', ENDKEY => ''} 2023-07-29 00:53:27,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3e132e71015a0af5c9c9cc18ee74b1f5 2023-07-29 00:53:27,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:27,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 3e132e71015a0af5c9c9cc18ee74b1f5 2023-07-29 00:53:27,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 3e132e71015a0af5c9c9cc18ee74b1f5 2023-07-29 00:53:27,231 INFO [StoreOpener-3e132e71015a0af5c9c9cc18ee74b1f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3e132e71015a0af5c9c9cc18ee74b1f5 2023-07-29 00:53:27,232 DEBUG [StoreOpener-3e132e71015a0af5c9c9cc18ee74b1f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/namespace/3e132e71015a0af5c9c9cc18ee74b1f5/info 2023-07-29 00:53:27,232 DEBUG [StoreOpener-3e132e71015a0af5c9c9cc18ee74b1f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/namespace/3e132e71015a0af5c9c9cc18ee74b1f5/info 2023-07-29 00:53:27,233 INFO [StoreOpener-3e132e71015a0af5c9c9cc18ee74b1f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e132e71015a0af5c9c9cc18ee74b1f5 columnFamilyName info 2023-07-29 00:53:27,233 INFO [StoreOpener-3e132e71015a0af5c9c9cc18ee74b1f5-1] regionserver.HStore(310): Store=3e132e71015a0af5c9c9cc18ee74b1f5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:27,234 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/namespace/3e132e71015a0af5c9c9cc18ee74b1f5 2023-07-29 00:53:27,235 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/namespace/3e132e71015a0af5c9c9cc18ee74b1f5 2023-07-29 00:53:27,238 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 3e132e71015a0af5c9c9cc18ee74b1f5 2023-07-29 00:53:27,241 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/namespace/3e132e71015a0af5c9c9cc18ee74b1f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-29 00:53:27,241 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 3e132e71015a0af5c9c9cc18ee74b1f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=880492, jitterRate=0.11960351467132568}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-29 00:53:27,242 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 3e132e71015a0af5c9c9cc18ee74b1f5: 2023-07-29 00:53:27,243 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5., pid=6, masterSystemTime=1690592007215 2023-07-29 00:53:27,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. 2023-07-29 00:53:27,248 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. 2023-07-29 00:53:27,250 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3e132e71015a0af5c9c9cc18ee74b1f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:27,250 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690592007249"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690592007249"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690592007249"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690592007249"}]},"ts":"1690592007249"} 2023-07-29 00:53:27,257 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-29 00:53:27,257 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3e132e71015a0af5c9c9cc18ee74b1f5, server=jenkins-hbase17.apache.org,44161,1690592006206 in 193 msec 2023-07-29 00:53:27,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-29 00:53:27,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3e132e71015a0af5c9c9cc18ee74b1f5, ASSIGN in 355 msec 2023-07-29 00:53:27,261 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-29 00:53:27,262 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690592007261"}]},"ts":"1690592007261"} 2023-07-29 00:53:27,263 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-29 00:53:27,265 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-29 00:53:27,267 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 413 msec 2023-07-29 00:53:27,355 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-29 00:53:27,357 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-29 00:53:27,357 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:27,364 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-29 00:53:27,376 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-29 00:53:27,379 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 15 msec 2023-07-29 00:53:27,388 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-29 00:53:27,396 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-29 00:53:27,400 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-07-29 00:53:27,412 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-29 00:53:27,413 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-29 00:53:27,413 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.186sec 2023-07-29 00:53:27,414 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-29 00:53:27,414 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-29 00:53:27,414 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-29 00:53:27,414 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,41077,1690592006167-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-29 00:53:27,414 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,41077,1690592006167-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-29 00:53:27,416 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-29 00:53:27,423 DEBUG [Listener at localhost.localdomain/41921] zookeeper.ReadOnlyZKClient(139): Connect 0x2194d714 to 127.0.0.1:61768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-29 00:53:27,428 DEBUG [Listener at localhost.localdomain/41921] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e45ccc0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-29 00:53:27,431 DEBUG [hconnection-0x6091007f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-29 00:53:27,434 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-29 00:53:27,437 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,41077,1690592006167 2023-07-29 00:53:27,438 INFO [Listener at localhost.localdomain/41921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:53:27,443 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-29 00:53:27,443 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:53:27,444 INFO [Listener at localhost.localdomain/41921] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-29 00:53:27,446 DEBUG [Listener at localhost.localdomain/41921] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-29 00:53:27,449 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-29 00:53:27,451 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-07-29 00:53:27,451 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-07-29 00:53:27,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-29 00:53:27,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:27,456 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-07-29 00:53:27,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testCompactionRecordDoesntBlockRolling" procId is: 9 2023-07-29 00:53:27,457 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-29 00:53:27,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-29 00:53:27,459 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d 2023-07-29 00:53:27,460 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d empty. 2023-07-29 00:53:27,460 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d 2023-07-29 00:53:27,460 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testCompactionRecordDoesntBlockRolling regions 2023-07-29 00:53:27,473 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/.tabledesc/.tableinfo.0000000001 2023-07-29 00:53:27,474 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => cb6edeb50f5a97566e65d53ecff6401d, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/.tmp 2023-07-29 00:53:27,485 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:27,485 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1604): Closing cb6edeb50f5a97566e65d53ecff6401d, disabling compactions & flushes 2023-07-29 00:53:27,485 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:53:27,485 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:53:27,485 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. after waiting 0 ms 2023-07-29 00:53:27,485 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:53:27,485 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:53:27,485 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1558): Region close journal for cb6edeb50f5a97566e65d53ecff6401d: 2023-07-29 00:53:27,488 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ADD_TO_META 2023-07-29 00:53:27,490 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1690592007490"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690592007490"}]},"ts":"1690592007490"} 2023-07-29 00:53:27,492 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-29 00:53:27,493 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-29 00:53:27,494 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690592007494"}]},"ts":"1690592007494"} 2023-07-29 00:53:27,496 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLING in hbase:meta 2023-07-29 00:53:27,499 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=cb6edeb50f5a97566e65d53ecff6401d, ASSIGN}] 2023-07-29 00:53:27,501 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=cb6edeb50f5a97566e65d53ecff6401d, ASSIGN 2023-07-29 00:53:27,502 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=cb6edeb50f5a97566e65d53ecff6401d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44161,1690592006206; forceNewPlan=false, retain=false 2023-07-29 00:53:27,653 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=cb6edeb50f5a97566e65d53ecff6401d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:27,653 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1690592007653"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690592007653"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690592007653"}]},"ts":"1690592007653"} 2023-07-29 00:53:27,656 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure cb6edeb50f5a97566e65d53ecff6401d, server=jenkins-hbase17.apache.org,44161,1690592006206}] 2023-07-29 00:53:27,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:53:27,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb6edeb50f5a97566e65d53ecff6401d, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d.', STARTKEY => '', ENDKEY => ''} 2023-07-29 00:53:27,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testCompactionRecordDoesntBlockRolling cb6edeb50f5a97566e65d53ecff6401d 2023-07-29 00:53:27,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:53:27,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for cb6edeb50f5a97566e65d53ecff6401d 2023-07-29 00:53:27,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for cb6edeb50f5a97566e65d53ecff6401d 2023-07-29 00:53:27,820 INFO [StoreOpener-cb6edeb50f5a97566e65d53ecff6401d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region cb6edeb50f5a97566e65d53ecff6401d 2023-07-29 00:53:27,823 DEBUG [StoreOpener-cb6edeb50f5a97566e65d53ecff6401d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info 2023-07-29 00:53:27,823 DEBUG [StoreOpener-cb6edeb50f5a97566e65d53ecff6401d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info 2023-07-29 00:53:27,824 INFO [StoreOpener-cb6edeb50f5a97566e65d53ecff6401d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb6edeb50f5a97566e65d53ecff6401d columnFamilyName info 2023-07-29 00:53:27,825 INFO [StoreOpener-cb6edeb50f5a97566e65d53ecff6401d-1] regionserver.HStore(310): Store=cb6edeb50f5a97566e65d53ecff6401d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:53:27,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d 2023-07-29 00:53:27,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d 2023-07-29 00:53:27,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for cb6edeb50f5a97566e65d53ecff6401d 2023-07-29 00:53:27,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-29 00:53:27,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened cb6edeb50f5a97566e65d53ecff6401d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=738767, jitterRate=-0.06061035394668579}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-29 00:53:27,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for cb6edeb50f5a97566e65d53ecff6401d: 2023-07-29 00:53:27,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d., pid=11, masterSystemTime=1690592007809 2023-07-29 00:53:27,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:53:27,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:53:27,842 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=cb6edeb50f5a97566e65d53ecff6401d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:27,842 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1690592007842"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690592007842"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690592007842"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690592007842"}]},"ts":"1690592007842"} 2023-07-29 00:53:27,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-29 00:53:27,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure cb6edeb50f5a97566e65d53ecff6401d, server=jenkins-hbase17.apache.org,44161,1690592006206 in 189 msec 2023-07-29 00:53:27,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-29 00:53:27,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=cb6edeb50f5a97566e65d53ecff6401d, ASSIGN in 350 msec 2023-07-29 00:53:27,853 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-29 00:53:27,853 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690592007853"}]},"ts":"1690592007853"} 2023-07-29 00:53:27,855 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLED in hbase:meta 2023-07-29 00:53:27,858 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_POST_OPERATION 2023-07-29 00:53:27,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling in 406 msec 2023-07-29 00:53:27,888 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-29 00:53:31,883 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-29 00:53:31,883 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-29 00:53:32,458 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-29 00:53:32,459 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-29 00:53:32,460 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-29 00:53:33,320 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-29 00:53:37,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-29 00:53:37,459 INFO [Listener at localhost.localdomain/41921] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testCompactionRecordDoesntBlockRolling, procId: 9 completed 2023-07-29 00:53:37,462 DEBUG [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:37,462 DEBUG [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:53:37,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-29 00:53:37,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] procedure.ProcedureCoordinator(165): Submitting procedure hbase:namespace 2023-07-29 00:53:37,484 INFO [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase:namespace' 2023-07-29 00:53:37,484 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-29 00:53:37,484 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase:namespace' starting 'acquire' 2023-07-29 00:53:37,484 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase:namespace', kicking off acquire phase on members. 2023-07-29 00:53:37,485 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-07-29 00:53:37,485 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-29 00:53:37,486 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-29 00:53:37,486 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-29 00:53:37,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-29 00:53:37,486 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,487 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-29 00:53:37,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase:namespace 2023-07-29 00:53:37,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-07-29 00:53:37,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-29 00:53:37,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-29 00:53:37,488 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase:namespace 2023-07-29 00:53:37,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase:namespace 2023-07-29 00:53:37,490 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase:namespace' with timeout 60000ms 2023-07-29 00:53:37,490 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-29 00:53:37,491 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase:namespace' starting 'acquire' stage 2023-07-29 00:53:37,491 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-29 00:53:37,491 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-29 00:53:37,491 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. 2023-07-29 00:53:37,491 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. started... 2023-07-29 00:53:37,492 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3e132e71015a0af5c9c9cc18ee74b1f5 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-29 00:53:37,512 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/namespace/3e132e71015a0af5c9c9cc18ee74b1f5/.tmp/info/6191216b1be2458f86d19a70aaaf4077 2023-07-29 00:53:37,521 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/namespace/3e132e71015a0af5c9c9cc18ee74b1f5/.tmp/info/6191216b1be2458f86d19a70aaaf4077 as hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/namespace/3e132e71015a0af5c9c9cc18ee74b1f5/info/6191216b1be2458f86d19a70aaaf4077 2023-07-29 00:53:37,528 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/namespace/3e132e71015a0af5c9c9cc18ee74b1f5/info/6191216b1be2458f86d19a70aaaf4077, entries=2, sequenceid=6, filesize=4.8 K 2023-07-29 00:53:37,529 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3e132e71015a0af5c9c9cc18ee74b1f5 in 37ms, sequenceid=6, compaction requested=false 2023-07-29 00:53:37,530 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3e132e71015a0af5c9c9cc18ee74b1f5: 2023-07-29 00:53:37,530 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. 2023-07-29 00:53:37,530 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-29 00:53:37,530 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-29 00:53:37,530 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,530 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase:namespace' locally acquired 2023-07-29 00:53:37,530 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44161,1690592006206' joining acquired barrier for procedure (hbase:namespace) in zk 2023-07-29 00:53:37,532 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-29 00:53:37,532 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-29 00:53:37,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-29 00:53:37,532 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace 2023-07-29 00:53:37,532 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase:namespace' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-29 00:53:37,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-29 00:53:37,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-29 00:53:37,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-29 00:53:37,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-29 00:53:37,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44161,1690592006206' joining acquired barrier for procedure 'hbase:namespace' on coordinator 2023-07-29 00:53:37,534 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase:namespace' starting 'in-barrier' execution. 2023-07-29 00:53:37,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2de0bcad[Count = 0] remaining members to acquire global barrier 2023-07-29 00:53:37,534 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-29 00:53:37,536 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-07-29 00:53:37,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-29 00:53:37,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-29 00:53:37,536 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase:namespace' received 'reached' from coordinator. 2023-07-29 00:53:37,536 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase:namespace' locally completed 2023-07-29 00:53:37,536 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,536 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase:namespace' completed for member 'jenkins-hbase17.apache.org,44161,1690592006206' in zk 2023-07-29 00:53:37,536 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-29 00:53:37,537 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,537 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase:namespace' has notified controller of completion 2023-07-29 00:53:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-29 00:53:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-29 00:53:37,537 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-29 00:53:37,537 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase:namespace' completed. 2023-07-29 00:53:37,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-29 00:53:37,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-29 00:53:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-29 00:53:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-29 00:53:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-29 00:53:37,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase:namespace' member 'jenkins-hbase17.apache.org,44161,1690592006206': 2023-07-29 00:53:37,541 INFO [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase:namespace' execution completed 2023-07-29 00:53:37,541 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-29 00:53:37,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44161,1690592006206' released barrier for procedure'hbase:namespace', counting down latch. Waiting for 0 more 2023-07-29 00:53:37,541 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-29 00:53:37,541 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase:namespace 2023-07-29 00:53:37,541 INFO [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase:namespaceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-29 00:53:37,542 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-07-29 00:53:37,542 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-07-29 00:53:37,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase:namespace 2023-07-29 00:53:37,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-29 00:53:37,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase:namespace 2023-07-29 00:53:37,542 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-29 00:53:37,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-07-29 00:53:37,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-29 00:53:37,543 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-29 00:53:37,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-29 00:53:37,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-29 00:53:37,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-07-29 00:53:37,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-29 00:53:37,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-29 00:53:37,544 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-29 00:53:37,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-29 00:53:37,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-29 00:53:37,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,548 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-29 00:53:37,548 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,548 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-29 00:53:37,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-29 00:53:37,549 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-29 00:53:37,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase:namespace' 2023-07-29 00:53:37,549 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-29 00:53:37,549 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-29 00:53:37,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-29 00:53:37,549 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:37,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-29 00:53:37,549 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-07-29 00:53:37,550 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-07-29 00:53:37,550 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-07-29 00:53:37,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-29 00:53:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-29 00:53:37,551 DEBUG [Listener at localhost.localdomain/41921] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase:namespace'' to complete. (max 20000 ms per retry) 2023-07-29 00:53:37,552 DEBUG [Listener at localhost.localdomain/41921] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-29 00:53:47,552 DEBUG [Listener at localhost.localdomain/41921] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-29 00:53:47,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-29 00:53:47,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-29 00:53:47,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,579 INFO [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-29 00:53:47,579 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-29 00:53:47,580 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-29 00:53:47,580 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-29 00:53:47,581 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,581 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,582 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-29 00:53:47,582 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-29 00:53:47,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-29 00:53:47,582 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,583 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-29 00:53:47,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-29 00:53:47,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,584 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,584 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,584 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-29 00:53:47,584 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-29 00:53:47,585 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-29 00:53:47,585 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-29 00:53:47,585 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-29 00:53:47,585 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:53:47,585 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. started... 2023-07-29 00:53:47,586 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb6edeb50f5a97566e65d53ecff6401d 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-29 00:53:47,606 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/.tmp/info/6c00cec01d984897b7089d7718178a59 2023-07-29 00:53:47,615 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/.tmp/info/6c00cec01d984897b7089d7718178a59 as hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/6c00cec01d984897b7089d7718178a59 2023-07-29 00:53:47,622 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/6c00cec01d984897b7089d7718178a59, entries=1, sequenceid=5, filesize=5.8 K 2023-07-29 00:53:47,624 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for cb6edeb50f5a97566e65d53ecff6401d in 38ms, sequenceid=5, compaction requested=false 2023-07-29 00:53:47,624 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb6edeb50f5a97566e65d53ecff6401d: 2023-07-29 00:53:47,624 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:53:47,625 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-29 00:53:47,625 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-29 00:53:47,625 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,625 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-29 00:53:47,625 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44161,1690592006206' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-29 00:53:47,626 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,626 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-29 00:53:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-29 00:53:47,627 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,627 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-29 00:53:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-29 00:53:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-29 00:53:47,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-29 00:53:47,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44161,1690592006206' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-29 00:53:47,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29df2dc9[Count = 0] remaining members to acquire global barrier 2023-07-29 00:53:47,628 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-29 00:53:47,629 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,629 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,629 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-29 00:53:47,629 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-29 00:53:47,629 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase17.apache.org,44161,1690592006206' in zk 2023-07-29 00:53:47,629 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,630 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-29 00:53:47,630 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,630 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-29 00:53:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-29 00:53:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-29 00:53:47,631 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-29 00:53:47,631 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-29 00:53:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-29 00:53:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-29 00:53:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-29 00:53:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase17.apache.org,44161,1690592006206': 2023-07-29 00:53:47,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44161,1690592006206' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-29 00:53:47,634 INFO [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-29 00:53:47,634 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-29 00:53:47,634 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-29 00:53:47,634 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,634 INFO [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-29 00:53:47,637 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,637 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,637 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-29 00:53:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-29 00:53:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-29 00:53:47,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-29 00:53:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-29 00:53:47,638 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-29 00:53:47,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-29 00:53:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,639 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-29 00:53:47,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,641 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,641 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,641 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-29 00:53:47,641 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-29 00:53:47,642 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:47,642 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-29 00:53:47,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-07-29 00:53:47,641 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-29 00:53:47,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-29 00:53:47,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-29 00:53:47,642 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-29 00:53:47,642 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,642 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:47,643 DEBUG [Listener at localhost.localdomain/41921] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-29 00:53:47,643 DEBUG [Listener at localhost.localdomain/41921] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-29 00:53:47,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-29 00:53:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-29 00:53:57,643 DEBUG [Listener at localhost.localdomain/41921] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-29 00:53:57,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-29 00:53:57,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-29 00:53:57,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-07-29 00:53:57,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,660 INFO [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-29 00:53:57,660 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-29 00:53:57,661 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-29 00:53:57,661 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-29 00:53:57,662 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,662 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,663 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,663 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-29 00:53:57,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-29 00:53:57,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-29 00:53:57,664 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,664 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-29 00:53:57,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-29 00:53:57,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,665 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,665 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-07-29 00:53:57,665 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,665 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-29 00:53:57,665 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-29 00:53:57,666 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-29 00:53:57,666 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-29 00:53:57,666 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-29 00:53:57,666 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:53:57,666 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. started... 2023-07-29 00:53:57,667 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb6edeb50f5a97566e65d53ecff6401d 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-29 00:53:57,684 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/.tmp/info/e322502e223a4bf1a471389f7223d9ff 2023-07-29 00:53:57,694 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/.tmp/info/e322502e223a4bf1a471389f7223d9ff as hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/e322502e223a4bf1a471389f7223d9ff 2023-07-29 00:53:57,701 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/e322502e223a4bf1a471389f7223d9ff, entries=1, sequenceid=9, filesize=5.8 K 2023-07-29 00:53:57,702 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for cb6edeb50f5a97566e65d53ecff6401d in 34ms, sequenceid=9, compaction requested=false 2023-07-29 00:53:57,702 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb6edeb50f5a97566e65d53ecff6401d: 2023-07-29 00:53:57,702 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:53:57,702 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-29 00:53:57,702 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-29 00:53:57,702 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,702 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-29 00:53:57,702 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44161,1690592006206' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-29 00:53:57,704 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,704 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-29 00:53:57,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-29 00:53:57,704 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,704 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-29 00:53:57,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-29 00:53:57,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-29 00:53:57,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-29 00:53:57,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44161,1690592006206' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-29 00:53:57,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cddb696[Count = 0] remaining members to acquire global barrier 2023-07-29 00:53:57,706 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-29 00:53:57,706 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,707 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,707 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-29 00:53:57,707 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-29 00:53:57,707 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase17.apache.org,44161,1690592006206' in zk 2023-07-29 00:53:57,707 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,707 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-29 00:53:57,708 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,708 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-29 00:53:57,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-29 00:53:57,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-29 00:53:57,708 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-29 00:53:57,708 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-29 00:53:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-29 00:53:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-29 00:53:57,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-29 00:53:57,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase17.apache.org,44161,1690592006206': 2023-07-29 00:53:57,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44161,1690592006206' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-29 00:53:57,711 INFO [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-29 00:53:57,711 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-29 00:53:57,711 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-29 00:53:57,711 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,711 INFO [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-29 00:53:57,712 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,713 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-29 00:53:57,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-29 00:53:57,713 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-29 00:53:57,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-29 00:53:57,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-29 00:53:57,713 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-29 00:53:57,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-29 00:53:57,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,715 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-29 00:53:57,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,717 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,717 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,717 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-29 00:53:57,717 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,718 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-29 00:53:57,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-29 00:53:57,718 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-29 00:53:57,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-29 00:53:57,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-07-29 00:53:57,718 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:53:57,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-29 00:53:57,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-29 00:53:57,718 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,719 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-29 00:53:57,719 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:53:57,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-29 00:53:57,719 DEBUG [Listener at localhost.localdomain/41921] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-29 00:53:57,719 DEBUG [Listener at localhost.localdomain/41921] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-29 00:54:07,719 DEBUG [Listener at localhost.localdomain/41921] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-29 00:54:07,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-29 00:54:07,741 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35365,DS-6ad71e06-f94f-4b45-b9bf-64ce9934c115,DISK] 2023-07-29 00:54:07,741 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-813192f0-acde-4c18-93a2-120089776908,DISK] 2023-07-29 00:54:07,744 INFO [Listener at localhost.localdomain/41921] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206/jenkins-hbase17.apache.org%2C44161%2C1690592006206.1690592006601 with entries=13, filesize=6.36 KB; new WAL /user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206/jenkins-hbase17.apache.org%2C44161%2C1690592006206.1690592047724 2023-07-29 00:54:07,744 DEBUG [Listener at localhost.localdomain/41921] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34351,DS-813192f0-acde-4c18-93a2-120089776908,DISK], DatanodeInfoWithStorage[127.0.0.1:35365,DS-6ad71e06-f94f-4b45-b9bf-64ce9934c115,DISK]] 2023-07-29 00:54:07,744 DEBUG [Listener at localhost.localdomain/41921] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206/jenkins-hbase17.apache.org%2C44161%2C1690592006206.1690592006601 is not closed yet, will try archiving it next time 2023-07-29 00:54:07,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-29 00:54:07,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-07-29 00:54:07,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,755 INFO [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-29 00:54:07,755 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-29 00:54:07,756 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-29 00:54:07,756 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-29 00:54:07,757 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,757 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,758 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-29 00:54:07,758 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-29 00:54:07,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-29 00:54:07,758 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,758 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-29 00:54:07,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-29 00:54:07,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,759 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,759 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-07-29 00:54:07,759 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,759 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-29 00:54:07,759 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-29 00:54:07,760 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-29 00:54:07,760 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-29 00:54:07,760 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-29 00:54:07,760 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:54:07,760 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. started... 2023-07-29 00:54:07,760 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb6edeb50f5a97566e65d53ecff6401d 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-29 00:54:07,771 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=13 (bloomFilter=true), to=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/.tmp/info/b30f270a8d3a41b5955b292489607b27 2023-07-29 00:54:07,780 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/.tmp/info/b30f270a8d3a41b5955b292489607b27 as hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/b30f270a8d3a41b5955b292489607b27 2023-07-29 00:54:07,787 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/b30f270a8d3a41b5955b292489607b27, entries=1, sequenceid=13, filesize=5.8 K 2023-07-29 00:54:07,788 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for cb6edeb50f5a97566e65d53ecff6401d in 28ms, sequenceid=13, compaction requested=true 2023-07-29 00:54:07,789 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb6edeb50f5a97566e65d53ecff6401d: 2023-07-29 00:54:07,789 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:54:07,789 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-29 00:54:07,789 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-29 00:54:07,789 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,789 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-29 00:54:07,789 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44161,1690592006206' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-29 00:54:07,791 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,791 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-29 00:54:07,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-29 00:54:07,791 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,791 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-29 00:54:07,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-29 00:54:07,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-29 00:54:07,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-29 00:54:07,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44161,1690592006206' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-29 00:54:07,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75d6373a[Count = 0] remaining members to acquire global barrier 2023-07-29 00:54:07,793 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-29 00:54:07,793 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,794 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,794 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-29 00:54:07,794 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-29 00:54:07,794 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase17.apache.org,44161,1690592006206' in zk 2023-07-29 00:54:07,794 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,795 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-29 00:54:07,795 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,795 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-29 00:54:07,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-29 00:54:07,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-29 00:54:07,796 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-29 00:54:07,796 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-29 00:54:07,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-29 00:54:07,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-29 00:54:07,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-29 00:54:07,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase17.apache.org,44161,1690592006206': 2023-07-29 00:54:07,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44161,1690592006206' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-29 00:54:07,800 INFO [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-29 00:54:07,800 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-29 00:54:07,800 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-29 00:54:07,800 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,800 INFO [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-29 00:54:07,801 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,801 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,801 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-29 00:54:07,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-29 00:54:07,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-29 00:54:07,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-29 00:54:07,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-29 00:54:07,802 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-29 00:54:07,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-29 00:54:07,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,804 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-29 00:54:07,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,807 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,807 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,807 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-29 00:54:07,807 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,807 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-29 00:54:07,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-29 00:54:07,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-07-29 00:54:07,807 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-29 00:54:07,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-29 00:54:07,807 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:07,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-29 00:54:07,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-29 00:54:07,808 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,808 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,808 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:07,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-29 00:54:07,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-29 00:54:07,809 DEBUG [Listener at localhost.localdomain/41921] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-29 00:54:07,809 DEBUG [Listener at localhost.localdomain/41921] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-29 00:54:17,809 DEBUG [Listener at localhost.localdomain/41921] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-29 00:54:17,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-29 00:54:17,815 DEBUG [Listener at localhost.localdomain/41921] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-29 00:54:17,823 DEBUG [Listener at localhost.localdomain/41921] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 17694 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-29 00:54:17,824 DEBUG [Listener at localhost.localdomain/41921] regionserver.HStore(1912): cb6edeb50f5a97566e65d53ecff6401d/info is initiating minor compaction (all files) 2023-07-29 00:54:17,825 INFO [Listener at localhost.localdomain/41921] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-29 00:54:17,825 INFO [Listener at localhost.localdomain/41921] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:17,825 INFO [Listener at localhost.localdomain/41921] regionserver.HRegion(2259): Starting compaction of cb6edeb50f5a97566e65d53ecff6401d/info in TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:54:17,825 INFO [Listener at localhost.localdomain/41921] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/6c00cec01d984897b7089d7718178a59, hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/e322502e223a4bf1a471389f7223d9ff, hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/b30f270a8d3a41b5955b292489607b27] into tmpdir=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/.tmp, totalSize=17.3 K 2023-07-29 00:54:17,826 DEBUG [Listener at localhost.localdomain/41921] compactions.Compactor(207): Compacting 6c00cec01d984897b7089d7718178a59, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1690592027567 2023-07-29 00:54:17,827 DEBUG [Listener at localhost.localdomain/41921] compactions.Compactor(207): Compacting e322502e223a4bf1a471389f7223d9ff, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1690592037647 2023-07-29 00:54:17,827 DEBUG [Listener at localhost.localdomain/41921] compactions.Compactor(207): Compacting b30f270a8d3a41b5955b292489607b27, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1690592047722 2023-07-29 00:54:17,850 INFO [Listener at localhost.localdomain/41921] throttle.PressureAwareThroughputController(145): cb6edeb50f5a97566e65d53ecff6401d#info#compaction#9 average throughput is 3.01 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-29 00:54:17,868 DEBUG [Listener at localhost.localdomain/41921] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/.tmp/info/d408c3265d2d41efa065832a9306ae20 as hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/d408c3265d2d41efa065832a9306ae20 2023-07-29 00:54:17,881 INFO [Listener at localhost.localdomain/41921] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cb6edeb50f5a97566e65d53ecff6401d/info of cb6edeb50f5a97566e65d53ecff6401d into d408c3265d2d41efa065832a9306ae20(size=7.9 K), total size for store is 7.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-29 00:54:17,882 DEBUG [Listener at localhost.localdomain/41921] regionserver.HRegion(2289): Compaction status journal for cb6edeb50f5a97566e65d53ecff6401d: 2023-07-29 00:54:17,897 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35365,DS-6ad71e06-f94f-4b45-b9bf-64ce9934c115,DISK] 2023-07-29 00:54:17,897 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-813192f0-acde-4c18-93a2-120089776908,DISK] 2023-07-29 00:54:17,900 INFO [Listener at localhost.localdomain/41921] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206/jenkins-hbase17.apache.org%2C44161%2C1690592006206.1690592047724 with entries=4, filesize=2.43 KB; new WAL /user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206/jenkins-hbase17.apache.org%2C44161%2C1690592006206.1690592057883 2023-07-29 00:54:17,900 DEBUG [Listener at localhost.localdomain/41921] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35365,DS-6ad71e06-f94f-4b45-b9bf-64ce9934c115,DISK], DatanodeInfoWithStorage[127.0.0.1:34351,DS-813192f0-acde-4c18-93a2-120089776908,DISK]] 2023-07-29 00:54:17,900 DEBUG [Listener at localhost.localdomain/41921] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206/jenkins-hbase17.apache.org%2C44161%2C1690592006206.1690592047724 is not closed yet, will try archiving it next time 2023-07-29 00:54:17,901 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206/jenkins-hbase17.apache.org%2C44161%2C1690592006206.1690592006601 to hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/oldWALs/jenkins-hbase17.apache.org%2C44161%2C1690592006206.1690592006601 2023-07-29 00:54:17,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-29 00:54:17,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-07-29 00:54:17,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,909 INFO [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-29 00:54:17,909 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-29 00:54:17,909 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-29 00:54:17,909 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-29 00:54:17,910 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,910 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,912 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,912 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-29 00:54:17,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-29 00:54:17,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-29 00:54:17,912 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,912 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-29 00:54:17,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-29 00:54:17,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,913 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,913 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-07-29 00:54:17,913 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,913 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-29 00:54:17,913 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-29 00:54:17,914 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-29 00:54:17,914 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-29 00:54:17,914 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-29 00:54:17,914 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:54:17,914 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. started... 2023-07-29 00:54:17,914 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb6edeb50f5a97566e65d53ecff6401d 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-29 00:54:17,932 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=18 (bloomFilter=true), to=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/.tmp/info/235725c2886a4a7a9b856feb79a83b8c 2023-07-29 00:54:17,939 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/.tmp/info/235725c2886a4a7a9b856feb79a83b8c as hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/235725c2886a4a7a9b856feb79a83b8c 2023-07-29 00:54:17,946 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/235725c2886a4a7a9b856feb79a83b8c, entries=1, sequenceid=18, filesize=5.8 K 2023-07-29 00:54:17,947 INFO [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for cb6edeb50f5a97566e65d53ecff6401d in 33ms, sequenceid=18, compaction requested=false 2023-07-29 00:54:17,947 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb6edeb50f5a97566e65d53ecff6401d: 2023-07-29 00:54:17,947 DEBUG [rs(jenkins-hbase17.apache.org,44161,1690592006206)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:54:17,947 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-29 00:54:17,948 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-29 00:54:17,948 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,948 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-29 00:54:17,948 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44161,1690592006206' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-29 00:54:17,949 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,949 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-29 00:54:17,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-29 00:54:17,950 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,950 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-29 00:54:17,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-29 00:54:17,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-29 00:54:17,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-29 00:54:17,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44161,1690592006206' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-29 00:54:17,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d7bf8f9[Count = 0] remaining members to acquire global barrier 2023-07-29 00:54:17,951 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-29 00:54:17,951 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,952 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,952 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-29 00:54:17,952 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-29 00:54:17,952 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase17.apache.org,44161,1690592006206' in zk 2023-07-29 00:54:17,952 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,952 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-29 00:54:17,953 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,953 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-29 00:54:17,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,953 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-29 00:54:17,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-29 00:54:17,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-29 00:54:17,953 DEBUG [member: 'jenkins-hbase17.apache.org,44161,1690592006206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-29 00:54:17,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-29 00:54:17,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-29 00:54:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-29 00:54:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase17.apache.org,44161,1690592006206': 2023-07-29 00:54:17,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44161,1690592006206' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-29 00:54:17,956 INFO [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-29 00:54:17,956 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-29 00:54:17,956 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-29 00:54:17,956 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,956 INFO [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-29 00:54:17,958 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,958 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-29 00:54:17,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,958 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-29 00:54:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-29 00:54:17,958 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-29 00:54:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-29 00:54:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-29 00:54:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-29 00:54:17,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,959 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-29 00:54:17,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,961 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,961 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,961 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,961 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:17,961 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,961 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-29 00:54:17,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-29 00:54:17,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-29 00:54:17,961 DEBUG [(jenkins-hbase17.apache.org,41077,1690592006167)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-29 00:54:17,961 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-07-29 00:54:17,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-29 00:54:17,961 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-29 00:54:17,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-29 00:54:17,962 DEBUG [Listener at localhost.localdomain/41921] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-29 00:54:17,962 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-29 00:54:17,962 DEBUG [Listener at localhost.localdomain/41921] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-29 00:54:17,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-29 00:54:17,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-29 00:54:27,962 DEBUG [Listener at localhost.localdomain/41921] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-29 00:54:27,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41077] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-29 00:54:27,990 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-813192f0-acde-4c18-93a2-120089776908,DISK] 2023-07-29 00:54:27,990 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35365,DS-6ad71e06-f94f-4b45-b9bf-64ce9934c115,DISK] 2023-07-29 00:54:27,992 INFO [Listener at localhost.localdomain/41921] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206/jenkins-hbase17.apache.org%2C44161%2C1690592006206.1690592057883 with entries=3, filesize=1.94 KB; new WAL /user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206/jenkins-hbase17.apache.org%2C44161%2C1690592006206.1690592067975 2023-07-29 00:54:27,992 DEBUG [Listener at localhost.localdomain/41921] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34351,DS-813192f0-acde-4c18-93a2-120089776908,DISK], DatanodeInfoWithStorage[127.0.0.1:35365,DS-6ad71e06-f94f-4b45-b9bf-64ce9934c115,DISK]] 2023-07-29 00:54:27,992 DEBUG [Listener at localhost.localdomain/41921] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206/jenkins-hbase17.apache.org%2C44161%2C1690592006206.1690592057883 is not closed yet, will try archiving it next time 2023-07-29 00:54:27,993 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-29 00:54:27,993 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/WALs/jenkins-hbase17.apache.org,44161,1690592006206/jenkins-hbase17.apache.org%2C44161%2C1690592006206.1690592047724 to hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/oldWALs/jenkins-hbase17.apache.org%2C44161%2C1690592006206.1690592047724 2023-07-29 00:54:27,993 INFO [Listener at localhost.localdomain/41921] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-29 00:54:27,993 DEBUG [Listener at localhost.localdomain/41921] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2194d714 to 127.0.0.1:61768 2023-07-29 00:54:27,993 DEBUG [Listener at localhost.localdomain/41921] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:54:27,994 DEBUG [Listener at localhost.localdomain/41921] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-29 00:54:27,994 DEBUG [Listener at localhost.localdomain/41921] util.JVMClusterUtil(257): Found active master hash=564451542, stopped=false 2023-07-29 00:54:27,994 INFO [Listener at localhost.localdomain/41921] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,41077,1690592006167 2023-07-29 00:54:27,995 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-29 00:54:27,995 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-29 00:54:27,995 INFO [Listener at localhost.localdomain/41921] procedure2.ProcedureExecutor(629): Stopping 2023-07-29 00:54:27,995 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:54:27,996 DEBUG [Listener at localhost.localdomain/41921] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e7aef02 to 127.0.0.1:61768 2023-07-29 00:54:27,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:54:27,996 DEBUG [Listener at localhost.localdomain/41921] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:54:27,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:54:27,996 INFO [Listener at localhost.localdomain/41921] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,44161,1690592006206' ***** 2023-07-29 00:54:27,996 INFO [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(1064): Closing user regions 2023-07-29 00:54:27,996 INFO [Listener at localhost.localdomain/41921] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-29 00:54:27,997 INFO [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(3305): Received CLOSE for cb6edeb50f5a97566e65d53ecff6401d 2023-07-29 00:54:27,997 INFO [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(3305): Received CLOSE for 3e132e71015a0af5c9c9cc18ee74b1f5 2023-07-29 00:54:27,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing cb6edeb50f5a97566e65d53ecff6401d, disabling compactions & flushes 2023-07-29 00:54:27,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:54:27,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:54:27,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. after waiting 0 ms 2023-07-29 00:54:27,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:54:27,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing cb6edeb50f5a97566e65d53ecff6401d 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-29 00:54:27,998 INFO [RS:0;jenkins-hbase17:44161] regionserver.HeapMemoryManager(220): Stopping 2023-07-29 00:54:27,998 INFO [RS:0;jenkins-hbase17:44161] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-29 00:54:27,998 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-29 00:54:27,998 INFO [RS:0;jenkins-hbase17:44161] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-29 00:54:27,999 INFO [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(3307): Received CLOSE for the region: 3e132e71015a0af5c9c9cc18ee74b1f5, which we are already trying to CLOSE, but not completed yet 2023-07-29 00:54:27,999 INFO [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:27,999 DEBUG [RS:0;jenkins-hbase17:44161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72653249 to 127.0.0.1:61768 2023-07-29 00:54:27,999 DEBUG [RS:0;jenkins-hbase17:44161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:54:27,999 INFO [RS:0;jenkins-hbase17:44161] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-29 00:54:27,999 INFO [RS:0;jenkins-hbase17:44161] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-29 00:54:27,999 INFO [RS:0;jenkins-hbase17:44161] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-29 00:54:27,999 INFO [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-29 00:54:27,999 INFO [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-29 00:54:28,000 DEBUG [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(1478): Online Regions={cb6edeb50f5a97566e65d53ecff6401d=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d., 3e132e71015a0af5c9c9cc18ee74b1f5=hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5., 1588230740=hbase:meta,,1.1588230740} 2023-07-29 00:54:28,000 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-29 00:54:28,000 DEBUG [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(1504): Waiting on 1588230740, 3e132e71015a0af5c9c9cc18ee74b1f5, cb6edeb50f5a97566e65d53ecff6401d 2023-07-29 00:54:28,000 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-29 00:54:28,000 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-29 00:54:28,000 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-29 00:54:28,000 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-29 00:54:28,001 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=3.10 KB heapSize=5.61 KB 2023-07-29 00:54:28,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=22 (bloomFilter=true), to=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/.tmp/info/cbf5d115c2ea4771b54c1696813f19ae 2023-07-29 00:54:28,024 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.85 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/.tmp/info/9d45d6c58fb44b75a74dea9a59e67c2f 2023-07-29 00:54:28,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/.tmp/info/cbf5d115c2ea4771b54c1696813f19ae as hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/cbf5d115c2ea4771b54c1696813f19ae 2023-07-29 00:54:28,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/cbf5d115c2ea4771b54c1696813f19ae, entries=1, sequenceid=22, filesize=5.8 K 2023-07-29 00:54:28,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for cb6edeb50f5a97566e65d53ecff6401d in 42ms, sequenceid=22, compaction requested=true 2023-07-29 00:54:28,044 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/6c00cec01d984897b7089d7718178a59, hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/e322502e223a4bf1a471389f7223d9ff, hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/b30f270a8d3a41b5955b292489607b27] to archive 2023-07-29 00:54:28,047 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-29 00:54:28,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=264 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/.tmp/table/e88d8f1bfe2a42cbb0fe74c0c7b4d593 2023-07-29 00:54:28,050 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/6c00cec01d984897b7089d7718178a59 to hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/6c00cec01d984897b7089d7718178a59 2023-07-29 00:54:28,052 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/e322502e223a4bf1a471389f7223d9ff to hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/e322502e223a4bf1a471389f7223d9ff 2023-07-29 00:54:28,054 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/b30f270a8d3a41b5955b292489607b27 to hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/info/b30f270a8d3a41b5955b292489607b27 2023-07-29 00:54:28,057 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/.tmp/info/9d45d6c58fb44b75a74dea9a59e67c2f as hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/info/9d45d6c58fb44b75a74dea9a59e67c2f 2023-07-29 00:54:28,064 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/info/9d45d6c58fb44b75a74dea9a59e67c2f, entries=20, sequenceid=14, filesize=7.6 K 2023-07-29 00:54:28,066 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/.tmp/table/e88d8f1bfe2a42cbb0fe74c0c7b4d593 as hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/table/e88d8f1bfe2a42cbb0fe74c0c7b4d593 2023-07-29 00:54:28,072 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/table/e88d8f1bfe2a42cbb0fe74c0c7b4d593, entries=4, sequenceid=14, filesize=4.9 K 2023-07-29 00:54:28,073 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.10 KB/3178, heapSize ~5.33 KB/5456, currentSize=0 B/0 for 1588230740 in 72ms, sequenceid=14, compaction requested=false 2023-07-29 00:54:28,081 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-07-29 00:54:28,083 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-29 00:54:28,083 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-29 00:54:28,083 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-29 00:54:28,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-29 00:54:28,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/cb6edeb50f5a97566e65d53ecff6401d/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=1 2023-07-29 00:54:28,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:54:28,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for cb6edeb50f5a97566e65d53ecff6401d: 2023-07-29 00:54:28,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690592007451.cb6edeb50f5a97566e65d53ecff6401d. 2023-07-29 00:54:28,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 3e132e71015a0af5c9c9cc18ee74b1f5, disabling compactions & flushes 2023-07-29 00:54:28,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. 2023-07-29 00:54:28,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. 2023-07-29 00:54:28,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. after waiting 0 ms 2023-07-29 00:54:28,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. 2023-07-29 00:54:28,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/data/hbase/namespace/3e132e71015a0af5c9c9cc18ee74b1f5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-29 00:54:28,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. 2023-07-29 00:54:28,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 3e132e71015a0af5c9c9cc18ee74b1f5: 2023-07-29 00:54:28,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690592006852.3e132e71015a0af5c9c9cc18ee74b1f5. 2023-07-29 00:54:28,200 INFO [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,44161,1690592006206; all regions closed. 2023-07-29 00:54:28,207 DEBUG [RS:0;jenkins-hbase17:44161] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/oldWALs 2023-07-29 00:54:28,208 INFO [RS:0;jenkins-hbase17:44161] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C44161%2C1690592006206.meta:.meta(num 1690592006775) 2023-07-29 00:54:28,215 DEBUG [RS:0;jenkins-hbase17:44161] wal.AbstractFSWAL(1028): Moved 2 WAL file(s) to /user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/oldWALs 2023-07-29 00:54:28,216 INFO [RS:0;jenkins-hbase17:44161] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C44161%2C1690592006206:(num 1690592067975) 2023-07-29 00:54:28,216 DEBUG [RS:0;jenkins-hbase17:44161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:54:28,216 INFO [RS:0;jenkins-hbase17:44161] regionserver.LeaseManager(133): Closed leases 2023-07-29 00:54:28,216 INFO [RS:0;jenkins-hbase17:44161] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-29 00:54:28,216 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-29 00:54:28,217 INFO [RS:0;jenkins-hbase17:44161] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:44161 2023-07-29 00:54:28,219 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-29 00:54:28,219 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,44161,1690592006206 2023-07-29 00:54:28,220 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-29 00:54:28,220 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,44161,1690592006206] 2023-07-29 00:54:28,220 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,44161,1690592006206; numProcessing=1 2023-07-29 00:54:28,221 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,44161,1690592006206 already deleted, retry=false 2023-07-29 00:54:28,221 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,44161,1690592006206 expired; onlineServers=0 2023-07-29 00:54:28,221 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,41077,1690592006167' ***** 2023-07-29 00:54:28,221 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-29 00:54:28,222 DEBUG [M:0;jenkins-hbase17:41077] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@259b483a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-29 00:54:28,222 INFO [M:0;jenkins-hbase17:41077] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,41077,1690592006167 2023-07-29 00:54:28,222 INFO [M:0;jenkins-hbase17:41077] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,41077,1690592006167; all regions closed. 2023-07-29 00:54:28,222 DEBUG [M:0;jenkins-hbase17:41077] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:54:28,222 DEBUG [M:0;jenkins-hbase17:41077] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-29 00:54:28,222 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-29 00:54:28,222 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690592006383] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690592006383,5,FailOnTimeoutGroup] 2023-07-29 00:54:28,222 DEBUG [M:0;jenkins-hbase17:41077] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-29 00:54:28,222 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690592006382] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690592006382,5,FailOnTimeoutGroup] 2023-07-29 00:54:28,223 INFO [M:0;jenkins-hbase17:41077] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-29 00:54:28,223 INFO [M:0;jenkins-hbase17:41077] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-29 00:54:28,224 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-29 00:54:28,224 INFO [M:0;jenkins-hbase17:41077] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-07-29 00:54:28,224 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:54:28,224 DEBUG [M:0;jenkins-hbase17:41077] master.HMaster(1512): Stopping service threads 2023-07-29 00:54:28,224 INFO [M:0;jenkins-hbase17:41077] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-29 00:54:28,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-29 00:54:28,224 ERROR [M:0;jenkins-hbase17:41077] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-29 00:54:28,225 INFO [M:0;jenkins-hbase17:41077] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-29 00:54:28,225 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-29 00:54:28,225 DEBUG [M:0;jenkins-hbase17:41077] zookeeper.ZKUtil(398): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-29 00:54:28,225 WARN [M:0;jenkins-hbase17:41077] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-29 00:54:28,225 INFO [M:0;jenkins-hbase17:41077] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-29 00:54:28,226 INFO [M:0;jenkins-hbase17:41077] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-29 00:54:28,226 DEBUG [M:0;jenkins-hbase17:41077] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-29 00:54:28,226 INFO [M:0;jenkins-hbase17:41077] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:54:28,226 DEBUG [M:0;jenkins-hbase17:41077] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:54:28,226 DEBUG [M:0;jenkins-hbase17:41077] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-29 00:54:28,226 DEBUG [M:0;jenkins-hbase17:41077] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:54:28,227 INFO [M:0;jenkins-hbase17:41077] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.94 KB heapSize=47.38 KB 2023-07-29 00:54:28,243 INFO [M:0;jenkins-hbase17:41077] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.94 KB at sequenceid=100 (bloomFilter=true), to=hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1b33140c333142f096adf592115fc9d9 2023-07-29 00:54:28,248 INFO [M:0;jenkins-hbase17:41077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b33140c333142f096adf592115fc9d9 2023-07-29 00:54:28,249 DEBUG [M:0;jenkins-hbase17:41077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1b33140c333142f096adf592115fc9d9 as hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1b33140c333142f096adf592115fc9d9 2023-07-29 00:54:28,254 INFO [M:0;jenkins-hbase17:41077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b33140c333142f096adf592115fc9d9 2023-07-29 00:54:28,254 INFO [M:0;jenkins-hbase17:41077] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34795/user/jenkins/test-data/8d845e18-5147-feee-44eb-f15a707fac33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1b33140c333142f096adf592115fc9d9, entries=11, sequenceid=100, filesize=6.1 K 2023-07-29 00:54:28,255 INFO [M:0;jenkins-hbase17:41077] regionserver.HRegion(2948): Finished flush of dataSize ~38.94 KB/39878, heapSize ~47.36 KB/48496, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=100, compaction requested=false 2023-07-29 00:54:28,257 INFO [M:0;jenkins-hbase17:41077] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:54:28,257 DEBUG [M:0;jenkins-hbase17:41077] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-29 00:54:28,259 INFO [M:0;jenkins-hbase17:41077] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-29 00:54:28,259 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-29 00:54:28,260 INFO [M:0;jenkins-hbase17:41077] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:41077 2023-07-29 00:54:28,261 DEBUG [M:0;jenkins-hbase17:41077] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,41077,1690592006167 already deleted, retry=false 2023-07-29 00:54:28,321 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:54:28,322 INFO [RS:0;jenkins-hbase17:44161] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,44161,1690592006206; zookeeper connection closed. 2023-07-29 00:54:28,322 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): regionserver:44161-0x101ae904b200001, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:54:28,323 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@70ed0939] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@70ed0939 2023-07-29 00:54:28,323 INFO [Listener at localhost.localdomain/41921] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-29 00:54:28,421 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:54:28,421 INFO [M:0;jenkins-hbase17:41077] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,41077,1690592006167; zookeeper connection closed. 2023-07-29 00:54:28,422 DEBUG [Listener at localhost.localdomain/41921-EventThread] zookeeper.ZKWatcher(600): master:41077-0x101ae904b200000, quorum=127.0.0.1:61768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:54:28,423 WARN [Listener at localhost.localdomain/41921] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-29 00:54:28,432 INFO [Listener at localhost.localdomain/41921] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-29 00:54:28,473 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-29 00:54:28,543 WARN [BP-1041914447-136.243.18.41-1690592005694 heartbeating to localhost.localdomain/127.0.0.1:34795] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-29 00:54:28,543 WARN [BP-1041914447-136.243.18.41-1690592005694 heartbeating to localhost.localdomain/127.0.0.1:34795] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1041914447-136.243.18.41-1690592005694 (Datanode Uuid 37e5134c-9fd7-47f3-9aba-f16a90eb1164) service to localhost.localdomain/127.0.0.1:34795 2023-07-29 00:54:28,544 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/cluster_66001958-879e-b87a-53bd-e70fd2a75f47/dfs/data/data3/current/BP-1041914447-136.243.18.41-1690592005694] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:54:28,545 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/cluster_66001958-879e-b87a-53bd-e70fd2a75f47/dfs/data/data4/current/BP-1041914447-136.243.18.41-1690592005694] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:54:28,547 WARN [Listener at localhost.localdomain/41921] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-29 00:54:28,554 INFO [Listener at localhost.localdomain/41921] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-29 00:54:28,660 WARN [BP-1041914447-136.243.18.41-1690592005694 heartbeating to localhost.localdomain/127.0.0.1:34795] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-29 00:54:28,660 WARN [BP-1041914447-136.243.18.41-1690592005694 heartbeating to localhost.localdomain/127.0.0.1:34795] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1041914447-136.243.18.41-1690592005694 (Datanode Uuid 8206b9c2-4850-4aee-8804-cc623193ec85) service to localhost.localdomain/127.0.0.1:34795 2023-07-29 00:54:28,661 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/cluster_66001958-879e-b87a-53bd-e70fd2a75f47/dfs/data/data1/current/BP-1041914447-136.243.18.41-1690592005694] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:54:28,662 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/cluster_66001958-879e-b87a-53bd-e70fd2a75f47/dfs/data/data2/current/BP-1041914447-136.243.18.41-1690592005694] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:54:28,675 INFO [Listener at localhost.localdomain/41921] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-29 00:54:28,795 INFO [Listener at localhost.localdomain/41921] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-29 00:54:28,819 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-29 00:54:28,827 INFO [Listener at localhost.localdomain/41921] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=64 (was 78), OpenFileDescriptor=438 (was 461), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=129 (was 296), ProcessCount=171 (was 171), AvailableMemoryMB=9965 (was 10500) 2023-07-29 00:54:28,835 INFO [Listener at localhost.localdomain/41921] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=65, OpenFileDescriptor=438, MaxFileDescriptor=60000, SystemLoadAverage=129, ProcessCount=171, AvailableMemoryMB=9965 2023-07-29 00:54:28,835 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-29 00:54:28,835 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/hadoop.log.dir so I do NOT create it in target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc 2023-07-29 00:54:28,835 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/67a1c681-5bcf-cca7-0de1-7339d4debd8f/hadoop.tmp.dir so I do NOT create it in target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc 2023-07-29 00:54:28,835 INFO [Listener at localhost.localdomain/41921] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/cluster_0f8b103c-726e-f7f2-d6c2-faf27a1ae7ae, deleteOnExit=true 2023-07-29 00:54:28,835 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-29 00:54:28,835 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/test.cache.data in system properties and HBase conf 2023-07-29 00:54:28,836 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/hadoop.tmp.dir in system properties and HBase conf 2023-07-29 00:54:28,836 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/hadoop.log.dir in system properties and HBase conf 2023-07-29 00:54:28,836 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-29 00:54:28,836 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-29 00:54:28,836 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-29 00:54:28,836 DEBUG [Listener at localhost.localdomain/41921] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-29 00:54:28,836 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-29 00:54:28,836 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-29 00:54:28,837 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-29 00:54:28,837 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-29 00:54:28,837 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-29 00:54:28,837 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-29 00:54:28,837 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-29 00:54:28,837 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-29 00:54:28,837 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-29 00:54:28,837 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/nfs.dump.dir in system properties and HBase conf 2023-07-29 00:54:28,838 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/java.io.tmpdir in system properties and HBase conf 2023-07-29 00:54:28,838 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-29 00:54:28,838 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-29 00:54:28,838 INFO [Listener at localhost.localdomain/41921] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-29 00:54:28,841 WARN [Listener at localhost.localdomain/41921] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-29 00:54:28,841 WARN [Listener at localhost.localdomain/41921] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-29 00:54:28,869 WARN [Listener at localhost.localdomain/41921] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:54:28,871 INFO [Listener at localhost.localdomain/41921] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:54:28,877 INFO [Listener at localhost.localdomain/41921] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/java.io.tmpdir/Jetty_localhost_localdomain_33687_hdfs____.zi09d/webapp 2023-07-29 00:54:28,947 INFO [Listener at localhost.localdomain/41921] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:33687 2023-07-29 00:54:28,949 WARN [Listener at localhost.localdomain/41921] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-29 00:54:28,949 WARN [Listener at localhost.localdomain/41921] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-29 00:54:28,972 WARN [Listener at localhost.localdomain/38077] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:54:28,981 WARN [Listener at localhost.localdomain/38077] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-29 00:54:28,984 WARN [Listener at localhost.localdomain/38077] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:54:28,985 INFO [Listener at localhost.localdomain/38077] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:54:28,990 INFO [Listener at localhost.localdomain/38077] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/java.io.tmpdir/Jetty_localhost_34167_datanode____.v6mw2w/webapp 2023-07-29 00:54:29,062 INFO [Listener at localhost.localdomain/38077] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34167 2023-07-29 00:54:29,067 WARN [Listener at localhost.localdomain/43341] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:54:29,076 WARN [Listener at localhost.localdomain/43341] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-29 00:54:29,079 WARN [Listener at localhost.localdomain/43341] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:54:29,080 INFO [Listener at localhost.localdomain/43341] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:54:29,087 INFO [Listener at localhost.localdomain/43341] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/java.io.tmpdir/Jetty_localhost_39673_datanode____.8q0i3x/webapp 2023-07-29 00:54:29,121 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x701a2ac3cbfef4e4: Processing first storage report for DS-72d54134-ab55-43bb-aed9-2dbfb4e22a53 from datanode b6d88c60-b231-4b35-87d5-6ffad2244a4c 2023-07-29 00:54:29,121 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x701a2ac3cbfef4e4: from storage DS-72d54134-ab55-43bb-aed9-2dbfb4e22a53 node DatanodeRegistration(127.0.0.1:36387, datanodeUuid=b6d88c60-b231-4b35-87d5-6ffad2244a4c, infoPort=42597, infoSecurePort=0, ipcPort=43341, storageInfo=lv=-57;cid=testClusterID;nsid=1246514762;c=1690592068843), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:54:29,122 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x701a2ac3cbfef4e4: Processing first storage report for DS-d8895437-50c8-42e7-a1fe-f13e721d29da from datanode b6d88c60-b231-4b35-87d5-6ffad2244a4c 2023-07-29 00:54:29,122 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x701a2ac3cbfef4e4: from storage DS-d8895437-50c8-42e7-a1fe-f13e721d29da node DatanodeRegistration(127.0.0.1:36387, datanodeUuid=b6d88c60-b231-4b35-87d5-6ffad2244a4c, infoPort=42597, infoSecurePort=0, ipcPort=43341, storageInfo=lv=-57;cid=testClusterID;nsid=1246514762;c=1690592068843), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:54:29,168 INFO [Listener at localhost.localdomain/43341] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39673 2023-07-29 00:54:29,173 WARN [Listener at localhost.localdomain/45641] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:54:29,229 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcccb8f2e7bb699e8: Processing first storage report for DS-60fdb13a-cd71-4bbf-9ff0-99f515f3b9dc from datanode 171d7824-d307-4c31-96e7-3d31c2bf35c9 2023-07-29 00:54:29,229 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcccb8f2e7bb699e8: from storage DS-60fdb13a-cd71-4bbf-9ff0-99f515f3b9dc node DatanodeRegistration(127.0.0.1:38429, datanodeUuid=171d7824-d307-4c31-96e7-3d31c2bf35c9, infoPort=33711, infoSecurePort=0, ipcPort=45641, storageInfo=lv=-57;cid=testClusterID;nsid=1246514762;c=1690592068843), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:54:29,229 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcccb8f2e7bb699e8: Processing first storage report for DS-e71badc2-75d5-49a5-ad3b-a15706b0cf7b from datanode 171d7824-d307-4c31-96e7-3d31c2bf35c9 2023-07-29 00:54:29,229 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcccb8f2e7bb699e8: from storage DS-e71badc2-75d5-49a5-ad3b-a15706b0cf7b node DatanodeRegistration(127.0.0.1:38429, datanodeUuid=171d7824-d307-4c31-96e7-3d31c2bf35c9, infoPort=33711, infoSecurePort=0, ipcPort=45641, storageInfo=lv=-57;cid=testClusterID;nsid=1246514762;c=1690592068843), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:54:29,286 DEBUG [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc 2023-07-29 00:54:29,290 INFO [Listener at localhost.localdomain/45641] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/cluster_0f8b103c-726e-f7f2-d6c2-faf27a1ae7ae/zookeeper_0, clientPort=59655, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/cluster_0f8b103c-726e-f7f2-d6c2-faf27a1ae7ae/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/cluster_0f8b103c-726e-f7f2-d6c2-faf27a1ae7ae/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-29 00:54:29,292 INFO [Listener at localhost.localdomain/45641] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59655 2023-07-29 00:54:29,292 INFO [Listener at localhost.localdomain/45641] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:54:29,294 INFO [Listener at localhost.localdomain/45641] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:54:29,309 INFO [Listener at localhost.localdomain/45641] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a with version=8 2023-07-29 00:54:29,309 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/hbase-staging 2023-07-29 00:54:29,311 INFO [Listener at localhost.localdomain/45641] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-07-29 00:54:29,311 INFO [Listener at localhost.localdomain/45641] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:54:29,311 INFO [Listener at localhost.localdomain/45641] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-29 00:54:29,311 INFO [Listener at localhost.localdomain/45641] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-29 00:54:29,311 INFO [Listener at localhost.localdomain/45641] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:54:29,311 INFO [Listener at localhost.localdomain/45641] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-29 00:54:29,311 INFO [Listener at localhost.localdomain/45641] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-29 00:54:29,313 INFO [Listener at localhost.localdomain/45641] ipc.NettyRpcServer(120): Bind to /136.243.18.41:46349 2023-07-29 00:54:29,313 INFO [Listener at localhost.localdomain/45641] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:54:29,314 INFO [Listener at localhost.localdomain/45641] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:54:29,315 INFO [Listener at localhost.localdomain/45641] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46349 connecting to ZooKeeper ensemble=127.0.0.1:59655 2023-07-29 00:54:29,320 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:463490x0, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-29 00:54:29,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46349-0x101ae9141c80000 connected 2023-07-29 00:54:29,335 DEBUG [Listener at localhost.localdomain/45641] zookeeper.ZKUtil(164): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-29 00:54:29,335 DEBUG [Listener at localhost.localdomain/45641] zookeeper.ZKUtil(164): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:54:29,336 DEBUG [Listener at localhost.localdomain/45641] zookeeper.ZKUtil(164): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-29 00:54:29,336 DEBUG [Listener at localhost.localdomain/45641] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46349 2023-07-29 00:54:29,336 DEBUG [Listener at localhost.localdomain/45641] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46349 2023-07-29 00:54:29,337 DEBUG [Listener at localhost.localdomain/45641] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46349 2023-07-29 00:54:29,337 DEBUG [Listener at localhost.localdomain/45641] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46349 2023-07-29 00:54:29,337 DEBUG [Listener at localhost.localdomain/45641] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46349 2023-07-29 00:54:29,337 INFO [Listener at localhost.localdomain/45641] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a, hbase.cluster.distributed=false 2023-07-29 00:54:29,352 INFO [Listener at localhost.localdomain/45641] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-29 00:54:29,352 INFO [Listener at localhost.localdomain/45641] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:54:29,352 INFO [Listener at localhost.localdomain/45641] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-29 00:54:29,352 INFO [Listener at localhost.localdomain/45641] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-29 00:54:29,352 INFO [Listener at localhost.localdomain/45641] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:54:29,352 INFO [Listener at localhost.localdomain/45641] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-29 00:54:29,352 INFO [Listener at localhost.localdomain/45641] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-29 00:54:29,354 INFO [Listener at localhost.localdomain/45641] ipc.NettyRpcServer(120): Bind to /136.243.18.41:39567 2023-07-29 00:54:29,354 INFO [Listener at localhost.localdomain/45641] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-29 00:54:29,354 DEBUG [Listener at localhost.localdomain/45641] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-29 00:54:29,355 INFO [Listener at localhost.localdomain/45641] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:54:29,356 INFO [Listener at localhost.localdomain/45641] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:54:29,357 INFO [Listener at localhost.localdomain/45641] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39567 connecting to ZooKeeper ensemble=127.0.0.1:59655 2023-07-29 00:54:29,359 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): regionserver:395670x0, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-29 00:54:29,360 DEBUG [Listener at localhost.localdomain/45641] zookeeper.ZKUtil(164): regionserver:395670x0, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-29 00:54:29,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39567-0x101ae9141c80001 connected 2023-07-29 00:54:29,361 DEBUG [Listener at localhost.localdomain/45641] zookeeper.ZKUtil(164): regionserver:39567-0x101ae9141c80001, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:54:29,361 DEBUG [Listener at localhost.localdomain/45641] zookeeper.ZKUtil(164): regionserver:39567-0x101ae9141c80001, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-29 00:54:29,362 DEBUG [Listener at localhost.localdomain/45641] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39567 2023-07-29 00:54:29,362 DEBUG [Listener at localhost.localdomain/45641] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39567 2023-07-29 00:54:29,362 DEBUG [Listener at localhost.localdomain/45641] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39567 2023-07-29 00:54:29,362 DEBUG [Listener at localhost.localdomain/45641] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39567 2023-07-29 00:54:29,363 DEBUG [Listener at localhost.localdomain/45641] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39567 2023-07-29 00:54:29,364 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,46349,1690592069310 2023-07-29 00:54:29,365 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-29 00:54:29,365 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,46349,1690592069310 2023-07-29 00:54:29,366 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-29 00:54:29,366 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): regionserver:39567-0x101ae9141c80001, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-29 00:54:29,366 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:54:29,367 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-29 00:54:29,368 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,46349,1690592069310 from backup master directory 2023-07-29 00:54:29,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-29 00:54:29,368 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,46349,1690592069310 2023-07-29 00:54:29,368 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-29 00:54:29,368 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-29 00:54:29,369 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,46349,1690592069310 2023-07-29 00:54:29,383 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/hbase.id with ID: 1f83b0e3-641b-42ac-a862-c49c6b1b1a45 2023-07-29 00:54:29,394 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:54:29,396 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:54:29,405 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x76306a22 to 127.0.0.1:59655 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-29 00:54:29,408 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f963cd7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-29 00:54:29,408 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-29 00:54:29,408 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-29 00:54:29,409 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-29 00:54:29,410 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/MasterData/data/master/store-tmp 2023-07-29 00:54:29,423 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:54:29,423 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-29 00:54:29,423 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:54:29,423 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:54:29,424 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-29 00:54:29,424 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:54:29,424 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:54:29,424 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-29 00:54:29,425 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/MasterData/WALs/jenkins-hbase17.apache.org,46349,1690592069310 2023-07-29 00:54:29,428 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C46349%2C1690592069310, suffix=, logDir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/MasterData/WALs/jenkins-hbase17.apache.org,46349,1690592069310, archiveDir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/MasterData/oldWALs, maxLogs=10 2023-07-29 00:54:29,444 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36387,DS-72d54134-ab55-43bb-aed9-2dbfb4e22a53,DISK] 2023-07-29 00:54:29,444 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38429,DS-60fdb13a-cd71-4bbf-9ff0-99f515f3b9dc,DISK] 2023-07-29 00:54:29,447 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/MasterData/WALs/jenkins-hbase17.apache.org,46349,1690592069310/jenkins-hbase17.apache.org%2C46349%2C1690592069310.1690592069428 2023-07-29 00:54:29,447 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36387,DS-72d54134-ab55-43bb-aed9-2dbfb4e22a53,DISK], DatanodeInfoWithStorage[127.0.0.1:38429,DS-60fdb13a-cd71-4bbf-9ff0-99f515f3b9dc,DISK]] 2023-07-29 00:54:29,447 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-29 00:54:29,447 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:54:29,447 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:54:29,447 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:54:29,449 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:54:29,450 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-29 00:54:29,451 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-29 00:54:29,451 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:54:29,452 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:54:29,452 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:54:29,455 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:54:29,457 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-29 00:54:29,457 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=725197, jitterRate=-0.07786516845226288}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-29 00:54:29,457 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-29 00:54:29,457 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-29 00:54:29,459 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-29 00:54:29,459 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-29 00:54:29,459 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-29 00:54:29,459 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-29 00:54:29,460 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-07-29 00:54:29,460 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-29 00:54:29,461 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-29 00:54:29,462 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-29 00:54:29,473 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-29 00:54:29,473 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-29 00:54:29,473 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-29 00:54:29,474 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-29 00:54:29,474 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-29 00:54:29,475 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:54:29,476 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-29 00:54:29,477 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-29 00:54:29,477 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-29 00:54:29,478 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): regionserver:39567-0x101ae9141c80001, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-29 00:54:29,478 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-29 00:54:29,478 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:54:29,478 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,46349,1690592069310, sessionid=0x101ae9141c80000, setting cluster-up flag (Was=false) 2023-07-29 00:54:29,480 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:54:29,483 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-29 00:54:29,484 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,46349,1690592069310 2023-07-29 00:54:29,486 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:54:29,488 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-29 00:54:29,489 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,46349,1690592069310 2023-07-29 00:54:29,489 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/.hbase-snapshot/.tmp 2023-07-29 00:54:29,491 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-29 00:54:29,492 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:54:29,492 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:54:29,492 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:54:29,492 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:54:29,492 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-07-29 00:54:29,492 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:54:29,492 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-29 00:54:29,493 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:54:29,496 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690592099496 2023-07-29 00:54:29,497 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-29 00:54:29,497 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-29 00:54:29,497 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-29 00:54:29,497 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-29 00:54:29,497 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-29 00:54:29,497 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-29 00:54:29,498 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:29,498 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-29 00:54:29,499 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-29 00:54:29,499 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-29 00:54:29,499 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-29 00:54:29,499 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-29 00:54:29,499 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-29 00:54:29,499 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-29 00:54:29,499 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690592069499,5,FailOnTimeoutGroup] 2023-07-29 00:54:29,499 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690592069499,5,FailOnTimeoutGroup] 2023-07-29 00:54:29,499 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:29,500 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-29 00:54:29,500 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:29,500 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:29,500 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-29 00:54:29,511 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-29 00:54:29,512 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-29 00:54:29,512 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a 2023-07-29 00:54:29,524 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:54:29,525 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-29 00:54:29,528 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/info 2023-07-29 00:54:29,528 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-29 00:54:29,529 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:54:29,529 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-29 00:54:29,531 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/rep_barrier 2023-07-29 00:54:29,532 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-29 00:54:29,533 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:54:29,533 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-29 00:54:29,535 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/table 2023-07-29 00:54:29,535 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-29 00:54:29,536 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:54:29,537 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740 2023-07-29 00:54:29,537 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740 2023-07-29 00:54:29,540 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-29 00:54:29,541 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-29 00:54:29,543 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-29 00:54:29,544 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=732837, jitterRate=-0.06815007328987122}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-29 00:54:29,544 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-29 00:54:29,544 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-29 00:54:29,544 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-29 00:54:29,544 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-29 00:54:29,544 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-29 00:54:29,544 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-29 00:54:29,545 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-29 00:54:29,545 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-29 00:54:29,546 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-29 00:54:29,546 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-29 00:54:29,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-29 00:54:29,548 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-29 00:54:29,549 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-29 00:54:29,566 INFO [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(951): ClusterId : 1f83b0e3-641b-42ac-a862-c49c6b1b1a45 2023-07-29 00:54:29,567 DEBUG [RS:0;jenkins-hbase17:39567] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-29 00:54:29,568 DEBUG [RS:0;jenkins-hbase17:39567] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-29 00:54:29,569 DEBUG [RS:0;jenkins-hbase17:39567] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-29 00:54:29,571 DEBUG [RS:0;jenkins-hbase17:39567] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-29 00:54:29,572 DEBUG [RS:0;jenkins-hbase17:39567] zookeeper.ReadOnlyZKClient(139): Connect 0x0cc65a72 to 127.0.0.1:59655 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-29 00:54:29,576 DEBUG [RS:0;jenkins-hbase17:39567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@201b59a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-29 00:54:29,576 DEBUG [RS:0;jenkins-hbase17:39567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63e3102, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-29 00:54:29,588 DEBUG [RS:0;jenkins-hbase17:39567] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:39567 2023-07-29 00:54:29,588 INFO [RS:0;jenkins-hbase17:39567] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-29 00:54:29,588 INFO [RS:0;jenkins-hbase17:39567] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-29 00:54:29,588 DEBUG [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(1022): About to register with Master. 2023-07-29 00:54:29,589 INFO [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,46349,1690592069310 with isa=jenkins-hbase17.apache.org/136.243.18.41:39567, startcode=1690592069351 2023-07-29 00:54:29,589 DEBUG [RS:0;jenkins-hbase17:39567] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-29 00:54:29,591 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48353, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-29 00:54:29,592 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46349] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:54:29,593 DEBUG [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a 2023-07-29 00:54:29,593 DEBUG [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:38077 2023-07-29 00:54:29,593 DEBUG [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-29 00:54:29,594 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-29 00:54:29,595 DEBUG [RS:0;jenkins-hbase17:39567] zookeeper.ZKUtil(162): regionserver:39567-0x101ae9141c80001, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:54:29,595 WARN [RS:0;jenkins-hbase17:39567] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-29 00:54:29,595 INFO [RS:0;jenkins-hbase17:39567] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-29 00:54:29,595 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,39567,1690592069351] 2023-07-29 00:54:29,595 DEBUG [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/WALs/jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:54:29,600 DEBUG [RS:0;jenkins-hbase17:39567] zookeeper.ZKUtil(162): regionserver:39567-0x101ae9141c80001, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:54:29,600 DEBUG [RS:0;jenkins-hbase17:39567] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-29 00:54:29,601 INFO [RS:0;jenkins-hbase17:39567] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-29 00:54:29,602 INFO [RS:0;jenkins-hbase17:39567] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-29 00:54:29,602 INFO [RS:0;jenkins-hbase17:39567] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-29 00:54:29,602 INFO [RS:0;jenkins-hbase17:39567] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:29,602 INFO [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-29 00:54:29,604 INFO [RS:0;jenkins-hbase17:39567] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:29,604 DEBUG [RS:0;jenkins-hbase17:39567] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:54:29,605 DEBUG [RS:0;jenkins-hbase17:39567] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:54:29,605 DEBUG [RS:0;jenkins-hbase17:39567] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:54:29,605 DEBUG [RS:0;jenkins-hbase17:39567] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:54:29,605 DEBUG [RS:0;jenkins-hbase17:39567] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:54:29,605 DEBUG [RS:0;jenkins-hbase17:39567] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-29 00:54:29,605 DEBUG [RS:0;jenkins-hbase17:39567] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:54:29,605 DEBUG [RS:0;jenkins-hbase17:39567] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:54:29,605 DEBUG [RS:0;jenkins-hbase17:39567] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:54:29,605 DEBUG [RS:0;jenkins-hbase17:39567] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:54:29,606 INFO [RS:0;jenkins-hbase17:39567] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:29,606 INFO [RS:0;jenkins-hbase17:39567] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:29,606 INFO [RS:0;jenkins-hbase17:39567] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:29,617 INFO [RS:0;jenkins-hbase17:39567] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-29 00:54:29,618 INFO [RS:0;jenkins-hbase17:39567] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,39567,1690592069351-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:29,625 INFO [RS:0;jenkins-hbase17:39567] regionserver.Replication(203): jenkins-hbase17.apache.org,39567,1690592069351 started 2023-07-29 00:54:29,625 INFO [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,39567,1690592069351, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:39567, sessionid=0x101ae9141c80001 2023-07-29 00:54:29,626 DEBUG [RS:0;jenkins-hbase17:39567] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-29 00:54:29,626 DEBUG [RS:0;jenkins-hbase17:39567] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:54:29,626 DEBUG [RS:0;jenkins-hbase17:39567] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,39567,1690592069351' 2023-07-29 00:54:29,626 DEBUG [RS:0;jenkins-hbase17:39567] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-29 00:54:29,626 DEBUG [RS:0;jenkins-hbase17:39567] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-29 00:54:29,626 DEBUG [RS:0;jenkins-hbase17:39567] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-29 00:54:29,627 DEBUG [RS:0;jenkins-hbase17:39567] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-29 00:54:29,627 DEBUG [RS:0;jenkins-hbase17:39567] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:54:29,627 DEBUG [RS:0;jenkins-hbase17:39567] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,39567,1690592069351' 2023-07-29 00:54:29,627 DEBUG [RS:0;jenkins-hbase17:39567] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-29 00:54:29,627 DEBUG [RS:0;jenkins-hbase17:39567] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-29 00:54:29,627 DEBUG [RS:0;jenkins-hbase17:39567] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-29 00:54:29,627 INFO [RS:0;jenkins-hbase17:39567] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-29 00:54:29,627 INFO [RS:0;jenkins-hbase17:39567] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-29 00:54:29,699 DEBUG [jenkins-hbase17:46349] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-29 00:54:29,700 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,39567,1690592069351, state=OPENING 2023-07-29 00:54:29,702 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-29 00:54:29,703 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:54:29,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,39567,1690592069351}] 2023-07-29 00:54:29,704 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-29 00:54:29,731 INFO [RS:0;jenkins-hbase17:39567] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C39567%2C1690592069351, suffix=, logDir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/WALs/jenkins-hbase17.apache.org,39567,1690592069351, archiveDir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/oldWALs, maxLogs=32 2023-07-29 00:54:29,750 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38429,DS-60fdb13a-cd71-4bbf-9ff0-99f515f3b9dc,DISK] 2023-07-29 00:54:29,750 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36387,DS-72d54134-ab55-43bb-aed9-2dbfb4e22a53,DISK] 2023-07-29 00:54:29,751 INFO [RS:0;jenkins-hbase17:39567] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/WALs/jenkins-hbase17.apache.org,39567,1690592069351/jenkins-hbase17.apache.org%2C39567%2C1690592069351.1690592069732 2023-07-29 00:54:29,752 DEBUG [RS:0;jenkins-hbase17:39567] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38429,DS-60fdb13a-cd71-4bbf-9ff0-99f515f3b9dc,DISK], DatanodeInfoWithStorage[127.0.0.1:36387,DS-72d54134-ab55-43bb-aed9-2dbfb4e22a53,DISK]] 2023-07-29 00:54:29,860 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:54:29,861 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-29 00:54:29,865 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-29 00:54:29,872 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-29 00:54:29,872 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-29 00:54:29,875 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C39567%2C1690592069351.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/WALs/jenkins-hbase17.apache.org,39567,1690592069351, archiveDir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/oldWALs, maxLogs=32 2023-07-29 00:54:29,889 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38429,DS-60fdb13a-cd71-4bbf-9ff0-99f515f3b9dc,DISK] 2023-07-29 00:54:29,889 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36387,DS-72d54134-ab55-43bb-aed9-2dbfb4e22a53,DISK] 2023-07-29 00:54:29,891 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/WALs/jenkins-hbase17.apache.org,39567,1690592069351/jenkins-hbase17.apache.org%2C39567%2C1690592069351.meta.1690592069875.meta 2023-07-29 00:54:29,891 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38429,DS-60fdb13a-cd71-4bbf-9ff0-99f515f3b9dc,DISK], DatanodeInfoWithStorage[127.0.0.1:36387,DS-72d54134-ab55-43bb-aed9-2dbfb4e22a53,DISK]] 2023-07-29 00:54:29,891 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-29 00:54:29,891 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-29 00:54:29,891 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-29 00:54:29,892 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-29 00:54:29,892 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-29 00:54:29,892 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:54:29,892 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-29 00:54:29,892 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-29 00:54:29,896 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-29 00:54:29,897 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/info 2023-07-29 00:54:29,897 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/info 2023-07-29 00:54:29,898 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-29 00:54:29,899 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:54:29,899 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-29 00:54:29,900 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/rep_barrier 2023-07-29 00:54:29,900 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/rep_barrier 2023-07-29 00:54:29,900 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-29 00:54:29,900 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:54:29,901 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-29 00:54:29,901 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/table 2023-07-29 00:54:29,901 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/table 2023-07-29 00:54:29,902 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-29 00:54:29,902 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:54:29,903 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740 2023-07-29 00:54:29,905 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740 2023-07-29 00:54:29,906 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-29 00:54:29,908 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-29 00:54:29,908 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=872196, jitterRate=0.1090555340051651}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-29 00:54:29,908 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-29 00:54:29,909 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690592069860 2023-07-29 00:54:29,913 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-29 00:54:29,913 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-29 00:54:29,914 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,39567,1690592069351, state=OPEN 2023-07-29 00:54:29,915 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-29 00:54:29,915 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-29 00:54:29,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-29 00:54:29,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,39567,1690592069351 in 211 msec 2023-07-29 00:54:29,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-29 00:54:29,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 370 msec 2023-07-29 00:54:29,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 429 msec 2023-07-29 00:54:29,920 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690592069920, completionTime=-1 2023-07-29 00:54:29,920 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-29 00:54:29,920 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-29 00:54:29,923 DEBUG [hconnection-0x3b41419c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-29 00:54:29,924 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-29 00:54:29,926 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-29 00:54:29,926 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690592129926 2023-07-29 00:54:29,926 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690592189926 2023-07-29 00:54:29,926 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-07-29 00:54:29,931 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,46349,1690592069310-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:29,931 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,46349,1690592069310-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:29,931 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,46349,1690592069310-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:29,931 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:46349, period=300000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:29,931 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-29 00:54:29,932 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-29 00:54:29,932 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-29 00:54:29,933 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-29 00:54:29,933 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-29 00:54:29,935 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-29 00:54:29,936 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-29 00:54:29,938 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/.tmp/data/hbase/namespace/9a4b3a3d288b106af8cdf74b925d6822 2023-07-29 00:54:29,938 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/.tmp/data/hbase/namespace/9a4b3a3d288b106af8cdf74b925d6822 empty. 2023-07-29 00:54:29,939 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/.tmp/data/hbase/namespace/9a4b3a3d288b106af8cdf74b925d6822 2023-07-29 00:54:29,939 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-29 00:54:29,953 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-29 00:54:29,954 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9a4b3a3d288b106af8cdf74b925d6822, NAME => 'hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/.tmp 2023-07-29 00:54:29,964 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:54:29,964 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 9a4b3a3d288b106af8cdf74b925d6822, disabling compactions & flushes 2023-07-29 00:54:29,964 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822. 2023-07-29 00:54:29,964 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822. 2023-07-29 00:54:29,964 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822. after waiting 0 ms 2023-07-29 00:54:29,964 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822. 2023-07-29 00:54:29,964 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822. 2023-07-29 00:54:29,964 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 9a4b3a3d288b106af8cdf74b925d6822: 2023-07-29 00:54:29,967 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-29 00:54:29,969 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690592069969"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690592069969"}]},"ts":"1690592069969"} 2023-07-29 00:54:29,972 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-29 00:54:29,974 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-29 00:54:29,974 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690592069974"}]},"ts":"1690592069974"} 2023-07-29 00:54:29,976 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-29 00:54:29,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9a4b3a3d288b106af8cdf74b925d6822, ASSIGN}] 2023-07-29 00:54:29,981 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9a4b3a3d288b106af8cdf74b925d6822, ASSIGN 2023-07-29 00:54:29,982 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=9a4b3a3d288b106af8cdf74b925d6822, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,39567,1690592069351; forceNewPlan=false, retain=false 2023-07-29 00:54:30,134 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9a4b3a3d288b106af8cdf74b925d6822, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:54:30,135 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690592070134"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690592070134"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690592070134"}]},"ts":"1690592070134"} 2023-07-29 00:54:30,140 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 9a4b3a3d288b106af8cdf74b925d6822, server=jenkins-hbase17.apache.org,39567,1690592069351}] 2023-07-29 00:54:30,303 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822. 2023-07-29 00:54:30,304 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9a4b3a3d288b106af8cdf74b925d6822, NAME => 'hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822.', STARTKEY => '', ENDKEY => ''} 2023-07-29 00:54:30,305 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 9a4b3a3d288b106af8cdf74b925d6822 2023-07-29 00:54:30,305 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:54:30,305 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 9a4b3a3d288b106af8cdf74b925d6822 2023-07-29 00:54:30,305 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 9a4b3a3d288b106af8cdf74b925d6822 2023-07-29 00:54:30,308 INFO [StoreOpener-9a4b3a3d288b106af8cdf74b925d6822-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 9a4b3a3d288b106af8cdf74b925d6822 2023-07-29 00:54:30,310 DEBUG [StoreOpener-9a4b3a3d288b106af8cdf74b925d6822-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/namespace/9a4b3a3d288b106af8cdf74b925d6822/info 2023-07-29 00:54:30,310 DEBUG [StoreOpener-9a4b3a3d288b106af8cdf74b925d6822-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/namespace/9a4b3a3d288b106af8cdf74b925d6822/info 2023-07-29 00:54:30,311 INFO [StoreOpener-9a4b3a3d288b106af8cdf74b925d6822-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a4b3a3d288b106af8cdf74b925d6822 columnFamilyName info 2023-07-29 00:54:30,312 INFO [StoreOpener-9a4b3a3d288b106af8cdf74b925d6822-1] regionserver.HStore(310): Store=9a4b3a3d288b106af8cdf74b925d6822/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:54:30,313 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/namespace/9a4b3a3d288b106af8cdf74b925d6822 2023-07-29 00:54:30,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/namespace/9a4b3a3d288b106af8cdf74b925d6822 2023-07-29 00:54:30,319 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 9a4b3a3d288b106af8cdf74b925d6822 2023-07-29 00:54:30,322 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/namespace/9a4b3a3d288b106af8cdf74b925d6822/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-29 00:54:30,323 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 9a4b3a3d288b106af8cdf74b925d6822; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=750419, jitterRate=-0.04579372704029083}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-29 00:54:30,323 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 9a4b3a3d288b106af8cdf74b925d6822: 2023-07-29 00:54:30,324 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822., pid=6, masterSystemTime=1690592070294 2023-07-29 00:54:30,328 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822. 2023-07-29 00:54:30,328 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822. 2023-07-29 00:54:30,329 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9a4b3a3d288b106af8cdf74b925d6822, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:54:30,329 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690592070329"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690592070329"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690592070329"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690592070329"}]},"ts":"1690592070329"} 2023-07-29 00:54:30,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-29 00:54:30,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 9a4b3a3d288b106af8cdf74b925d6822, server=jenkins-hbase17.apache.org,39567,1690592069351 in 192 msec 2023-07-29 00:54:30,338 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-29 00:54:30,339 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=9a4b3a3d288b106af8cdf74b925d6822, ASSIGN in 356 msec 2023-07-29 00:54:30,340 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-29 00:54:30,341 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690592070341"}]},"ts":"1690592070341"} 2023-07-29 00:54:30,343 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-29 00:54:30,345 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-29 00:54:30,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 413 msec 2023-07-29 00:54:30,436 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-29 00:54:30,438 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-29 00:54:30,438 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:54:30,443 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-29 00:54:30,451 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-29 00:54:30,454 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-07-29 00:54:30,465 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-29 00:54:30,473 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-29 00:54:30,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-07-29 00:54:30,489 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-29 00:54:30,490 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-29 00:54:30,491 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.121sec 2023-07-29 00:54:30,491 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-29 00:54:30,491 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-29 00:54:30,491 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-29 00:54:30,491 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,46349,1690592069310-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-29 00:54:30,491 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,46349,1690592069310-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-29 00:54:30,493 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-29 00:54:30,566 DEBUG [Listener at localhost.localdomain/45641] zookeeper.ReadOnlyZKClient(139): Connect 0x11b5ebf7 to 127.0.0.1:59655 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-29 00:54:30,573 DEBUG [Listener at localhost.localdomain/45641] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66f2f353, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-29 00:54:30,576 DEBUG [hconnection-0x496dea77-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-29 00:54:30,579 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-29 00:54:30,581 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,46349,1690592069310 2023-07-29 00:54:30,582 INFO [Listener at localhost.localdomain/45641] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:54:30,585 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-29 00:54:30,585 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:54:30,587 INFO [Listener at localhost.localdomain/45641] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-29 00:54:30,590 DEBUG [Listener at localhost.localdomain/45641] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-29 00:54:30,594 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-29 00:54:30,597 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46349] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-07-29 00:54:30,597 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46349] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-07-29 00:54:30,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46349] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-29 00:54:30,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46349] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRolling 2023-07-29 00:54:30,602 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-07-29 00:54:30,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46349] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRolling" procId is: 9 2023-07-29 00:54:30,603 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-29 00:54:30,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46349] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-29 00:54:30,606 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/.tmp/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1 2023-07-29 00:54:30,607 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/.tmp/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1 empty. 2023-07-29 00:54:30,607 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/.tmp/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1 2023-07-29 00:54:30,607 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRolling regions 2023-07-29 00:54:30,618 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/.tmp/data/default/TestLogRolling-testLogRolling/.tabledesc/.tableinfo.0000000001 2023-07-29 00:54:30,619 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4a20b815c7b305045d547f965f1870f1, NAME => 'TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/.tmp 2023-07-29 00:54:30,627 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:54:30,627 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1604): Closing 4a20b815c7b305045d547f965f1870f1, disabling compactions & flushes 2023-07-29 00:54:30,627 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. 2023-07-29 00:54:30,627 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. 2023-07-29 00:54:30,627 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. after waiting 0 ms 2023-07-29 00:54:30,627 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. 2023-07-29 00:54:30,627 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. 2023-07-29 00:54:30,627 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1558): Region close journal for 4a20b815c7b305045d547f965f1870f1: 2023-07-29 00:54:30,630 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ADD_TO_META 2023-07-29 00:54:30,631 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690592070631"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690592070631"}]},"ts":"1690592070631"} 2023-07-29 00:54:30,633 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-29 00:54:30,634 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-29 00:54:30,634 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690592070634"}]},"ts":"1690592070634"} 2023-07-29 00:54:30,636 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLING in hbase:meta 2023-07-29 00:54:30,638 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=4a20b815c7b305045d547f965f1870f1, ASSIGN}] 2023-07-29 00:54:30,640 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=4a20b815c7b305045d547f965f1870f1, ASSIGN 2023-07-29 00:54:30,641 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=4a20b815c7b305045d547f965f1870f1, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,39567,1690592069351; forceNewPlan=false, retain=false 2023-07-29 00:54:30,792 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4a20b815c7b305045d547f965f1870f1, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:54:30,793 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690592070792"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690592070792"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690592070792"}]},"ts":"1690592070792"} 2023-07-29 00:54:30,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 4a20b815c7b305045d547f965f1870f1, server=jenkins-hbase17.apache.org,39567,1690592069351}] 2023-07-29 00:54:30,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. 2023-07-29 00:54:30,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a20b815c7b305045d547f965f1870f1, NAME => 'TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.', STARTKEY => '', ENDKEY => ''} 2023-07-29 00:54:30,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:54:30,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:54:30,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:54:30,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:54:30,961 INFO [StoreOpener-4a20b815c7b305045d547f965f1870f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:54:30,964 DEBUG [StoreOpener-4a20b815c7b305045d547f965f1870f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info 2023-07-29 00:54:30,965 DEBUG [StoreOpener-4a20b815c7b305045d547f965f1870f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info 2023-07-29 00:54:30,965 INFO [StoreOpener-4a20b815c7b305045d547f965f1870f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a20b815c7b305045d547f965f1870f1 columnFamilyName info 2023-07-29 00:54:30,966 INFO [StoreOpener-4a20b815c7b305045d547f965f1870f1-1] regionserver.HStore(310): Store=4a20b815c7b305045d547f965f1870f1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:54:30,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1 2023-07-29 00:54:30,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1 2023-07-29 00:54:30,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:54:30,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-29 00:54:30,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 4a20b815c7b305045d547f965f1870f1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=833592, jitterRate=0.05996808409690857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-29 00:54:30,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 4a20b815c7b305045d547f965f1870f1: 2023-07-29 00:54:30,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1., pid=11, masterSystemTime=1690592070947 2023-07-29 00:54:30,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. 2023-07-29 00:54:30,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. 2023-07-29 00:54:30,979 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4a20b815c7b305045d547f965f1870f1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:54:30,980 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690592070979"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690592070979"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690592070979"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690592070979"}]},"ts":"1690592070979"} 2023-07-29 00:54:30,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-29 00:54:30,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 4a20b815c7b305045d547f965f1870f1, server=jenkins-hbase17.apache.org,39567,1690592069351 in 187 msec 2023-07-29 00:54:30,986 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-29 00:54:30,987 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=4a20b815c7b305045d547f965f1870f1, ASSIGN in 346 msec 2023-07-29 00:54:30,988 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-29 00:54:30,988 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690592070988"}]},"ts":"1690592070988"} 2023-07-29 00:54:30,989 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLED in hbase:meta 2023-07-29 00:54:30,991 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_POST_OPERATION 2023-07-29 00:54:30,993 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRolling in 394 msec 2023-07-29 00:54:33,615 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-29 00:54:35,601 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-29 00:54:35,601 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-29 00:54:35,602 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRolling' 2023-07-29 00:54:40,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46349] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-29 00:54:40,607 INFO [Listener at localhost.localdomain/45641] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRolling, procId: 9 completed 2023-07-29 00:54:40,610 DEBUG [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRolling 2023-07-29 00:54:40,610 DEBUG [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. 2023-07-29 00:54:40,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:54:40,630 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 4a20b815c7b305045d547f965f1870f1 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-29 00:54:40,643 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=12 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/c79bf8c0f2404af2af7330f9ff1722d3 2023-07-29 00:54:40,652 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/c79bf8c0f2404af2af7330f9ff1722d3 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/c79bf8c0f2404af2af7330f9ff1722d3 2023-07-29 00:54:40,658 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/c79bf8c0f2404af2af7330f9ff1722d3, entries=8, sequenceid=12, filesize=13.0 K 2023-07-29 00:54:40,659 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=16.42 KB/16816 for 4a20b815c7b305045d547f965f1870f1 in 30ms, sequenceid=12, compaction requested=false 2023-07-29 00:54:40,659 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 4a20b815c7b305045d547f965f1870f1: 2023-07-29 00:54:40,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:54:40,661 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 4a20b815c7b305045d547f965f1870f1 1/1 column families, dataSize=18.47 KB heapSize=20.08 KB 2023-07-29 00:54:40,676 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=18.47 KB at sequenceid=33 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/ce77f5255dbf444ba28192fb36137d2f 2023-07-29 00:54:40,684 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/ce77f5255dbf444ba28192fb36137d2f as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/ce77f5255dbf444ba28192fb36137d2f 2023-07-29 00:54:40,696 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/ce77f5255dbf444ba28192fb36137d2f, entries=18, sequenceid=33, filesize=23.3 K 2023-07-29 00:54:40,697 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~18.47 KB/18918, heapSize ~20.06 KB/20544, currentSize=6.16 KB/6306 for 4a20b815c7b305045d547f965f1870f1 in 36ms, sequenceid=33, compaction requested=false 2023-07-29 00:54:40,697 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 4a20b815c7b305045d547f965f1870f1: 2023-07-29 00:54:40,697 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=36.2 K, sizeToCheck=16.0 K 2023-07-29 00:54:40,697 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-29 00:54:40,698 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/ce77f5255dbf444ba28192fb36137d2f because midkey is the same as first or last row 2023-07-29 00:54:42,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:54:42,681 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 4a20b815c7b305045d547f965f1870f1 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-29 00:54:42,711 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=44 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/8c48f9b37404446e8a7b3cdc7a308ca5 2023-07-29 00:54:42,725 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/8c48f9b37404446e8a7b3cdc7a308ca5 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/8c48f9b37404446e8a7b3cdc7a308ca5 2023-07-29 00:54:42,731 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=4a20b815c7b305045d547f965f1870f1, server=jenkins-hbase17.apache.org,39567,1690592069351 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-29 00:54:42,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] ipc.CallRunner(144): callId: 64 service: ClientService methodName: Mutate size: 1.1 K connection: 136.243.18.41:37304 deadline: 1690592092730, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=4a20b815c7b305045d547f965f1870f1, server=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:54:42,733 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/8c48f9b37404446e8a7b3cdc7a308ca5, entries=8, sequenceid=44, filesize=13.0 K 2023-07-29 00:54:42,734 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 4a20b815c7b305045d547f965f1870f1 in 53ms, sequenceid=44, compaction requested=true 2023-07-29 00:54:42,734 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 4a20b815c7b305045d547f965f1870f1: 2023-07-29 00:54:42,734 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=49.2 K, sizeToCheck=16.0 K 2023-07-29 00:54:42,735 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-29 00:54:42,735 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/ce77f5255dbf444ba28192fb36137d2f because midkey is the same as first or last row 2023-07-29 00:54:42,736 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:54:42,736 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-29 00:54:42,741 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 50368 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-29 00:54:42,741 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1912): 4a20b815c7b305045d547f965f1870f1/info is initiating minor compaction (all files) 2023-07-29 00:54:42,741 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4a20b815c7b305045d547f965f1870f1/info in TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. 2023-07-29 00:54:42,741 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/c79bf8c0f2404af2af7330f9ff1722d3, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/ce77f5255dbf444ba28192fb36137d2f, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/8c48f9b37404446e8a7b3cdc7a308ca5] into tmpdir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp, totalSize=49.2 K 2023-07-29 00:54:42,742 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting c79bf8c0f2404af2af7330f9ff1722d3, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1690592080616 2023-07-29 00:54:42,742 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting ce77f5255dbf444ba28192fb36137d2f, keycount=18, bloomtype=ROW, size=23.3 K, encoding=NONE, compression=NONE, seqNum=33, earliestPutTs=1690592080631 2023-07-29 00:54:42,743 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting 8c48f9b37404446e8a7b3cdc7a308ca5, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=44, earliestPutTs=1690592080662 2023-07-29 00:54:42,770 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4a20b815c7b305045d547f965f1870f1#info#compaction#18 average throughput is 17.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-29 00:54:42,793 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/99d509f7d4a4487ba148a5a64fd99239 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/99d509f7d4a4487ba148a5a64fd99239 2023-07-29 00:54:42,803 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4a20b815c7b305045d547f965f1870f1/info of 4a20b815c7b305045d547f965f1870f1 into 99d509f7d4a4487ba148a5a64fd99239(size=39.8 K), total size for store is 39.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-29 00:54:42,803 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4a20b815c7b305045d547f965f1870f1: 2023-07-29 00:54:42,803 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1., storeName=4a20b815c7b305045d547f965f1870f1/info, priority=13, startTime=1690592082736; duration=0sec 2023-07-29 00:54:42,805 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=39.8 K, sizeToCheck=16.0 K 2023-07-29 00:54:42,805 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-29 00:54:42,805 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/99d509f7d4a4487ba148a5a64fd99239 because midkey is the same as first or last row 2023-07-29 00:54:42,805 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:54:52,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:54:52,813 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 4a20b815c7b305045d547f965f1870f1 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-29 00:54:52,831 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=4a20b815c7b305045d547f965f1870f1, server=jenkins-hbase17.apache.org,39567,1690592069351 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-29 00:54:52,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] ipc.CallRunner(144): callId: 74 service: ClientService methodName: Mutate size: 1.1 K connection: 136.243.18.41:37304 deadline: 1690592102830, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=4a20b815c7b305045d547f965f1870f1, server=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:54:52,832 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=70 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/67d57564d8a948cba48003e90340781f 2023-07-29 00:54:52,839 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/67d57564d8a948cba48003e90340781f as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/67d57564d8a948cba48003e90340781f 2023-07-29 00:54:52,844 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/67d57564d8a948cba48003e90340781f, entries=22, sequenceid=70, filesize=27.4 K 2023-07-29 00:54:52,845 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=7.18 KB/7357 for 4a20b815c7b305045d547f965f1870f1 in 32ms, sequenceid=70, compaction requested=false 2023-07-29 00:54:52,845 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 4a20b815c7b305045d547f965f1870f1: 2023-07-29 00:54:52,845 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=67.2 K, sizeToCheck=16.0 K 2023-07-29 00:54:52,845 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-29 00:54:52,845 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/99d509f7d4a4487ba148a5a64fd99239 because midkey is the same as first or last row 2023-07-29 00:55:02,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:55:02,882 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 4a20b815c7b305045d547f965f1870f1 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-29 00:55:02,899 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=81 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/aacd54fc771147e9a8b0f6d39300b836 2023-07-29 00:55:02,906 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/aacd54fc771147e9a8b0f6d39300b836 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/aacd54fc771147e9a8b0f6d39300b836 2023-07-29 00:55:02,912 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/aacd54fc771147e9a8b0f6d39300b836, entries=8, sequenceid=81, filesize=13.0 K 2023-07-29 00:55:02,913 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=0 B/0 for 4a20b815c7b305045d547f965f1870f1 in 31ms, sequenceid=81, compaction requested=true 2023-07-29 00:55:02,913 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 4a20b815c7b305045d547f965f1870f1: 2023-07-29 00:55:02,913 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=80.2 K, sizeToCheck=16.0 K 2023-07-29 00:55:02,913 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-29 00:55:02,913 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/99d509f7d4a4487ba148a5a64fd99239 because midkey is the same as first or last row 2023-07-29 00:55:02,913 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:55:02,913 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-29 00:55:02,915 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 82087 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-29 00:55:02,915 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1912): 4a20b815c7b305045d547f965f1870f1/info is initiating minor compaction (all files) 2023-07-29 00:55:02,915 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4a20b815c7b305045d547f965f1870f1/info in TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. 2023-07-29 00:55:02,915 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/99d509f7d4a4487ba148a5a64fd99239, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/67d57564d8a948cba48003e90340781f, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/aacd54fc771147e9a8b0f6d39300b836] into tmpdir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp, totalSize=80.2 K 2023-07-29 00:55:02,916 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting 99d509f7d4a4487ba148a5a64fd99239, keycount=34, bloomtype=ROW, size=39.8 K, encoding=NONE, compression=NONE, seqNum=44, earliestPutTs=1690592080616 2023-07-29 00:55:02,916 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting 67d57564d8a948cba48003e90340781f, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=70, earliestPutTs=1690592082682 2023-07-29 00:55:02,916 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting aacd54fc771147e9a8b0f6d39300b836, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=81, earliestPutTs=1690592092814 2023-07-29 00:55:02,933 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4a20b815c7b305045d547f965f1870f1#info#compaction#21 average throughput is 16.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-29 00:55:02,953 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/7ae6b069d77b48ffbb368fafb9674a80 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/7ae6b069d77b48ffbb368fafb9674a80 2023-07-29 00:55:02,960 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4a20b815c7b305045d547f965f1870f1/info of 4a20b815c7b305045d547f965f1870f1 into 7ae6b069d77b48ffbb368fafb9674a80(size=70.9 K), total size for store is 70.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-29 00:55:02,960 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4a20b815c7b305045d547f965f1870f1: 2023-07-29 00:55:02,960 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1., storeName=4a20b815c7b305045d547f965f1870f1/info, priority=13, startTime=1690592102913; duration=0sec 2023-07-29 00:55:02,960 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=70.9 K, sizeToCheck=16.0 K 2023-07-29 00:55:02,960 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-29 00:55:02,960 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/7ae6b069d77b48ffbb368fafb9674a80 because midkey is the same as first or last row 2023-07-29 00:55:02,960 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:55:04,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:55:04,894 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 4a20b815c7b305045d547f965f1870f1 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-29 00:55:04,920 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=93 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/17a5960c1c5b4a70a0559f3bf73e8d74 2023-07-29 00:55:04,927 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=4a20b815c7b305045d547f965f1870f1, server=jenkins-hbase17.apache.org,39567,1690592069351 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-29 00:55:04,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] ipc.CallRunner(144): callId: 106 service: ClientService methodName: Mutate size: 1.1 K connection: 136.243.18.41:37304 deadline: 1690592114927, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=4a20b815c7b305045d547f965f1870f1, server=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:55:04,928 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/17a5960c1c5b4a70a0559f3bf73e8d74 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/17a5960c1c5b4a70a0559f3bf73e8d74 2023-07-29 00:55:04,937 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/17a5960c1c5b4a70a0559f3bf73e8d74, entries=8, sequenceid=93, filesize=13.0 K 2023-07-29 00:55:04,938 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 4a20b815c7b305045d547f965f1870f1 in 44ms, sequenceid=93, compaction requested=false 2023-07-29 00:55:04,938 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 4a20b815c7b305045d547f965f1870f1: 2023-07-29 00:55:04,938 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=83.9 K, sizeToCheck=16.0 K 2023-07-29 00:55:04,938 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-29 00:55:04,938 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/7ae6b069d77b48ffbb368fafb9674a80 because midkey is the same as first or last row 2023-07-29 00:55:14,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:55:14,993 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 4a20b815c7b305045d547f965f1870f1 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-29 00:55:15,019 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=118 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/4a3e30a404564e829b1c1393035096a1 2023-07-29 00:55:15,026 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/4a3e30a404564e829b1c1393035096a1 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/4a3e30a404564e829b1c1393035096a1 2023-07-29 00:55:15,035 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/4a3e30a404564e829b1c1393035096a1, entries=22, sequenceid=118, filesize=27.4 K 2023-07-29 00:55:15,036 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=2.05 KB/2102 for 4a20b815c7b305045d547f965f1870f1 in 43ms, sequenceid=118, compaction requested=true 2023-07-29 00:55:15,036 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 4a20b815c7b305045d547f965f1870f1: 2023-07-29 00:55:15,036 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=111.2 K, sizeToCheck=16.0 K 2023-07-29 00:55:15,036 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-29 00:55:15,036 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/7ae6b069d77b48ffbb368fafb9674a80 because midkey is the same as first or last row 2023-07-29 00:55:15,036 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-29 00:55:15,036 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-29 00:55:15,038 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 113891 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-29 00:55:15,038 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1912): 4a20b815c7b305045d547f965f1870f1/info is initiating minor compaction (all files) 2023-07-29 00:55:15,038 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4a20b815c7b305045d547f965f1870f1/info in TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. 2023-07-29 00:55:15,039 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/7ae6b069d77b48ffbb368fafb9674a80, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/17a5960c1c5b4a70a0559f3bf73e8d74, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/4a3e30a404564e829b1c1393035096a1] into tmpdir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp, totalSize=111.2 K 2023-07-29 00:55:15,039 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting 7ae6b069d77b48ffbb368fafb9674a80, keycount=64, bloomtype=ROW, size=70.9 K, encoding=NONE, compression=NONE, seqNum=81, earliestPutTs=1690592080616 2023-07-29 00:55:15,040 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting 17a5960c1c5b4a70a0559f3bf73e8d74, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=93, earliestPutTs=1690592104884 2023-07-29 00:55:15,040 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting 4a3e30a404564e829b1c1393035096a1, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=118, earliestPutTs=1690592104895 2023-07-29 00:55:15,056 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4a20b815c7b305045d547f965f1870f1#info#compaction#24 average throughput is 18.84 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-29 00:55:15,073 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/2f59b566ceb64f049bd4814fb3d110ec as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/2f59b566ceb64f049bd4814fb3d110ec 2023-07-29 00:55:15,080 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4a20b815c7b305045d547f965f1870f1/info of 4a20b815c7b305045d547f965f1870f1 into 2f59b566ceb64f049bd4814fb3d110ec(size=101.8 K), total size for store is 101.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-29 00:55:15,081 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4a20b815c7b305045d547f965f1870f1: 2023-07-29 00:55:15,081 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1., storeName=4a20b815c7b305045d547f965f1870f1/info, priority=13, startTime=1690592115036; duration=0sec 2023-07-29 00:55:15,081 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=101.8 K, sizeToCheck=16.0 K 2023-07-29 00:55:15,081 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-29 00:55:15,082 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.CompactSplit(227): Splitting TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1., compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:55:15,082 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:55:15,083 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46349] assignment.AssignmentManager(1140): Split request from jenkins-hbase17.apache.org,39567,1690592069351, parent={ENCODED => 4a20b815c7b305045d547f965f1870f1, NAME => 'TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.', STARTKEY => '', ENDKEY => ''} splitKey=row0064 2023-07-29 00:55:15,089 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46349] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:55:15,096 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46349] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=4a20b815c7b305045d547f965f1870f1, daughterA=2ef8ae38bc0bc32a747dfabf07a04496, daughterB=9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:15,096 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=4a20b815c7b305045d547f965f1870f1, daughterA=2ef8ae38bc0bc32a747dfabf07a04496, daughterB=9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:15,096 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=4a20b815c7b305045d547f965f1870f1, daughterA=2ef8ae38bc0bc32a747dfabf07a04496, daughterB=9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:15,096 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=4a20b815c7b305045d547f965f1870f1, daughterA=2ef8ae38bc0bc32a747dfabf07a04496, daughterB=9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:15,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=4a20b815c7b305045d547f965f1870f1, UNASSIGN}] 2023-07-29 00:55:15,107 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=4a20b815c7b305045d547f965f1870f1, UNASSIGN 2023-07-29 00:55:15,108 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4a20b815c7b305045d547f965f1870f1, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:55:15,108 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690592115108"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690592115108"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690592115108"}]},"ts":"1690592115108"} 2023-07-29 00:55:15,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; CloseRegionProcedure 4a20b815c7b305045d547f965f1870f1, server=jenkins-hbase17.apache.org,39567,1690592069351}] 2023-07-29 00:55:15,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:55:15,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 4a20b815c7b305045d547f965f1870f1, disabling compactions & flushes 2023-07-29 00:55:15,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. 2023-07-29 00:55:15,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. 2023-07-29 00:55:15,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. after waiting 0 ms 2023-07-29 00:55:15,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. 2023-07-29 00:55:15,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 4a20b815c7b305045d547f965f1870f1 1/1 column families, dataSize=2.05 KB heapSize=2.45 KB 2023-07-29 00:55:15,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.05 KB at sequenceid=124 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/f94e63822fd34324ae4b347ed4c94978 2023-07-29 00:55:15,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.tmp/info/f94e63822fd34324ae4b347ed4c94978 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/f94e63822fd34324ae4b347ed4c94978 2023-07-29 00:55:15,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/f94e63822fd34324ae4b347ed4c94978, entries=2, sequenceid=124, filesize=6.8 K 2023-07-29 00:55:15,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.05 KB/2102, heapSize ~2.44 KB/2496, currentSize=0 B/0 for 4a20b815c7b305045d547f965f1870f1 in 26ms, sequenceid=124, compaction requested=false 2023-07-29 00:55:15,301 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/c79bf8c0f2404af2af7330f9ff1722d3, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/ce77f5255dbf444ba28192fb36137d2f, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/99d509f7d4a4487ba148a5a64fd99239, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/8c48f9b37404446e8a7b3cdc7a308ca5, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/67d57564d8a948cba48003e90340781f, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/7ae6b069d77b48ffbb368fafb9674a80, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/aacd54fc771147e9a8b0f6d39300b836, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/17a5960c1c5b4a70a0559f3bf73e8d74, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/4a3e30a404564e829b1c1393035096a1] to archive 2023-07-29 00:55:15,303 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-29 00:55:15,305 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/c79bf8c0f2404af2af7330f9ff1722d3 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/c79bf8c0f2404af2af7330f9ff1722d3 2023-07-29 00:55:15,306 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/ce77f5255dbf444ba28192fb36137d2f to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/ce77f5255dbf444ba28192fb36137d2f 2023-07-29 00:55:15,308 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/99d509f7d4a4487ba148a5a64fd99239 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/99d509f7d4a4487ba148a5a64fd99239 2023-07-29 00:55:15,310 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/8c48f9b37404446e8a7b3cdc7a308ca5 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/8c48f9b37404446e8a7b3cdc7a308ca5 2023-07-29 00:55:15,312 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/67d57564d8a948cba48003e90340781f to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/67d57564d8a948cba48003e90340781f 2023-07-29 00:55:15,314 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/7ae6b069d77b48ffbb368fafb9674a80 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/7ae6b069d77b48ffbb368fafb9674a80 2023-07-29 00:55:15,316 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/aacd54fc771147e9a8b0f6d39300b836 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/aacd54fc771147e9a8b0f6d39300b836 2023-07-29 00:55:15,317 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/17a5960c1c5b4a70a0559f3bf73e8d74 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/17a5960c1c5b4a70a0559f3bf73e8d74 2023-07-29 00:55:15,318 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/4a3e30a404564e829b1c1393035096a1 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/4a3e30a404564e829b1c1393035096a1 2023-07-29 00:55:15,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/recovered.edits/127.seqid, newMaxSeqId=127, maxSeqId=1 2023-07-29 00:55:15,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. 2023-07-29 00:55:15,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 4a20b815c7b305045d547f965f1870f1: 2023-07-29 00:55:15,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:55:15,328 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4a20b815c7b305045d547f965f1870f1, regionState=CLOSED 2023-07-29 00:55:15,329 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690592115328"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690592115328"}]},"ts":"1690592115328"} 2023-07-29 00:55:15,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-29 00:55:15,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; CloseRegionProcedure 4a20b815c7b305045d547f965f1870f1, server=jenkins-hbase17.apache.org,39567,1690592069351 in 222 msec 2023-07-29 00:55:15,337 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-29 00:55:15,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=4a20b815c7b305045d547f965f1870f1, UNASSIGN in 230 msec 2023-07-29 00:55:15,360 INFO [PEWorker-1] assignment.SplitTableRegionProcedure(694): pid=12 splitting 2 storefiles, region=4a20b815c7b305045d547f965f1870f1, threads=2 2023-07-29 00:55:15,361 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/2f59b566ceb64f049bd4814fb3d110ec for region: 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:55:15,364 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/f94e63822fd34324ae4b347ed4c94978 for region: 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:55:15,380 DEBUG [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/f94e63822fd34324ae4b347ed4c94978, top=true 2023-07-29 00:55:15,401 INFO [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/.splits/9f2b9494388f1acdd4a654ed97d45176/info/TestLogRolling-testLogRolling=4a20b815c7b305045d547f965f1870f1-f94e63822fd34324ae4b347ed4c94978 for child: 9f2b9494388f1acdd4a654ed97d45176, parent: 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:55:15,401 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/f94e63822fd34324ae4b347ed4c94978 for region: 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:55:15,453 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/2f59b566ceb64f049bd4814fb3d110ec for region: 4a20b815c7b305045d547f965f1870f1 2023-07-29 00:55:15,454 DEBUG [PEWorker-1] assignment.SplitTableRegionProcedure(755): pid=12 split storefiles for region 4a20b815c7b305045d547f965f1870f1 Daughter A: 1 storefiles, Daughter B: 2 storefiles. 2023-07-29 00:55:15,509 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/2ef8ae38bc0bc32a747dfabf07a04496/recovered.edits/127.seqid, newMaxSeqId=127, maxSeqId=-1 2023-07-29 00:55:15,512 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/recovered.edits/127.seqid, newMaxSeqId=127, maxSeqId=-1 2023-07-29 00:55:15,514 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690592115514"},{"qualifier":"splitA","vlen":70,"tag":[],"timestamp":"1690592115514"},{"qualifier":"splitB","vlen":70,"tag":[],"timestamp":"1690592115514"}]},"ts":"1690592115514"} 2023-07-29 00:55:15,514 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1690592115514"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690592115514"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690592115514"}]},"ts":"1690592115514"} 2023-07-29 00:55:15,514 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1690592115514"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690592115514"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690592115514"}]},"ts":"1690592115514"} 2023-07-29 00:55:15,557 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39567] regionserver.HRegion(9158): Flush requested on 1588230740 2023-07-29 00:55:15,557 DEBUG [MemStoreFlusher.0] regionserver.FlushAllLargeStoresPolicy(69): Since none of the CFs were above the size, flushing all. 2023-07-29 00:55:15,557 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=4.82 KB heapSize=8.36 KB 2023-07-29 00:55:15,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=2ef8ae38bc0bc32a747dfabf07a04496, ASSIGN}, {pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=9f2b9494388f1acdd4a654ed97d45176, ASSIGN}] 2023-07-29 00:55:15,568 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=2ef8ae38bc0bc32a747dfabf07a04496, ASSIGN 2023-07-29 00:55:15,568 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=9f2b9494388f1acdd4a654ed97d45176, ASSIGN 2023-07-29 00:55:15,569 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=9f2b9494388f1acdd4a654ed97d45176, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase17.apache.org,39567,1690592069351; forceNewPlan=false, retain=false 2023-07-29 00:55:15,569 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=2ef8ae38bc0bc32a747dfabf07a04496, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase17.apache.org,39567,1690592069351; forceNewPlan=false, retain=false 2023-07-29 00:55:15,578 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=4.61 KB at sequenceid=17 (bloomFilter=false), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/.tmp/info/8ac8b42cd89e4673ab32bc1837cde0d1 2023-07-29 00:55:15,593 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=216 B at sequenceid=17 (bloomFilter=false), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/.tmp/table/35eceb218b9e4c7b9b7de0b9b932ee1f 2023-07-29 00:55:15,598 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/.tmp/info/8ac8b42cd89e4673ab32bc1837cde0d1 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/info/8ac8b42cd89e4673ab32bc1837cde0d1 2023-07-29 00:55:15,605 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/info/8ac8b42cd89e4673ab32bc1837cde0d1, entries=29, sequenceid=17, filesize=8.6 K 2023-07-29 00:55:15,607 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/.tmp/table/35eceb218b9e4c7b9b7de0b9b932ee1f as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/table/35eceb218b9e4c7b9b7de0b9b932ee1f 2023-07-29 00:55:15,613 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/table/35eceb218b9e4c7b9b7de0b9b932ee1f, entries=4, sequenceid=17, filesize=4.8 K 2023-07-29 00:55:15,615 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~4.82 KB/4939, heapSize ~8.08 KB/8272, currentSize=0 B/0 for 1588230740 in 58ms, sequenceid=17, compaction requested=false 2023-07-29 00:55:15,616 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-07-29 00:55:15,721 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9f2b9494388f1acdd4a654ed97d45176, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:55:15,721 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=2ef8ae38bc0bc32a747dfabf07a04496, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:55:15,721 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1690592115721"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690592115721"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690592115721"}]},"ts":"1690592115721"} 2023-07-29 00:55:15,721 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1690592115721"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690592115721"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690592115721"}]},"ts":"1690592115721"} 2023-07-29 00:55:15,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 9f2b9494388f1acdd4a654ed97d45176, server=jenkins-hbase17.apache.org,39567,1690592069351}] 2023-07-29 00:55:15,724 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=18, ppid=15, state=RUNNABLE; OpenRegionProcedure 2ef8ae38bc0bc32a747dfabf07a04496, server=jenkins-hbase17.apache.org,39567,1690592069351}] 2023-07-29 00:55:15,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496. 2023-07-29 00:55:15,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2ef8ae38bc0bc32a747dfabf07a04496, NAME => 'TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496.', STARTKEY => '', ENDKEY => 'row0064'} 2023-07-29 00:55:15,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling 2ef8ae38bc0bc32a747dfabf07a04496 2023-07-29 00:55:15,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:55:15,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 2ef8ae38bc0bc32a747dfabf07a04496 2023-07-29 00:55:15,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 2ef8ae38bc0bc32a747dfabf07a04496 2023-07-29 00:55:15,884 INFO [StoreOpener-2ef8ae38bc0bc32a747dfabf07a04496-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2ef8ae38bc0bc32a747dfabf07a04496 2023-07-29 00:55:15,885 DEBUG [StoreOpener-2ef8ae38bc0bc32a747dfabf07a04496-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/2ef8ae38bc0bc32a747dfabf07a04496/info 2023-07-29 00:55:15,885 DEBUG [StoreOpener-2ef8ae38bc0bc32a747dfabf07a04496-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/2ef8ae38bc0bc32a747dfabf07a04496/info 2023-07-29 00:55:15,885 INFO [StoreOpener-2ef8ae38bc0bc32a747dfabf07a04496-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ef8ae38bc0bc32a747dfabf07a04496 columnFamilyName info 2023-07-29 00:55:15,901 DEBUG [StoreOpener-2ef8ae38bc0bc32a747dfabf07a04496-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/2ef8ae38bc0bc32a747dfabf07a04496/info/2f59b566ceb64f049bd4814fb3d110ec.4a20b815c7b305045d547f965f1870f1->hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/2f59b566ceb64f049bd4814fb3d110ec-bottom 2023-07-29 00:55:15,901 INFO [StoreOpener-2ef8ae38bc0bc32a747dfabf07a04496-1] regionserver.HStore(310): Store=2ef8ae38bc0bc32a747dfabf07a04496/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:55:15,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/2ef8ae38bc0bc32a747dfabf07a04496 2023-07-29 00:55:15,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/2ef8ae38bc0bc32a747dfabf07a04496 2023-07-29 00:55:15,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 2ef8ae38bc0bc32a747dfabf07a04496 2023-07-29 00:55:15,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 2ef8ae38bc0bc32a747dfabf07a04496; next sequenceid=128; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=862460, jitterRate=0.0966748595237732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-29 00:55:15,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 2ef8ae38bc0bc32a747dfabf07a04496: 2023-07-29 00:55:15,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496., pid=18, masterSystemTime=1690592115877 2023-07-29 00:55:15,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:55:15,912 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-29 00:55:15,913 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496. 2023-07-29 00:55:15,913 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1912): 2ef8ae38bc0bc32a747dfabf07a04496/info is initiating minor compaction (all files) 2023-07-29 00:55:15,913 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2ef8ae38bc0bc32a747dfabf07a04496/info in TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496. 2023-07-29 00:55:15,914 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/2ef8ae38bc0bc32a747dfabf07a04496/info/2f59b566ceb64f049bd4814fb3d110ec.4a20b815c7b305045d547f965f1870f1->hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/2f59b566ceb64f049bd4814fb3d110ec-bottom] into tmpdir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/2ef8ae38bc0bc32a747dfabf07a04496/.tmp, totalSize=101.8 K 2023-07-29 00:55:15,915 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting 2f59b566ceb64f049bd4814fb3d110ec.4a20b815c7b305045d547f965f1870f1, keycount=47, bloomtype=ROW, size=101.8 K, encoding=NONE, compression=NONE, seqNum=118, earliestPutTs=1690592080616 2023-07-29 00:55:15,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496. 2023-07-29 00:55:15,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496. 2023-07-29 00:55:15,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. 2023-07-29 00:55:15,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9f2b9494388f1acdd4a654ed97d45176, NAME => 'TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.', STARTKEY => 'row0064', ENDKEY => ''} 2023-07-29 00:55:15,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:15,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:55:15,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:15,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:15,919 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=2ef8ae38bc0bc32a747dfabf07a04496, regionState=OPEN, openSeqNum=128, regionLocation=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:55:15,919 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1690592115919"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690592115919"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690592115919"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690592115919"}]},"ts":"1690592115919"} 2023-07-29 00:55:15,922 INFO [StoreOpener-9f2b9494388f1acdd4a654ed97d45176-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:15,923 DEBUG [StoreOpener-9f2b9494388f1acdd4a654ed97d45176-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info 2023-07-29 00:55:15,923 DEBUG [StoreOpener-9f2b9494388f1acdd4a654ed97d45176-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info 2023-07-29 00:55:15,924 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=15 2023-07-29 00:55:15,924 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=15, state=SUCCESS; OpenRegionProcedure 2ef8ae38bc0bc32a747dfabf07a04496, server=jenkins-hbase17.apache.org,39567,1690592069351 in 197 msec 2023-07-29 00:55:15,927 INFO [StoreOpener-9f2b9494388f1acdd4a654ed97d45176-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f2b9494388f1acdd4a654ed97d45176 columnFamilyName info 2023-07-29 00:55:15,929 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2ef8ae38bc0bc32a747dfabf07a04496#info#compaction#28 average throughput is 15.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-29 00:55:15,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=2ef8ae38bc0bc32a747dfabf07a04496, ASSIGN in 359 msec 2023-07-29 00:55:15,944 DEBUG [StoreOpener-9f2b9494388f1acdd4a654ed97d45176-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/2f59b566ceb64f049bd4814fb3d110ec.4a20b815c7b305045d547f965f1870f1->hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/2f59b566ceb64f049bd4814fb3d110ec-top 2023-07-29 00:55:15,957 DEBUG [StoreOpener-9f2b9494388f1acdd4a654ed97d45176-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/TestLogRolling-testLogRolling=4a20b815c7b305045d547f965f1870f1-f94e63822fd34324ae4b347ed4c94978 2023-07-29 00:55:15,957 INFO [StoreOpener-9f2b9494388f1acdd4a654ed97d45176-1] regionserver.HStore(310): Store=9f2b9494388f1acdd4a654ed97d45176/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:55:15,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:15,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:15,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:15,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 9f2b9494388f1acdd4a654ed97d45176; next sequenceid=128; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=713616, jitterRate=-0.09259136021137238}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-29 00:55:15,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:15,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176., pid=17, masterSystemTime=1690592115877 2023-07-29 00:55:15,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:55:15,969 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 2 store files, 0 compacting, 2 eligible, 16 blocking 2023-07-29 00:55:15,971 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/2ef8ae38bc0bc32a747dfabf07a04496/.tmp/info/2b1f326f12cd42ae8a6e904020bb2500 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/2ef8ae38bc0bc32a747dfabf07a04496/info/2b1f326f12cd42ae8a6e904020bb2500 2023-07-29 00:55:15,971 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. 2023-07-29 00:55:15,971 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HStore(1912): 9f2b9494388f1acdd4a654ed97d45176/info is initiating minor compaction (all files) 2023-07-29 00:55:15,971 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 9f2b9494388f1acdd4a654ed97d45176/info in TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. 2023-07-29 00:55:15,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. 2023-07-29 00:55:15,972 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/2f59b566ceb64f049bd4814fb3d110ec.4a20b815c7b305045d547f965f1870f1->hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/2f59b566ceb64f049bd4814fb3d110ec-top, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/TestLogRolling-testLogRolling=4a20b815c7b305045d547f965f1870f1-f94e63822fd34324ae4b347ed4c94978] into tmpdir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp, totalSize=108.6 K 2023-07-29 00:55:15,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. 2023-07-29 00:55:15,973 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] compactions.Compactor(207): Compacting 2f59b566ceb64f049bd4814fb3d110ec.4a20b815c7b305045d547f965f1870f1, keycount=47, bloomtype=ROW, size=101.8 K, encoding=NONE, compression=NONE, seqNum=119, earliestPutTs=1690592080616 2023-07-29 00:55:15,974 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9f2b9494388f1acdd4a654ed97d45176, regionState=OPEN, openSeqNum=128, regionLocation=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:55:15,974 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1690592115973"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690592115973"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690592115973"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690592115973"}]},"ts":"1690592115973"} 2023-07-29 00:55:15,975 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] compactions.Compactor(207): Compacting TestLogRolling-testLogRolling=4a20b815c7b305045d547f965f1870f1-f94e63822fd34324ae4b347ed4c94978, keycount=2, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=124, earliestPutTs=1690592114996 2023-07-29 00:55:15,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-07-29 00:55:15,981 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 9f2b9494388f1acdd4a654ed97d45176, server=jenkins-hbase17.apache.org,39567,1690592069351 in 253 msec 2023-07-29 00:55:15,987 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 2ef8ae38bc0bc32a747dfabf07a04496/info of 2ef8ae38bc0bc32a747dfabf07a04496 into 2b1f326f12cd42ae8a6e904020bb2500(size=69.7 K), total size for store is 69.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-29 00:55:15,987 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2ef8ae38bc0bc32a747dfabf07a04496: 2023-07-29 00:55:15,987 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496., storeName=2ef8ae38bc0bc32a747dfabf07a04496/info, priority=15, startTime=1690592115911; duration=0sec 2023-07-29 00:55:15,988 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:55:15,991 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=12 2023-07-29 00:55:15,991 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=9f2b9494388f1acdd4a654ed97d45176, ASSIGN in 413 msec 2023-07-29 00:55:15,994 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] throttle.PressureAwareThroughputController(145): 9f2b9494388f1acdd4a654ed97d45176#info#compaction#29 average throughput is 16.54 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-29 00:55:15,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=4a20b815c7b305045d547f965f1870f1, daughterA=2ef8ae38bc0bc32a747dfabf07a04496, daughterB=9f2b9494388f1acdd4a654ed97d45176 in 901 msec 2023-07-29 00:55:16,044 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/77d5aa699db34d62b09fd57ccce88c99 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/77d5aa699db34d62b09fd57ccce88c99 2023-07-29 00:55:16,053 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HStore(1652): Completed compaction of 2 (all) file(s) in 9f2b9494388f1acdd4a654ed97d45176/info of 9f2b9494388f1acdd4a654ed97d45176 into 77d5aa699db34d62b09fd57ccce88c99(size=38.9 K), total size for store is 38.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-29 00:55:16,053 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:16,053 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176., storeName=9f2b9494388f1acdd4a654ed97d45176/info, priority=14, startTime=1690592115969; duration=0sec 2023-07-29 00:55:16,053 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:55:16,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Mutate size: 1.1 K connection: 136.243.18.41:37304 deadline: 1690592126999, exception=org.apache.hadoop.hbase.NotServingRegionException: TestLogRolling-testLogRolling,,1690592070596.4a20b815c7b305045d547f965f1870f1. is not online on jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:55:20,877 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-29 00:55:27,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:27,065 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 9f2b9494388f1acdd4a654ed97d45176 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-29 00:55:27,083 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=139 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/04c5aa92ada44149ba3a57c7082bf110 2023-07-29 00:55:27,090 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/04c5aa92ada44149ba3a57c7082bf110 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/04c5aa92ada44149ba3a57c7082bf110 2023-07-29 00:55:27,095 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/04c5aa92ada44149ba3a57c7082bf110, entries=8, sequenceid=139, filesize=13.0 K 2023-07-29 00:55:27,097 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=19.50 KB/19969 for 9f2b9494388f1acdd4a654ed97d45176 in 32ms, sequenceid=139, compaction requested=false 2023-07-29 00:55:27,097 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:27,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:27,098 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 9f2b9494388f1acdd4a654ed97d45176 1/1 column families, dataSize=20.53 KB heapSize=22.28 KB 2023-07-29 00:55:27,112 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=20.53 KB at sequenceid=162 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/5027ed1db5f94ec5bb4c951f5f7f0489 2023-07-29 00:55:27,118 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/5027ed1db5f94ec5bb4c951f5f7f0489 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/5027ed1db5f94ec5bb4c951f5f7f0489 2023-07-29 00:55:27,123 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/5027ed1db5f94ec5bb4c951f5f7f0489, entries=20, sequenceid=162, filesize=25.3 K 2023-07-29 00:55:27,124 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~20.53 KB/21020, heapSize ~22.27 KB/22800, currentSize=4.11 KB/4204 for 9f2b9494388f1acdd4a654ed97d45176 in 26ms, sequenceid=162, compaction requested=true 2023-07-29 00:55:27,124 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:27,124 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-29 00:55:27,124 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-29 00:55:27,127 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 79022 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-29 00:55:27,128 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HStore(1912): 9f2b9494388f1acdd4a654ed97d45176/info is initiating minor compaction (all files) 2023-07-29 00:55:27,128 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 9f2b9494388f1acdd4a654ed97d45176/info in TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. 2023-07-29 00:55:27,128 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/77d5aa699db34d62b09fd57ccce88c99, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/04c5aa92ada44149ba3a57c7082bf110, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/5027ed1db5f94ec5bb4c951f5f7f0489] into tmpdir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp, totalSize=77.2 K 2023-07-29 00:55:27,129 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] compactions.Compactor(207): Compacting 77d5aa699db34d62b09fd57ccce88c99, keycount=33, bloomtype=ROW, size=38.9 K, encoding=NONE, compression=NONE, seqNum=124, earliestPutTs=1690592102878 2023-07-29 00:55:27,129 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] compactions.Compactor(207): Compacting 04c5aa92ada44149ba3a57c7082bf110, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=139, earliestPutTs=1690592127056 2023-07-29 00:55:27,130 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] compactions.Compactor(207): Compacting 5027ed1db5f94ec5bb4c951f5f7f0489, keycount=20, bloomtype=ROW, size=25.3 K, encoding=NONE, compression=NONE, seqNum=162, earliestPutTs=1690592127066 2023-07-29 00:55:27,146 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] throttle.PressureAwareThroughputController(145): 9f2b9494388f1acdd4a654ed97d45176#info#compaction#32 average throughput is 30.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-29 00:55:27,171 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/2cf8e642ddb54342b2245a9b63e3347f as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/2cf8e642ddb54342b2245a9b63e3347f 2023-07-29 00:55:27,178 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 9f2b9494388f1acdd4a654ed97d45176/info of 9f2b9494388f1acdd4a654ed97d45176 into 2cf8e642ddb54342b2245a9b63e3347f(size=67.8 K), total size for store is 67.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-29 00:55:27,178 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:27,178 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176., storeName=9f2b9494388f1acdd4a654ed97d45176/info, priority=13, startTime=1690592127124; duration=0sec 2023-07-29 00:55:27,178 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:55:29,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:29,111 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 9f2b9494388f1acdd4a654ed97d45176 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-29 00:55:29,129 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=174 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/4683fc15a95143cca5552d1f68b30f53 2023-07-29 00:55:29,136 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/4683fc15a95143cca5552d1f68b30f53 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/4683fc15a95143cca5552d1f68b30f53 2023-07-29 00:55:29,142 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/4683fc15a95143cca5552d1f68b30f53, entries=8, sequenceid=174, filesize=13.0 K 2023-07-29 00:55:29,142 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 9f2b9494388f1acdd4a654ed97d45176 in 31ms, sequenceid=174, compaction requested=false 2023-07-29 00:55:29,142 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:29,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:29,144 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 9f2b9494388f1acdd4a654ed97d45176 1/1 column families, dataSize=23.61 KB heapSize=25.59 KB 2023-07-29 00:55:29,159 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=23.61 KB at sequenceid=200 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/3deaca2e5c014205bae3fbfe2f2bcc4d 2023-07-29 00:55:29,164 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/3deaca2e5c014205bae3fbfe2f2bcc4d as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/3deaca2e5c014205bae3fbfe2f2bcc4d 2023-07-29 00:55:29,170 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/3deaca2e5c014205bae3fbfe2f2bcc4d, entries=23, sequenceid=200, filesize=28.4 K 2023-07-29 00:55:29,171 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~23.61 KB/24173, heapSize ~25.57 KB/26184, currentSize=5.13 KB/5255 for 9f2b9494388f1acdd4a654ed97d45176 in 27ms, sequenceid=200, compaction requested=true 2023-07-29 00:55:29,171 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:29,172 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-29 00:55:29,172 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-29 00:55:29,174 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 111835 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-29 00:55:29,174 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1912): 9f2b9494388f1acdd4a654ed97d45176/info is initiating minor compaction (all files) 2023-07-29 00:55:29,174 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9f2b9494388f1acdd4a654ed97d45176/info in TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. 2023-07-29 00:55:29,174 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/2cf8e642ddb54342b2245a9b63e3347f, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/4683fc15a95143cca5552d1f68b30f53, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/3deaca2e5c014205bae3fbfe2f2bcc4d] into tmpdir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp, totalSize=109.2 K 2023-07-29 00:55:29,174 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting 2cf8e642ddb54342b2245a9b63e3347f, keycount=61, bloomtype=ROW, size=67.8 K, encoding=NONE, compression=NONE, seqNum=162, earliestPutTs=1690592102878 2023-07-29 00:55:29,175 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting 4683fc15a95143cca5552d1f68b30f53, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=174, earliestPutTs=1690592127099 2023-07-29 00:55:29,175 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting 3deaca2e5c014205bae3fbfe2f2bcc4d, keycount=23, bloomtype=ROW, size=28.4 K, encoding=NONE, compression=NONE, seqNum=200, earliestPutTs=1690592129112 2023-07-29 00:55:29,189 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9f2b9494388f1acdd4a654ed97d45176#info#compaction#35 average throughput is 23.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-29 00:55:29,201 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/11663aad38bf4ca18aa1de99de548fd3 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/11663aad38bf4ca18aa1de99de548fd3 2023-07-29 00:55:29,206 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 9f2b9494388f1acdd4a654ed97d45176/info of 9f2b9494388f1acdd4a654ed97d45176 into 11663aad38bf4ca18aa1de99de548fd3(size=99.9 K), total size for store is 99.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-29 00:55:29,206 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:29,206 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176., storeName=9f2b9494388f1acdd4a654ed97d45176/info, priority=13, startTime=1690592129172; duration=0sec 2023-07-29 00:55:29,206 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:55:31,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:31,155 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 9f2b9494388f1acdd4a654ed97d45176 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-29 00:55:31,170 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=212 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/31cff198250b4a79bf293ed1a06a5494 2023-07-29 00:55:31,178 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/31cff198250b4a79bf293ed1a06a5494 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/31cff198250b4a79bf293ed1a06a5494 2023-07-29 00:55:31,184 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/31cff198250b4a79bf293ed1a06a5494, entries=8, sequenceid=212, filesize=13.0 K 2023-07-29 00:55:31,184 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=20.53 KB/21020 for 9f2b9494388f1acdd4a654ed97d45176 in 29ms, sequenceid=212, compaction requested=false 2023-07-29 00:55:31,185 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:31,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:31,186 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 9f2b9494388f1acdd4a654ed97d45176 1/1 column families, dataSize=21.55 KB heapSize=23.38 KB 2023-07-29 00:55:31,200 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=21.55 KB at sequenceid=236 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/5ec751ac49364ff883810136b47df9de 2023-07-29 00:55:31,207 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/5ec751ac49364ff883810136b47df9de as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/5ec751ac49364ff883810136b47df9de 2023-07-29 00:55:31,214 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/5ec751ac49364ff883810136b47df9de, entries=21, sequenceid=236, filesize=26.4 K 2023-07-29 00:55:31,215 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~21.55 KB/22071, heapSize ~23.37 KB/23928, currentSize=8.21 KB/8408 for 9f2b9494388f1acdd4a654ed97d45176 in 29ms, sequenceid=236, compaction requested=true 2023-07-29 00:55:31,215 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:31,216 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-29 00:55:31,216 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-29 00:55:31,217 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 142551 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-29 00:55:31,217 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HStore(1912): 9f2b9494388f1acdd4a654ed97d45176/info is initiating minor compaction (all files) 2023-07-29 00:55:31,218 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 9f2b9494388f1acdd4a654ed97d45176/info in TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. 2023-07-29 00:55:31,218 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/11663aad38bf4ca18aa1de99de548fd3, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/31cff198250b4a79bf293ed1a06a5494, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/5ec751ac49364ff883810136b47df9de] into tmpdir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp, totalSize=139.2 K 2023-07-29 00:55:31,218 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] compactions.Compactor(207): Compacting 11663aad38bf4ca18aa1de99de548fd3, keycount=92, bloomtype=ROW, size=99.9 K, encoding=NONE, compression=NONE, seqNum=200, earliestPutTs=1690592102878 2023-07-29 00:55:31,218 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] compactions.Compactor(207): Compacting 31cff198250b4a79bf293ed1a06a5494, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=212, earliestPutTs=1690592129144 2023-07-29 00:55:31,219 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] compactions.Compactor(207): Compacting 5ec751ac49364ff883810136b47df9de, keycount=21, bloomtype=ROW, size=26.4 K, encoding=NONE, compression=NONE, seqNum=236, earliestPutTs=1690592131156 2023-07-29 00:55:31,230 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] throttle.PressureAwareThroughputController(145): 9f2b9494388f1acdd4a654ed97d45176#info#compaction#38 average throughput is 40.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-29 00:55:31,244 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/e0124f638d254cbc8b15402befe54645 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/e0124f638d254cbc8b15402befe54645 2023-07-29 00:55:31,249 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 9f2b9494388f1acdd4a654ed97d45176/info of 9f2b9494388f1acdd4a654ed97d45176 into e0124f638d254cbc8b15402befe54645(size=129.9 K), total size for store is 129.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-29 00:55:31,249 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:31,249 INFO [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176., storeName=9f2b9494388f1acdd4a654ed97d45176/info, priority=13, startTime=1690592131215; duration=0sec 2023-07-29 00:55:31,249 DEBUG [RS:0;jenkins-hbase17:39567-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:55:33,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:33,203 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 9f2b9494388f1acdd4a654ed97d45176 1/1 column families, dataSize=9.24 KB heapSize=10.16 KB 2023-07-29 00:55:33,230 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=9f2b9494388f1acdd4a654ed97d45176, server=jenkins-hbase17.apache.org,39567,1690592069351 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-29 00:55:33,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] ipc.CallRunner(144): callId: 232 service: ClientService methodName: Mutate size: 1.2 K connection: 136.243.18.41:37304 deadline: 1690592143230, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=9f2b9494388f1acdd4a654ed97d45176, server=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:55:33,616 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=9.24 KB at sequenceid=249 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/b71f6b7f735346e7a99e392a87241e12 2023-07-29 00:55:33,626 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/b71f6b7f735346e7a99e392a87241e12 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/b71f6b7f735346e7a99e392a87241e12 2023-07-29 00:55:33,631 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/b71f6b7f735346e7a99e392a87241e12, entries=9, sequenceid=249, filesize=14.0 K 2023-07-29 00:55:33,632 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~9.24 KB/9459, heapSize ~10.15 KB/10392, currentSize=20.53 KB/21020 for 9f2b9494388f1acdd4a654ed97d45176 in 429ms, sequenceid=249, compaction requested=false 2023-07-29 00:55:33,632 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:43,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:43,315 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 9f2b9494388f1acdd4a654ed97d45176 1/1 column families, dataSize=21.55 KB heapSize=23.38 KB 2023-07-29 00:55:43,326 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=21.55 KB at sequenceid=273 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/a89a5698e8344286b604320040eb2612 2023-07-29 00:55:43,329 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=9f2b9494388f1acdd4a654ed97d45176, server=jenkins-hbase17.apache.org,39567,1690592069351 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-29 00:55:43,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 1.2 K connection: 136.243.18.41:37304 deadline: 1690592153329, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=9f2b9494388f1acdd4a654ed97d45176, server=jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:55:43,332 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/a89a5698e8344286b604320040eb2612 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/a89a5698e8344286b604320040eb2612 2023-07-29 00:55:43,338 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/a89a5698e8344286b604320040eb2612, entries=21, sequenceid=273, filesize=26.4 K 2023-07-29 00:55:43,339 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~21.55 KB/22071, heapSize ~23.37 KB/23928, currentSize=8.21 KB/8408 for 9f2b9494388f1acdd4a654ed97d45176 in 24ms, sequenceid=273, compaction requested=true 2023-07-29 00:55:43,339 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:43,339 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:55:43,339 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-29 00:55:43,342 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 174395 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-29 00:55:43,342 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1912): 9f2b9494388f1acdd4a654ed97d45176/info is initiating minor compaction (all files) 2023-07-29 00:55:43,342 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9f2b9494388f1acdd4a654ed97d45176/info in TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. 2023-07-29 00:55:43,342 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/e0124f638d254cbc8b15402befe54645, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/b71f6b7f735346e7a99e392a87241e12, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/a89a5698e8344286b604320040eb2612] into tmpdir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp, totalSize=170.3 K 2023-07-29 00:55:43,343 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting e0124f638d254cbc8b15402befe54645, keycount=121, bloomtype=ROW, size=129.9 K, encoding=NONE, compression=NONE, seqNum=236, earliestPutTs=1690592102878 2023-07-29 00:55:43,343 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting b71f6b7f735346e7a99e392a87241e12, keycount=9, bloomtype=ROW, size=14.0 K, encoding=NONE, compression=NONE, seqNum=249, earliestPutTs=1690592131187 2023-07-29 00:55:43,343 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting a89a5698e8344286b604320040eb2612, keycount=21, bloomtype=ROW, size=26.4 K, encoding=NONE, compression=NONE, seqNum=273, earliestPutTs=1690592133204 2023-07-29 00:55:43,354 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9f2b9494388f1acdd4a654ed97d45176#info#compaction#41 average throughput is 50.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-29 00:55:43,366 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/02d74fa23ac148fbad985bb3157d379d as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/02d74fa23ac148fbad985bb3157d379d 2023-07-29 00:55:43,373 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 9f2b9494388f1acdd4a654ed97d45176/info of 9f2b9494388f1acdd4a654ed97d45176 into 02d74fa23ac148fbad985bb3157d379d(size=161.0 K), total size for store is 161.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-29 00:55:43,373 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:43,373 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176., storeName=9f2b9494388f1acdd4a654ed97d45176/info, priority=13, startTime=1690592143339; duration=0sec 2023-07-29 00:55:43,373 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:55:53,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:53,418 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 9f2b9494388f1acdd4a654ed97d45176 1/1 column families, dataSize=9.24 KB heapSize=10.16 KB 2023-07-29 00:55:53,436 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=9.24 KB at sequenceid=286 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/e77a3ed3028f4c8b8a19bd3399ea1410 2023-07-29 00:55:53,444 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/e77a3ed3028f4c8b8a19bd3399ea1410 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/e77a3ed3028f4c8b8a19bd3399ea1410 2023-07-29 00:55:53,453 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/e77a3ed3028f4c8b8a19bd3399ea1410, entries=9, sequenceid=286, filesize=14.0 K 2023-07-29 00:55:53,454 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~9.24 KB/9459, heapSize ~10.15 KB/10392, currentSize=1.03 KB/1051 for 9f2b9494388f1acdd4a654ed97d45176 in 36ms, sequenceid=286, compaction requested=false 2023-07-29 00:55:53,454 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:55,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:55,431 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 9f2b9494388f1acdd4a654ed97d45176 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-29 00:55:55,453 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=297 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/318f39af924246d7aa46d59a9a1e7fd3 2023-07-29 00:55:55,460 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/318f39af924246d7aa46d59a9a1e7fd3 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/318f39af924246d7aa46d59a9a1e7fd3 2023-07-29 00:55:55,466 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/318f39af924246d7aa46d59a9a1e7fd3, entries=8, sequenceid=297, filesize=13.0 K 2023-07-29 00:55:55,468 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 9f2b9494388f1acdd4a654ed97d45176 in 37ms, sequenceid=297, compaction requested=true 2023-07-29 00:55:55,469 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:55,469 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:55:55,469 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-29 00:55:55,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39567] regionserver.HRegion(9158): Flush requested on 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:55,470 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 9f2b9494388f1acdd4a654ed97d45176 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-29 00:55:55,471 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 192471 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-29 00:55:55,471 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1912): 9f2b9494388f1acdd4a654ed97d45176/info is initiating minor compaction (all files) 2023-07-29 00:55:55,471 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9f2b9494388f1acdd4a654ed97d45176/info in TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. 2023-07-29 00:55:55,472 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/02d74fa23ac148fbad985bb3157d379d, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/e77a3ed3028f4c8b8a19bd3399ea1410, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/318f39af924246d7aa46d59a9a1e7fd3] into tmpdir=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp, totalSize=188.0 K 2023-07-29 00:55:55,472 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting 02d74fa23ac148fbad985bb3157d379d, keycount=151, bloomtype=ROW, size=161.0 K, encoding=NONE, compression=NONE, seqNum=273, earliestPutTs=1690592102878 2023-07-29 00:55:55,473 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting e77a3ed3028f4c8b8a19bd3399ea1410, keycount=9, bloomtype=ROW, size=14.0 K, encoding=NONE, compression=NONE, seqNum=286, earliestPutTs=1690592143316 2023-07-29 00:55:55,473 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] compactions.Compactor(207): Compacting 318f39af924246d7aa46d59a9a1e7fd3, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=297, earliestPutTs=1690592153420 2023-07-29 00:55:55,493 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=322 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/de302fa7d0164e85966bec79854cca4f 2023-07-29 00:55:55,499 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9f2b9494388f1acdd4a654ed97d45176#info#compaction#45 average throughput is 42.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-29 00:55:55,500 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/de302fa7d0164e85966bec79854cca4f as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/de302fa7d0164e85966bec79854cca4f 2023-07-29 00:55:55,513 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/de302fa7d0164e85966bec79854cca4f, entries=22, sequenceid=322, filesize=27.4 K 2023-07-29 00:55:55,514 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=3.08 KB/3153 for 9f2b9494388f1acdd4a654ed97d45176 in 44ms, sequenceid=322, compaction requested=false 2023-07-29 00:55:55,514 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:55,522 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/22650704219e439c90194e2217f2b30c as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/22650704219e439c90194e2217f2b30c 2023-07-29 00:55:55,529 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 9f2b9494388f1acdd4a654ed97d45176/info of 9f2b9494388f1acdd4a654ed97d45176 into 22650704219e439c90194e2217f2b30c(size=178.6 K), total size for store is 206.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-29 00:55:55,529 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:55,529 INFO [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176., storeName=9f2b9494388f1acdd4a654ed97d45176/info, priority=13, startTime=1690592155469; duration=0sec 2023-07-29 00:55:55,529 DEBUG [RS:0;jenkins-hbase17:39567-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-29 00:55:57,476 INFO [Listener at localhost.localdomain/45641] wal.AbstractTestLogRolling(188): after writing there are 0 log files 2023-07-29 00:55:57,499 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38429,DS-60fdb13a-cd71-4bbf-9ff0-99f515f3b9dc,DISK] 2023-07-29 00:55:57,499 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36387,DS-72d54134-ab55-43bb-aed9-2dbfb4e22a53,DISK] 2023-07-29 00:55:57,502 INFO [Listener at localhost.localdomain/45641] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/WALs/jenkins-hbase17.apache.org,39567,1690592069351/jenkins-hbase17.apache.org%2C39567%2C1690592069351.1690592069732 with entries=311, filesize=301.18 KB; new WAL /user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/WALs/jenkins-hbase17.apache.org,39567,1690592069351/jenkins-hbase17.apache.org%2C39567%2C1690592069351.1690592157478 2023-07-29 00:55:57,502 DEBUG [Listener at localhost.localdomain/45641] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38429,DS-60fdb13a-cd71-4bbf-9ff0-99f515f3b9dc,DISK], DatanodeInfoWithStorage[127.0.0.1:36387,DS-72d54134-ab55-43bb-aed9-2dbfb4e22a53,DISK]] 2023-07-29 00:55:57,502 DEBUG [Listener at localhost.localdomain/45641] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/WALs/jenkins-hbase17.apache.org,39567,1690592069351/jenkins-hbase17.apache.org%2C39567%2C1690592069351.1690592069732 is not closed yet, will try archiving it next time 2023-07-29 00:55:57,507 INFO [Listener at localhost.localdomain/45641] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.26 KB heapSize=4.19 KB 2023-07-29 00:55:57,517 INFO [Listener at localhost.localdomain/45641] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.26 KB at sequenceid=24 (bloomFilter=false), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/.tmp/info/f8155b4fa6bb48ac82abec7cd300361e 2023-07-29 00:55:57,526 DEBUG [Listener at localhost.localdomain/45641] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/.tmp/info/f8155b4fa6bb48ac82abec7cd300361e as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/info/f8155b4fa6bb48ac82abec7cd300361e 2023-07-29 00:55:57,531 INFO [Listener at localhost.localdomain/45641] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/info/f8155b4fa6bb48ac82abec7cd300361e, entries=16, sequenceid=24, filesize=7.0 K 2023-07-29 00:55:57,532 INFO [Listener at localhost.localdomain/45641] regionserver.HRegion(2948): Finished flush of dataSize ~2.26 KB/2316, heapSize ~3.67 KB/3760, currentSize=0 B/0 for 1588230740 in 25ms, sequenceid=24, compaction requested=false 2023-07-29 00:55:57,533 DEBUG [Listener at localhost.localdomain/45641] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-07-29 00:55:57,533 INFO [Listener at localhost.localdomain/45641] regionserver.HRegion(2745): Flushing 9f2b9494388f1acdd4a654ed97d45176 1/1 column families, dataSize=3.08 KB heapSize=3.55 KB 2023-07-29 00:55:57,543 INFO [Listener at localhost.localdomain/45641] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.08 KB at sequenceid=329 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/43e8bb4fec2a4e28b553d013785dfaba 2023-07-29 00:55:57,548 DEBUG [Listener at localhost.localdomain/45641] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/.tmp/info/43e8bb4fec2a4e28b553d013785dfaba as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/43e8bb4fec2a4e28b553d013785dfaba 2023-07-29 00:55:57,553 INFO [Listener at localhost.localdomain/45641] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/43e8bb4fec2a4e28b553d013785dfaba, entries=3, sequenceid=329, filesize=7.8 K 2023-07-29 00:55:57,554 INFO [Listener at localhost.localdomain/45641] regionserver.HRegion(2948): Finished flush of dataSize ~3.08 KB/3153, heapSize ~3.54 KB/3624, currentSize=0 B/0 for 9f2b9494388f1acdd4a654ed97d45176 in 21ms, sequenceid=329, compaction requested=true 2023-07-29 00:55:57,554 DEBUG [Listener at localhost.localdomain/45641] regionserver.HRegion(2446): Flush status journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:57,554 DEBUG [Listener at localhost.localdomain/45641] regionserver.HRegion(2446): Flush status journal for 2ef8ae38bc0bc32a747dfabf07a04496: 2023-07-29 00:55:57,555 INFO [Listener at localhost.localdomain/45641] regionserver.HRegion(2745): Flushing 9a4b3a3d288b106af8cdf74b925d6822 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-29 00:55:57,564 INFO [Listener at localhost.localdomain/45641] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/namespace/9a4b3a3d288b106af8cdf74b925d6822/.tmp/info/5cfefc895f2f43b28acb943552727cf8 2023-07-29 00:55:57,570 DEBUG [Listener at localhost.localdomain/45641] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/namespace/9a4b3a3d288b106af8cdf74b925d6822/.tmp/info/5cfefc895f2f43b28acb943552727cf8 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/namespace/9a4b3a3d288b106af8cdf74b925d6822/info/5cfefc895f2f43b28acb943552727cf8 2023-07-29 00:55:57,575 INFO [Listener at localhost.localdomain/45641] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/namespace/9a4b3a3d288b106af8cdf74b925d6822/info/5cfefc895f2f43b28acb943552727cf8, entries=2, sequenceid=6, filesize=4.8 K 2023-07-29 00:55:57,576 INFO [Listener at localhost.localdomain/45641] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 9a4b3a3d288b106af8cdf74b925d6822 in 21ms, sequenceid=6, compaction requested=false 2023-07-29 00:55:57,577 DEBUG [Listener at localhost.localdomain/45641] regionserver.HRegion(2446): Flush status journal for 9a4b3a3d288b106af8cdf74b925d6822: 2023-07-29 00:55:57,588 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38429,DS-60fdb13a-cd71-4bbf-9ff0-99f515f3b9dc,DISK] 2023-07-29 00:55:57,588 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36387,DS-72d54134-ab55-43bb-aed9-2dbfb4e22a53,DISK] 2023-07-29 00:55:57,590 INFO [Listener at localhost.localdomain/45641] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/WALs/jenkins-hbase17.apache.org,39567,1690592069351/jenkins-hbase17.apache.org%2C39567%2C1690592069351.1690592157478 with entries=4, filesize=1.22 KB; new WAL /user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/WALs/jenkins-hbase17.apache.org,39567,1690592069351/jenkins-hbase17.apache.org%2C39567%2C1690592069351.1690592157577 2023-07-29 00:55:57,590 DEBUG [Listener at localhost.localdomain/45641] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38429,DS-60fdb13a-cd71-4bbf-9ff0-99f515f3b9dc,DISK], DatanodeInfoWithStorage[127.0.0.1:36387,DS-72d54134-ab55-43bb-aed9-2dbfb4e22a53,DISK]] 2023-07-29 00:55:57,590 DEBUG [Listener at localhost.localdomain/45641] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/WALs/jenkins-hbase17.apache.org,39567,1690592069351/jenkins-hbase17.apache.org%2C39567%2C1690592069351.1690592157478 is not closed yet, will try archiving it next time 2023-07-29 00:55:57,594 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/WALs/jenkins-hbase17.apache.org,39567,1690592069351/jenkins-hbase17.apache.org%2C39567%2C1690592069351.1690592069732 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/oldWALs/jenkins-hbase17.apache.org%2C39567%2C1690592069351.1690592069732 2023-07-29 00:55:57,594 INFO [Listener at localhost.localdomain/45641] hbase.Waiter(180): Waiting up to [5,000] milli-secs(wait.for.ratio=[1]) 2023-07-29 00:55:57,595 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/WALs/jenkins-hbase17.apache.org,39567,1690592069351/jenkins-hbase17.apache.org%2C39567%2C1690592069351.1690592157478 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/oldWALs/jenkins-hbase17.apache.org%2C39567%2C1690592069351.1690592157478 2023-07-29 00:55:57,695 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-29 00:55:57,695 INFO [Listener at localhost.localdomain/45641] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-29 00:55:57,695 DEBUG [Listener at localhost.localdomain/45641] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11b5ebf7 to 127.0.0.1:59655 2023-07-29 00:55:57,695 DEBUG [Listener at localhost.localdomain/45641] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:55:57,695 DEBUG [Listener at localhost.localdomain/45641] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-29 00:55:57,696 DEBUG [Listener at localhost.localdomain/45641] util.JVMClusterUtil(257): Found active master hash=116238457, stopped=false 2023-07-29 00:55:57,696 INFO [Listener at localhost.localdomain/45641] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,46349,1690592069310 2023-07-29 00:55:57,697 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-29 00:55:57,697 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): regionserver:39567-0x101ae9141c80001, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-29 00:55:57,698 INFO [Listener at localhost.localdomain/45641] procedure2.ProcedureExecutor(629): Stopping 2023-07-29 00:55:57,698 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:55:57,698 DEBUG [Listener at localhost.localdomain/45641] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76306a22 to 127.0.0.1:59655 2023-07-29 00:55:57,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:55:57,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39567-0x101ae9141c80001, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:55:57,699 DEBUG [Listener at localhost.localdomain/45641] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:55:57,700 INFO [Listener at localhost.localdomain/45641] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,39567,1690592069351' ***** 2023-07-29 00:55:57,700 INFO [Listener at localhost.localdomain/45641] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-29 00:55:57,701 INFO [RS:0;jenkins-hbase17:39567] regionserver.HeapMemoryManager(220): Stopping 2023-07-29 00:55:57,701 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-29 00:55:57,701 INFO [RS:0;jenkins-hbase17:39567] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-29 00:55:57,701 INFO [RS:0;jenkins-hbase17:39567] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-29 00:55:57,701 INFO [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(3305): Received CLOSE for 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:57,702 INFO [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(3305): Received CLOSE for 2ef8ae38bc0bc32a747dfabf07a04496 2023-07-29 00:55:57,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 9f2b9494388f1acdd4a654ed97d45176, disabling compactions & flushes 2023-07-29 00:55:57,702 INFO [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(3305): Received CLOSE for 9a4b3a3d288b106af8cdf74b925d6822 2023-07-29 00:55:57,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. 2023-07-29 00:55:57,702 INFO [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:55:57,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. 2023-07-29 00:55:57,702 DEBUG [RS:0;jenkins-hbase17:39567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0cc65a72 to 127.0.0.1:59655 2023-07-29 00:55:57,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. after waiting 0 ms 2023-07-29 00:55:57,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. 2023-07-29 00:55:57,702 DEBUG [RS:0;jenkins-hbase17:39567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:55:57,703 INFO [RS:0;jenkins-hbase17:39567] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-29 00:55:57,703 INFO [RS:0;jenkins-hbase17:39567] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-29 00:55:57,704 INFO [RS:0;jenkins-hbase17:39567] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-29 00:55:57,706 INFO [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-29 00:55:57,708 INFO [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(1474): Waiting on 4 regions to close 2023-07-29 00:55:57,709 DEBUG [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 9f2b9494388f1acdd4a654ed97d45176=TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176., 2ef8ae38bc0bc32a747dfabf07a04496=TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496., 9a4b3a3d288b106af8cdf74b925d6822=hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822.} 2023-07-29 00:55:57,710 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-29 00:55:57,712 DEBUG [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(1504): Waiting on 1588230740, 2ef8ae38bc0bc32a747dfabf07a04496, 9a4b3a3d288b106af8cdf74b925d6822, 9f2b9494388f1acdd4a654ed97d45176 2023-07-29 00:55:57,714 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-29 00:55:57,714 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-29 00:55:57,714 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-29 00:55:57,714 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-29 00:55:57,715 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/2f59b566ceb64f049bd4814fb3d110ec.4a20b815c7b305045d547f965f1870f1->hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/2f59b566ceb64f049bd4814fb3d110ec-top, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/77d5aa699db34d62b09fd57ccce88c99, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/TestLogRolling-testLogRolling=4a20b815c7b305045d547f965f1870f1-f94e63822fd34324ae4b347ed4c94978, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/04c5aa92ada44149ba3a57c7082bf110, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/2cf8e642ddb54342b2245a9b63e3347f, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/5027ed1db5f94ec5bb4c951f5f7f0489, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/4683fc15a95143cca5552d1f68b30f53, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/11663aad38bf4ca18aa1de99de548fd3, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/3deaca2e5c014205bae3fbfe2f2bcc4d, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/31cff198250b4a79bf293ed1a06a5494, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/e0124f638d254cbc8b15402befe54645, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/5ec751ac49364ff883810136b47df9de, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/b71f6b7f735346e7a99e392a87241e12, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/02d74fa23ac148fbad985bb3157d379d, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/a89a5698e8344286b604320040eb2612, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/e77a3ed3028f4c8b8a19bd3399ea1410, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/318f39af924246d7aa46d59a9a1e7fd3] to archive 2023-07-29 00:55:57,717 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-29 00:55:57,719 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/2f59b566ceb64f049bd4814fb3d110ec.4a20b815c7b305045d547f965f1870f1 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/2f59b566ceb64f049bd4814fb3d110ec.4a20b815c7b305045d547f965f1870f1 2023-07-29 00:55:57,720 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/77d5aa699db34d62b09fd57ccce88c99 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/77d5aa699db34d62b09fd57ccce88c99 2023-07-29 00:55:57,725 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/TestLogRolling-testLogRolling=4a20b815c7b305045d547f965f1870f1-f94e63822fd34324ae4b347ed4c94978 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/TestLogRolling-testLogRolling=4a20b815c7b305045d547f965f1870f1-f94e63822fd34324ae4b347ed4c94978 2023-07-29 00:55:57,726 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/04c5aa92ada44149ba3a57c7082bf110 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/04c5aa92ada44149ba3a57c7082bf110 2023-07-29 00:55:57,727 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/meta/1588230740/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-07-29 00:55:57,729 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-29 00:55:57,729 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/2cf8e642ddb54342b2245a9b63e3347f to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/2cf8e642ddb54342b2245a9b63e3347f 2023-07-29 00:55:57,729 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-29 00:55:57,729 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-29 00:55:57,729 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-29 00:55:57,731 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/5027ed1db5f94ec5bb4c951f5f7f0489 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/5027ed1db5f94ec5bb4c951f5f7f0489 2023-07-29 00:55:57,732 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/4683fc15a95143cca5552d1f68b30f53 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/4683fc15a95143cca5552d1f68b30f53 2023-07-29 00:55:57,733 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/11663aad38bf4ca18aa1de99de548fd3 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/11663aad38bf4ca18aa1de99de548fd3 2023-07-29 00:55:57,735 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/3deaca2e5c014205bae3fbfe2f2bcc4d to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/3deaca2e5c014205bae3fbfe2f2bcc4d 2023-07-29 00:55:57,736 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/31cff198250b4a79bf293ed1a06a5494 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/31cff198250b4a79bf293ed1a06a5494 2023-07-29 00:55:57,737 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/e0124f638d254cbc8b15402befe54645 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/e0124f638d254cbc8b15402befe54645 2023-07-29 00:55:57,738 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/5ec751ac49364ff883810136b47df9de to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/5ec751ac49364ff883810136b47df9de 2023-07-29 00:55:57,739 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/b71f6b7f735346e7a99e392a87241e12 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/b71f6b7f735346e7a99e392a87241e12 2023-07-29 00:55:57,740 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/02d74fa23ac148fbad985bb3157d379d to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/02d74fa23ac148fbad985bb3157d379d 2023-07-29 00:55:57,741 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/a89a5698e8344286b604320040eb2612 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/a89a5698e8344286b604320040eb2612 2023-07-29 00:55:57,742 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/e77a3ed3028f4c8b8a19bd3399ea1410 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/e77a3ed3028f4c8b8a19bd3399ea1410 2023-07-29 00:55:57,743 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/318f39af924246d7aa46d59a9a1e7fd3 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/info/318f39af924246d7aa46d59a9a1e7fd3 2023-07-29 00:55:57,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/9f2b9494388f1acdd4a654ed97d45176/recovered.edits/332.seqid, newMaxSeqId=332, maxSeqId=127 2023-07-29 00:55:57,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. 2023-07-29 00:55:57,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 9f2b9494388f1acdd4a654ed97d45176: 2023-07-29 00:55:57,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,row0064,1690592115089.9f2b9494388f1acdd4a654ed97d45176. 2023-07-29 00:55:57,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 2ef8ae38bc0bc32a747dfabf07a04496, disabling compactions & flushes 2023-07-29 00:55:57,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496. 2023-07-29 00:55:57,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496. 2023-07-29 00:55:57,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496. after waiting 0 ms 2023-07-29 00:55:57,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496. 2023-07-29 00:55:57,750 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/2ef8ae38bc0bc32a747dfabf07a04496/info/2f59b566ceb64f049bd4814fb3d110ec.4a20b815c7b305045d547f965f1870f1->hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/4a20b815c7b305045d547f965f1870f1/info/2f59b566ceb64f049bd4814fb3d110ec-bottom] to archive 2023-07-29 00:55:57,750 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-29 00:55:57,752 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/2ef8ae38bc0bc32a747dfabf07a04496/info/2f59b566ceb64f049bd4814fb3d110ec.4a20b815c7b305045d547f965f1870f1 to hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/archive/data/default/TestLogRolling-testLogRolling/2ef8ae38bc0bc32a747dfabf07a04496/info/2f59b566ceb64f049bd4814fb3d110ec.4a20b815c7b305045d547f965f1870f1 2023-07-29 00:55:57,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/default/TestLogRolling-testLogRolling/2ef8ae38bc0bc32a747dfabf07a04496/recovered.edits/132.seqid, newMaxSeqId=132, maxSeqId=127 2023-07-29 00:55:57,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496. 2023-07-29 00:55:57,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 2ef8ae38bc0bc32a747dfabf07a04496: 2023-07-29 00:55:57,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,,1690592115089.2ef8ae38bc0bc32a747dfabf07a04496. 2023-07-29 00:55:57,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 9a4b3a3d288b106af8cdf74b925d6822, disabling compactions & flushes 2023-07-29 00:55:57,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822. 2023-07-29 00:55:57,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822. 2023-07-29 00:55:57,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822. after waiting 0 ms 2023-07-29 00:55:57,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822. 2023-07-29 00:55:57,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/data/hbase/namespace/9a4b3a3d288b106af8cdf74b925d6822/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-29 00:55:57,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822. 2023-07-29 00:55:57,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 9a4b3a3d288b106af8cdf74b925d6822: 2023-07-29 00:55:57,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690592069932.9a4b3a3d288b106af8cdf74b925d6822. 2023-07-29 00:55:57,914 INFO [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,39567,1690592069351; all regions closed. 2023-07-29 00:55:57,929 DEBUG [RS:0;jenkins-hbase17:39567] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/oldWALs 2023-07-29 00:55:57,929 INFO [RS:0;jenkins-hbase17:39567] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C39567%2C1690592069351.meta:.meta(num 1690592069875) 2023-07-29 00:55:57,934 DEBUG [RS:0;jenkins-hbase17:39567] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/oldWALs 2023-07-29 00:55:57,934 INFO [RS:0;jenkins-hbase17:39567] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C39567%2C1690592069351:(num 1690592157577) 2023-07-29 00:55:57,934 DEBUG [RS:0;jenkins-hbase17:39567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:55:57,934 INFO [RS:0;jenkins-hbase17:39567] regionserver.LeaseManager(133): Closed leases 2023-07-29 00:55:57,935 INFO [RS:0;jenkins-hbase17:39567] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-29 00:55:57,935 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-29 00:55:57,936 INFO [RS:0;jenkins-hbase17:39567] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:39567 2023-07-29 00:55:57,937 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-29 00:55:57,937 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): regionserver:39567-0x101ae9141c80001, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,39567,1690592069351 2023-07-29 00:55:57,937 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): regionserver:39567-0x101ae9141c80001, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-29 00:55:57,938 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,39567,1690592069351] 2023-07-29 00:55:57,938 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,39567,1690592069351; numProcessing=1 2023-07-29 00:55:57,938 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,39567,1690592069351 already deleted, retry=false 2023-07-29 00:55:57,938 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,39567,1690592069351 expired; onlineServers=0 2023-07-29 00:55:57,938 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,46349,1690592069310' ***** 2023-07-29 00:55:57,938 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-29 00:55:57,939 DEBUG [M:0;jenkins-hbase17:46349] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d22c7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-29 00:55:57,939 INFO [M:0;jenkins-hbase17:46349] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,46349,1690592069310 2023-07-29 00:55:57,939 INFO [M:0;jenkins-hbase17:46349] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,46349,1690592069310; all regions closed. 2023-07-29 00:55:57,939 DEBUG [M:0;jenkins-hbase17:46349] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:55:57,939 DEBUG [M:0;jenkins-hbase17:46349] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-29 00:55:57,939 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-29 00:55:57,939 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690592069499] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690592069499,5,FailOnTimeoutGroup] 2023-07-29 00:55:57,939 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690592069499] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690592069499,5,FailOnTimeoutGroup] 2023-07-29 00:55:57,939 DEBUG [M:0;jenkins-hbase17:46349] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-29 00:55:57,940 INFO [M:0;jenkins-hbase17:46349] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-29 00:55:57,940 INFO [M:0;jenkins-hbase17:46349] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-29 00:55:57,940 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-29 00:55:57,940 INFO [M:0;jenkins-hbase17:46349] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-07-29 00:55:57,940 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:55:57,940 DEBUG [M:0;jenkins-hbase17:46349] master.HMaster(1512): Stopping service threads 2023-07-29 00:55:57,940 INFO [M:0;jenkins-hbase17:46349] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-29 00:55:57,941 ERROR [M:0;jenkins-hbase17:46349] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-29 00:55:57,941 INFO [M:0;jenkins-hbase17:46349] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-29 00:55:57,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-29 00:55:57,941 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-29 00:55:57,941 DEBUG [M:0;jenkins-hbase17:46349] zookeeper.ZKUtil(398): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-29 00:55:57,941 WARN [M:0;jenkins-hbase17:46349] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-29 00:55:57,941 INFO [M:0;jenkins-hbase17:46349] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-29 00:55:57,941 INFO [M:0;jenkins-hbase17:46349] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-29 00:55:57,942 DEBUG [M:0;jenkins-hbase17:46349] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-29 00:55:57,942 INFO [M:0;jenkins-hbase17:46349] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:55:57,942 DEBUG [M:0;jenkins-hbase17:46349] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:55:57,942 DEBUG [M:0;jenkins-hbase17:46349] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-29 00:55:57,942 DEBUG [M:0;jenkins-hbase17:46349] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:55:57,942 INFO [M:0;jenkins-hbase17:46349] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=64.80 KB heapSize=78.54 KB 2023-07-29 00:55:57,954 INFO [M:0;jenkins-hbase17:46349] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=64.80 KB at sequenceid=160 (bloomFilter=true), to=hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9245f3468521421587733d4293dffd78 2023-07-29 00:55:57,959 INFO [M:0;jenkins-hbase17:46349] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9245f3468521421587733d4293dffd78 2023-07-29 00:55:57,960 DEBUG [M:0;jenkins-hbase17:46349] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9245f3468521421587733d4293dffd78 as hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9245f3468521421587733d4293dffd78 2023-07-29 00:55:57,966 INFO [M:0;jenkins-hbase17:46349] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9245f3468521421587733d4293dffd78 2023-07-29 00:55:57,966 INFO [M:0;jenkins-hbase17:46349] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38077/user/jenkins/test-data/1a0be52a-e1a9-3d5d-2c1c-a959fe9c8c2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9245f3468521421587733d4293dffd78, entries=18, sequenceid=160, filesize=6.9 K 2023-07-29 00:55:57,966 INFO [M:0;jenkins-hbase17:46349] regionserver.HRegion(2948): Finished flush of dataSize ~64.80 KB/66352, heapSize ~78.52 KB/80408, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=160, compaction requested=false 2023-07-29 00:55:57,968 INFO [M:0;jenkins-hbase17:46349] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:55:57,968 DEBUG [M:0;jenkins-hbase17:46349] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-29 00:55:57,971 INFO [M:0;jenkins-hbase17:46349] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-29 00:55:57,971 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-29 00:55:57,971 INFO [M:0;jenkins-hbase17:46349] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:46349 2023-07-29 00:55:57,973 DEBUG [M:0;jenkins-hbase17:46349] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,46349,1690592069310 already deleted, retry=false 2023-07-29 00:55:58,038 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): regionserver:39567-0x101ae9141c80001, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:55:58,039 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): regionserver:39567-0x101ae9141c80001, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:55:58,038 INFO [RS:0;jenkins-hbase17:39567] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,39567,1690592069351; zookeeper connection closed. 2023-07-29 00:55:58,040 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2ffcc710] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2ffcc710 2023-07-29 00:55:58,041 INFO [Listener at localhost.localdomain/45641] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-29 00:55:58,139 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:55:58,139 DEBUG [Listener at localhost.localdomain/45641-EventThread] zookeeper.ZKWatcher(600): master:46349-0x101ae9141c80000, quorum=127.0.0.1:59655, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:55:58,139 INFO [M:0;jenkins-hbase17:46349] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,46349,1690592069310; zookeeper connection closed. 2023-07-29 00:55:58,142 WARN [Listener at localhost.localdomain/45641] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-29 00:55:58,150 INFO [Listener at localhost.localdomain/45641] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-29 00:55:58,262 WARN [BP-630986698-136.243.18.41-1690592068843 heartbeating to localhost.localdomain/127.0.0.1:38077] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-29 00:55:58,262 WARN [BP-630986698-136.243.18.41-1690592068843 heartbeating to localhost.localdomain/127.0.0.1:38077] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-630986698-136.243.18.41-1690592068843 (Datanode Uuid 171d7824-d307-4c31-96e7-3d31c2bf35c9) service to localhost.localdomain/127.0.0.1:38077 2023-07-29 00:55:58,263 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/cluster_0f8b103c-726e-f7f2-d6c2-faf27a1ae7ae/dfs/data/data3/current/BP-630986698-136.243.18.41-1690592068843] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:55:58,264 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/cluster_0f8b103c-726e-f7f2-d6c2-faf27a1ae7ae/dfs/data/data4/current/BP-630986698-136.243.18.41-1690592068843] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:55:58,266 WARN [Listener at localhost.localdomain/45641] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-29 00:55:58,275 INFO [Listener at localhost.localdomain/45641] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-29 00:55:58,381 WARN [BP-630986698-136.243.18.41-1690592068843 heartbeating to localhost.localdomain/127.0.0.1:38077] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-29 00:55:58,382 WARN [BP-630986698-136.243.18.41-1690592068843 heartbeating to localhost.localdomain/127.0.0.1:38077] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-630986698-136.243.18.41-1690592068843 (Datanode Uuid b6d88c60-b231-4b35-87d5-6ffad2244a4c) service to localhost.localdomain/127.0.0.1:38077 2023-07-29 00:55:58,382 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/cluster_0f8b103c-726e-f7f2-d6c2-faf27a1ae7ae/dfs/data/data1/current/BP-630986698-136.243.18.41-1690592068843] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:55:58,383 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/cluster_0f8b103c-726e-f7f2-d6c2-faf27a1ae7ae/dfs/data/data2/current/BP-630986698-136.243.18.41-1690592068843] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:55:58,398 INFO [Listener at localhost.localdomain/45641] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-29 00:55:58,522 INFO [Listener at localhost.localdomain/45641] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-29 00:55:58,558 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-29 00:55:58,567 INFO [Listener at localhost.localdomain/45641] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=76 (was 65) - Thread LEAK? -, OpenFileDescriptor=469 (was 438) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 129) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=10067 (was 9965) - AvailableMemoryMB LEAK? - 2023-07-29 00:55:58,575 INFO [Listener at localhost.localdomain/45641] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=77, OpenFileDescriptor=469, MaxFileDescriptor=60000, SystemLoadAverage=156, ProcessCount=171, AvailableMemoryMB=10067 2023-07-29 00:55:58,575 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-29 00:55:58,575 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/hadoop.log.dir so I do NOT create it in target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014 2023-07-29 00:55:58,575 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/712a0ad5-87cc-eb13-206e-c23861b871bc/hadoop.tmp.dir so I do NOT create it in target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014 2023-07-29 00:55:58,575 INFO [Listener at localhost.localdomain/45641] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/cluster_2be59c66-cc59-c61f-5c2f-62d89e034ed1, deleteOnExit=true 2023-07-29 00:55:58,575 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-29 00:55:58,575 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/test.cache.data in system properties and HBase conf 2023-07-29 00:55:58,576 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/hadoop.tmp.dir in system properties and HBase conf 2023-07-29 00:55:58,576 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/hadoop.log.dir in system properties and HBase conf 2023-07-29 00:55:58,576 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-29 00:55:58,576 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-29 00:55:58,576 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-29 00:55:58,576 DEBUG [Listener at localhost.localdomain/45641] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-29 00:55:58,576 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-29 00:55:58,576 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-29 00:55:58,577 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-29 00:55:58,577 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-29 00:55:58,577 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-29 00:55:58,577 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-29 00:55:58,577 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-29 00:55:58,577 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-29 00:55:58,577 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-29 00:55:58,577 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/nfs.dump.dir in system properties and HBase conf 2023-07-29 00:55:58,578 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/java.io.tmpdir in system properties and HBase conf 2023-07-29 00:55:58,578 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-29 00:55:58,578 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-29 00:55:58,578 INFO [Listener at localhost.localdomain/45641] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-29 00:55:58,582 WARN [Listener at localhost.localdomain/45641] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-29 00:55:58,582 WARN [Listener at localhost.localdomain/45641] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-29 00:55:58,607 WARN [Listener at localhost.localdomain/45641] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:55:58,609 INFO [Listener at localhost.localdomain/45641] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:55:58,613 INFO [Listener at localhost.localdomain/45641] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/java.io.tmpdir/Jetty_localhost_localdomain_45059_hdfs____.fcs3n7/webapp 2023-07-29 00:55:58,686 INFO [Listener at localhost.localdomain/45641] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:45059 2023-07-29 00:55:58,688 WARN [Listener at localhost.localdomain/45641] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-29 00:55:58,688 WARN [Listener at localhost.localdomain/45641] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-29 00:55:58,712 WARN [Listener at localhost.localdomain/39149] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:55:58,727 WARN [Listener at localhost.localdomain/39149] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-29 00:55:58,729 WARN [Listener at localhost.localdomain/39149] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:55:58,730 INFO [Listener at localhost.localdomain/39149] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:55:58,735 INFO [Listener at localhost.localdomain/39149] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/java.io.tmpdir/Jetty_localhost_43791_datanode____b7aaaf/webapp 2023-07-29 00:55:58,807 INFO [Listener at localhost.localdomain/39149] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43791 2023-07-29 00:55:58,813 WARN [Listener at localhost.localdomain/40951] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:55:58,822 WARN [Listener at localhost.localdomain/40951] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-29 00:55:58,823 WARN [Listener at localhost.localdomain/40951] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-29 00:55:58,824 INFO [Listener at localhost.localdomain/40951] log.Slf4jLog(67): jetty-6.1.26 2023-07-29 00:55:58,829 INFO [Listener at localhost.localdomain/40951] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/java.io.tmpdir/Jetty_localhost_41153_datanode____.qqet5z/webapp 2023-07-29 00:55:58,864 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1bbc36053ad9f8bb: Processing first storage report for DS-baf08a8c-5ea9-4b9c-85ce-00e4fc8f8109 from datanode 94c0e099-1e21-4482-aaa3-78e57bfe656c 2023-07-29 00:55:58,864 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1bbc36053ad9f8bb: from storage DS-baf08a8c-5ea9-4b9c-85ce-00e4fc8f8109 node DatanodeRegistration(127.0.0.1:36969, datanodeUuid=94c0e099-1e21-4482-aaa3-78e57bfe656c, infoPort=46653, infoSecurePort=0, ipcPort=40951, storageInfo=lv=-57;cid=testClusterID;nsid=474707791;c=1690592158584), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:55:58,865 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1bbc36053ad9f8bb: Processing first storage report for DS-a114ad14-0bc5-4310-b461-0508bdd1ea6e from datanode 94c0e099-1e21-4482-aaa3-78e57bfe656c 2023-07-29 00:55:58,865 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1bbc36053ad9f8bb: from storage DS-a114ad14-0bc5-4310-b461-0508bdd1ea6e node DatanodeRegistration(127.0.0.1:36969, datanodeUuid=94c0e099-1e21-4482-aaa3-78e57bfe656c, infoPort=46653, infoSecurePort=0, ipcPort=40951, storageInfo=lv=-57;cid=testClusterID;nsid=474707791;c=1690592158584), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:55:58,907 INFO [Listener at localhost.localdomain/40951] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41153 2023-07-29 00:55:58,915 WARN [Listener at localhost.localdomain/45183] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-29 00:55:58,967 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfab2b5779328b7e2: Processing first storage report for DS-81039b7e-88fc-44a7-bc84-9980496d9b81 from datanode 50b69e61-fcbc-4fd1-b708-64003c724ddc 2023-07-29 00:55:58,967 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfab2b5779328b7e2: from storage DS-81039b7e-88fc-44a7-bc84-9980496d9b81 node DatanodeRegistration(127.0.0.1:33865, datanodeUuid=50b69e61-fcbc-4fd1-b708-64003c724ddc, infoPort=38617, infoSecurePort=0, ipcPort=45183, storageInfo=lv=-57;cid=testClusterID;nsid=474707791;c=1690592158584), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-29 00:55:58,967 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfab2b5779328b7e2: Processing first storage report for DS-b8675ae1-98c7-4e02-a2dd-fe84123075e1 from datanode 50b69e61-fcbc-4fd1-b708-64003c724ddc 2023-07-29 00:55:58,967 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfab2b5779328b7e2: from storage DS-b8675ae1-98c7-4e02-a2dd-fe84123075e1 node DatanodeRegistration(127.0.0.1:33865, datanodeUuid=50b69e61-fcbc-4fd1-b708-64003c724ddc, infoPort=38617, infoSecurePort=0, ipcPort=45183, storageInfo=lv=-57;cid=testClusterID;nsid=474707791;c=1690592158584), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-29 00:55:59,021 DEBUG [Listener at localhost.localdomain/45183] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014 2023-07-29 00:55:59,025 INFO [Listener at localhost.localdomain/45183] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/cluster_2be59c66-cc59-c61f-5c2f-62d89e034ed1/zookeeper_0, clientPort=52787, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/cluster_2be59c66-cc59-c61f-5c2f-62d89e034ed1/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/cluster_2be59c66-cc59-c61f-5c2f-62d89e034ed1/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-29 00:55:59,026 INFO [Listener at localhost.localdomain/45183] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52787 2023-07-29 00:55:59,026 INFO [Listener at localhost.localdomain/45183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:55:59,027 INFO [Listener at localhost.localdomain/45183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:55:59,041 INFO [Listener at localhost.localdomain/45183] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e with version=8 2023-07-29 00:55:59,041 INFO [Listener at localhost.localdomain/45183] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost.localdomain:40329/user/jenkins/test-data/577bc1ea-d62b-70c1-eee2-0842ce5441d9/hbase-staging 2023-07-29 00:55:59,043 INFO [Listener at localhost.localdomain/45183] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-07-29 00:55:59,043 INFO [Listener at localhost.localdomain/45183] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:55:59,044 INFO [Listener at localhost.localdomain/45183] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-29 00:55:59,044 INFO [Listener at localhost.localdomain/45183] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-29 00:55:59,044 INFO [Listener at localhost.localdomain/45183] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:55:59,044 INFO [Listener at localhost.localdomain/45183] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-29 00:55:59,044 INFO [Listener at localhost.localdomain/45183] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-29 00:55:59,046 INFO [Listener at localhost.localdomain/45183] ipc.NettyRpcServer(120): Bind to /136.243.18.41:35737 2023-07-29 00:55:59,046 INFO [Listener at localhost.localdomain/45183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:55:59,048 INFO [Listener at localhost.localdomain/45183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:55:59,050 INFO [Listener at localhost.localdomain/45183] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35737 connecting to ZooKeeper ensemble=127.0.0.1:52787 2023-07-29 00:55:59,055 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:357370x0, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-29 00:55:59,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35737-0x101ae92a04f0000 connected 2023-07-29 00:55:59,065 DEBUG [Listener at localhost.localdomain/45183] zookeeper.ZKUtil(164): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-29 00:55:59,066 DEBUG [Listener at localhost.localdomain/45183] zookeeper.ZKUtil(164): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:55:59,066 DEBUG [Listener at localhost.localdomain/45183] zookeeper.ZKUtil(164): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-29 00:55:59,066 DEBUG [Listener at localhost.localdomain/45183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35737 2023-07-29 00:55:59,067 DEBUG [Listener at localhost.localdomain/45183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35737 2023-07-29 00:55:59,067 DEBUG [Listener at localhost.localdomain/45183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35737 2023-07-29 00:55:59,067 DEBUG [Listener at localhost.localdomain/45183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35737 2023-07-29 00:55:59,068 DEBUG [Listener at localhost.localdomain/45183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35737 2023-07-29 00:55:59,068 INFO [Listener at localhost.localdomain/45183] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e, hbase.cluster.distributed=false 2023-07-29 00:55:59,083 INFO [Listener at localhost.localdomain/45183] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-29 00:55:59,083 INFO [Listener at localhost.localdomain/45183] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:55:59,083 INFO [Listener at localhost.localdomain/45183] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-29 00:55:59,083 INFO [Listener at localhost.localdomain/45183] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-29 00:55:59,083 INFO [Listener at localhost.localdomain/45183] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-29 00:55:59,083 INFO [Listener at localhost.localdomain/45183] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-29 00:55:59,084 INFO [Listener at localhost.localdomain/45183] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-29 00:55:59,086 INFO [Listener at localhost.localdomain/45183] ipc.NettyRpcServer(120): Bind to /136.243.18.41:44177 2023-07-29 00:55:59,086 INFO [Listener at localhost.localdomain/45183] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-29 00:55:59,087 DEBUG [Listener at localhost.localdomain/45183] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-29 00:55:59,088 INFO [Listener at localhost.localdomain/45183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:55:59,088 INFO [Listener at localhost.localdomain/45183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:55:59,089 INFO [Listener at localhost.localdomain/45183] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44177 connecting to ZooKeeper ensemble=127.0.0.1:52787 2023-07-29 00:55:59,091 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): regionserver:441770x0, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-29 00:55:59,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44177-0x101ae92a04f0001 connected 2023-07-29 00:55:59,093 DEBUG [Listener at localhost.localdomain/45183] zookeeper.ZKUtil(164): regionserver:44177-0x101ae92a04f0001, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-29 00:55:59,094 DEBUG [Listener at localhost.localdomain/45183] zookeeper.ZKUtil(164): regionserver:44177-0x101ae92a04f0001, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:55:59,095 DEBUG [Listener at localhost.localdomain/45183] zookeeper.ZKUtil(164): regionserver:44177-0x101ae92a04f0001, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-29 00:55:59,095 DEBUG [Listener at localhost.localdomain/45183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44177 2023-07-29 00:55:59,095 DEBUG [Listener at localhost.localdomain/45183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44177 2023-07-29 00:55:59,096 DEBUG [Listener at localhost.localdomain/45183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44177 2023-07-29 00:55:59,096 DEBUG [Listener at localhost.localdomain/45183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44177 2023-07-29 00:55:59,096 DEBUG [Listener at localhost.localdomain/45183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44177 2023-07-29 00:55:59,097 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,35737,1690592159043 2023-07-29 00:55:59,098 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-29 00:55:59,098 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,35737,1690592159043 2023-07-29 00:55:59,099 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-29 00:55:59,099 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x101ae92a04f0001, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-29 00:55:59,099 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:55:59,100 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-29 00:55:59,101 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,35737,1690592159043 from backup master directory 2023-07-29 00:55:59,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-29 00:55:59,101 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,35737,1690592159043 2023-07-29 00:55:59,101 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-29 00:55:59,101 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-29 00:55:59,101 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,35737,1690592159043 2023-07-29 00:55:59,117 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/hbase.id with ID: 3dc9efe9-e806-4735-9371-2d9acb9aa7ce 2023-07-29 00:55:59,130 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:55:59,132 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:55:59,140 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0b501d08 to 127.0.0.1:52787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-29 00:55:59,143 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@739d6242, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-29 00:55:59,143 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-29 00:55:59,144 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-29 00:55:59,144 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-29 00:55:59,146 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/MasterData/data/master/store-tmp 2023-07-29 00:55:59,155 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:55:59,155 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-29 00:55:59,155 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:55:59,155 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:55:59,155 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-29 00:55:59,155 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:55:59,155 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:55:59,155 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-29 00:55:59,156 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/MasterData/WALs/jenkins-hbase17.apache.org,35737,1690592159043 2023-07-29 00:55:59,159 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C35737%2C1690592159043, suffix=, logDir=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/MasterData/WALs/jenkins-hbase17.apache.org,35737,1690592159043, archiveDir=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/MasterData/oldWALs, maxLogs=10 2023-07-29 00:55:59,173 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33865,DS-81039b7e-88fc-44a7-bc84-9980496d9b81,DISK] 2023-07-29 00:55:59,174 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36969,DS-baf08a8c-5ea9-4b9c-85ce-00e4fc8f8109,DISK] 2023-07-29 00:55:59,176 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/MasterData/WALs/jenkins-hbase17.apache.org,35737,1690592159043/jenkins-hbase17.apache.org%2C35737%2C1690592159043.1690592159159 2023-07-29 00:55:59,176 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33865,DS-81039b7e-88fc-44a7-bc84-9980496d9b81,DISK], DatanodeInfoWithStorage[127.0.0.1:36969,DS-baf08a8c-5ea9-4b9c-85ce-00e4fc8f8109,DISK]] 2023-07-29 00:55:59,176 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-29 00:55:59,176 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:55:59,176 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:55:59,176 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:55:59,178 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:55:59,179 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-29 00:55:59,180 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-29 00:55:59,180 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:55:59,181 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:55:59,181 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:55:59,184 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-29 00:55:59,186 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-29 00:55:59,186 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=750266, jitterRate=-0.04598750174045563}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-29 00:55:59,186 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-29 00:55:59,186 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-29 00:55:59,188 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-29 00:55:59,188 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-29 00:55:59,188 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-29 00:55:59,188 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-29 00:55:59,188 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-07-29 00:55:59,189 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-29 00:55:59,189 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-29 00:55:59,190 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-29 00:55:59,201 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-29 00:55:59,201 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-29 00:55:59,202 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-29 00:55:59,202 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-29 00:55:59,202 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-29 00:55:59,204 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:55:59,205 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-29 00:55:59,205 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-29 00:55:59,206 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-29 00:55:59,207 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x101ae92a04f0001, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-29 00:55:59,207 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-29 00:55:59,207 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:55:59,207 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,35737,1690592159043, sessionid=0x101ae92a04f0000, setting cluster-up flag (Was=false) 2023-07-29 00:55:59,210 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:55:59,212 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-29 00:55:59,213 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,35737,1690592159043 2023-07-29 00:55:59,215 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:55:59,218 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-29 00:55:59,219 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,35737,1690592159043 2023-07-29 00:55:59,220 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/.hbase-snapshot/.tmp 2023-07-29 00:55:59,221 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-29 00:55:59,222 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:55:59,222 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:55:59,222 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:55:59,222 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-29 00:55:59,222 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-07-29 00:55:59,222 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:55:59,222 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-29 00:55:59,222 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:55:59,223 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690592189223 2023-07-29 00:55:59,223 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-29 00:55:59,223 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-29 00:55:59,223 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-29 00:55:59,223 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-29 00:55:59,223 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-29 00:55:59,223 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-29 00:55:59,223 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-29 00:55:59,224 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-29 00:55:59,224 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-29 00:55:59,224 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-29 00:55:59,224 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-29 00:55:59,224 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-29 00:55:59,224 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-29 00:55:59,224 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-29 00:55:59,225 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-29 00:55:59,228 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690592159224,5,FailOnTimeoutGroup] 2023-07-29 00:55:59,229 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690592159229,5,FailOnTimeoutGroup] 2023-07-29 00:55:59,229 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-29 00:55:59,229 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-29 00:55:59,229 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-29 00:55:59,229 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-29 00:55:59,235 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-29 00:55:59,237 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-29 00:55:59,237 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e 2023-07-29 00:55:59,245 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:55:59,246 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-29 00:55:59,248 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/info 2023-07-29 00:55:59,248 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-29 00:55:59,249 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:55:59,249 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-29 00:55:59,250 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/rep_barrier 2023-07-29 00:55:59,250 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-29 00:55:59,251 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:55:59,251 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-29 00:55:59,252 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/table 2023-07-29 00:55:59,252 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-29 00:55:59,253 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:55:59,254 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740 2023-07-29 00:55:59,255 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740 2023-07-29 00:55:59,257 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-29 00:55:59,259 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-29 00:55:59,261 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-29 00:55:59,262 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=822807, jitterRate=0.04625342786312103}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-29 00:55:59,262 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-29 00:55:59,262 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-29 00:55:59,262 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-29 00:55:59,262 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-29 00:55:59,262 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-29 00:55:59,262 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-29 00:55:59,262 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-29 00:55:59,263 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-29 00:55:59,263 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-29 00:55:59,263 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-29 00:55:59,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-29 00:55:59,265 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-29 00:55:59,266 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-29 00:55:59,300 INFO [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(951): ClusterId : 3dc9efe9-e806-4735-9371-2d9acb9aa7ce 2023-07-29 00:55:59,301 DEBUG [RS:0;jenkins-hbase17:44177] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-29 00:55:59,305 DEBUG [RS:0;jenkins-hbase17:44177] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-29 00:55:59,305 DEBUG [RS:0;jenkins-hbase17:44177] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-29 00:55:59,308 DEBUG [RS:0;jenkins-hbase17:44177] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-29 00:55:59,310 DEBUG [RS:0;jenkins-hbase17:44177] zookeeper.ReadOnlyZKClient(139): Connect 0x51a9fe2d to 127.0.0.1:52787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-29 00:55:59,317 DEBUG [RS:0;jenkins-hbase17:44177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f6e1a68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-29 00:55:59,317 DEBUG [RS:0;jenkins-hbase17:44177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b51955d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-29 00:55:59,329 DEBUG [RS:0;jenkins-hbase17:44177] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:44177 2023-07-29 00:55:59,329 INFO [RS:0;jenkins-hbase17:44177] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-29 00:55:59,329 INFO [RS:0;jenkins-hbase17:44177] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-29 00:55:59,329 DEBUG [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(1022): About to register with Master. 2023-07-29 00:55:59,330 INFO [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,35737,1690592159043 with isa=jenkins-hbase17.apache.org/136.243.18.41:44177, startcode=1690592159082 2023-07-29 00:55:59,330 DEBUG [RS:0;jenkins-hbase17:44177] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-29 00:55:59,333 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:58931, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-07-29 00:55:59,334 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35737] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,44177,1690592159082 2023-07-29 00:55:59,335 DEBUG [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e 2023-07-29 00:55:59,335 DEBUG [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:39149 2023-07-29 00:55:59,335 DEBUG [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-29 00:55:59,336 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-29 00:55:59,336 DEBUG [RS:0;jenkins-hbase17:44177] zookeeper.ZKUtil(162): regionserver:44177-0x101ae92a04f0001, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44177,1690592159082 2023-07-29 00:55:59,336 WARN [RS:0;jenkins-hbase17:44177] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-29 00:55:59,337 INFO [RS:0;jenkins-hbase17:44177] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-29 00:55:59,337 DEBUG [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/WALs/jenkins-hbase17.apache.org,44177,1690592159082 2023-07-29 00:55:59,337 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,44177,1690592159082] 2023-07-29 00:55:59,340 DEBUG [RS:0;jenkins-hbase17:44177] zookeeper.ZKUtil(162): regionserver:44177-0x101ae92a04f0001, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44177,1690592159082 2023-07-29 00:55:59,341 DEBUG [RS:0;jenkins-hbase17:44177] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-29 00:55:59,341 INFO [RS:0;jenkins-hbase17:44177] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-29 00:55:59,343 INFO [RS:0;jenkins-hbase17:44177] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-29 00:55:59,343 INFO [RS:0;jenkins-hbase17:44177] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-29 00:55:59,343 INFO [RS:0;jenkins-hbase17:44177] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-29 00:55:59,343 INFO [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-29 00:55:59,345 INFO [RS:0;jenkins-hbase17:44177] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-29 00:55:59,345 DEBUG [RS:0;jenkins-hbase17:44177] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:55:59,345 DEBUG [RS:0;jenkins-hbase17:44177] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:55:59,345 DEBUG [RS:0;jenkins-hbase17:44177] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:55:59,345 DEBUG [RS:0;jenkins-hbase17:44177] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:55:59,345 DEBUG [RS:0;jenkins-hbase17:44177] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:55:59,345 DEBUG [RS:0;jenkins-hbase17:44177] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-29 00:55:59,345 DEBUG [RS:0;jenkins-hbase17:44177] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:55:59,345 DEBUG [RS:0;jenkins-hbase17:44177] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:55:59,345 DEBUG [RS:0;jenkins-hbase17:44177] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:55:59,345 DEBUG [RS:0;jenkins-hbase17:44177] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-29 00:55:59,347 INFO [RS:0;jenkins-hbase17:44177] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-29 00:55:59,347 INFO [RS:0;jenkins-hbase17:44177] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-29 00:55:59,348 INFO [RS:0;jenkins-hbase17:44177] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-29 00:55:59,358 INFO [RS:0;jenkins-hbase17:44177] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-29 00:55:59,358 INFO [RS:0;jenkins-hbase17:44177] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,44177,1690592159082-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-29 00:55:59,367 INFO [RS:0;jenkins-hbase17:44177] regionserver.Replication(203): jenkins-hbase17.apache.org,44177,1690592159082 started 2023-07-29 00:55:59,367 INFO [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,44177,1690592159082, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:44177, sessionid=0x101ae92a04f0001 2023-07-29 00:55:59,367 DEBUG [RS:0;jenkins-hbase17:44177] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-29 00:55:59,367 DEBUG [RS:0;jenkins-hbase17:44177] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,44177,1690592159082 2023-07-29 00:55:59,368 DEBUG [RS:0;jenkins-hbase17:44177] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,44177,1690592159082' 2023-07-29 00:55:59,368 DEBUG [RS:0;jenkins-hbase17:44177] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-29 00:55:59,368 DEBUG [RS:0;jenkins-hbase17:44177] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-29 00:55:59,368 DEBUG [RS:0;jenkins-hbase17:44177] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-29 00:55:59,368 DEBUG [RS:0;jenkins-hbase17:44177] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-29 00:55:59,368 DEBUG [RS:0;jenkins-hbase17:44177] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,44177,1690592159082 2023-07-29 00:55:59,368 DEBUG [RS:0;jenkins-hbase17:44177] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,44177,1690592159082' 2023-07-29 00:55:59,368 DEBUG [RS:0;jenkins-hbase17:44177] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-29 00:55:59,369 DEBUG [RS:0;jenkins-hbase17:44177] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-29 00:55:59,369 DEBUG [RS:0;jenkins-hbase17:44177] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-29 00:55:59,369 INFO [RS:0;jenkins-hbase17:44177] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-29 00:55:59,369 INFO [RS:0;jenkins-hbase17:44177] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-29 00:55:59,417 DEBUG [jenkins-hbase17:35737] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-29 00:55:59,418 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,44177,1690592159082, state=OPENING 2023-07-29 00:55:59,419 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-29 00:55:59,421 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:55:59,422 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-29 00:55:59,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,44177,1690592159082}] 2023-07-29 00:55:59,471 INFO [RS:0;jenkins-hbase17:44177] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C44177%2C1690592159082, suffix=, logDir=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/WALs/jenkins-hbase17.apache.org,44177,1690592159082, archiveDir=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/oldWALs, maxLogs=32 2023-07-29 00:55:59,492 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36969,DS-baf08a8c-5ea9-4b9c-85ce-00e4fc8f8109,DISK] 2023-07-29 00:55:59,492 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33865,DS-81039b7e-88fc-44a7-bc84-9980496d9b81,DISK] 2023-07-29 00:55:59,493 INFO [RS:0;jenkins-hbase17:44177] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/WALs/jenkins-hbase17.apache.org,44177,1690592159082/jenkins-hbase17.apache.org%2C44177%2C1690592159082.1690592159473 2023-07-29 00:55:59,494 DEBUG [RS:0;jenkins-hbase17:44177] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36969,DS-baf08a8c-5ea9-4b9c-85ce-00e4fc8f8109,DISK], DatanodeInfoWithStorage[127.0.0.1:33865,DS-81039b7e-88fc-44a7-bc84-9980496d9b81,DISK]] 2023-07-29 00:55:59,579 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,44177,1690592159082 2023-07-29 00:55:59,579 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-29 00:55:59,585 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-29 00:55:59,592 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-29 00:55:59,592 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-29 00:55:59,593 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C44177%2C1690592159082.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/WALs/jenkins-hbase17.apache.org,44177,1690592159082, archiveDir=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/oldWALs, maxLogs=32 2023-07-29 00:55:59,608 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36969,DS-baf08a8c-5ea9-4b9c-85ce-00e4fc8f8109,DISK] 2023-07-29 00:55:59,608 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33865,DS-81039b7e-88fc-44a7-bc84-9980496d9b81,DISK] 2023-07-29 00:55:59,610 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/WALs/jenkins-hbase17.apache.org,44177,1690592159082/jenkins-hbase17.apache.org%2C44177%2C1690592159082.meta.1690592159594.meta 2023-07-29 00:55:59,610 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36969,DS-baf08a8c-5ea9-4b9c-85ce-00e4fc8f8109,DISK], DatanodeInfoWithStorage[127.0.0.1:33865,DS-81039b7e-88fc-44a7-bc84-9980496d9b81,DISK]] 2023-07-29 00:55:59,610 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-29 00:55:59,611 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-29 00:55:59,611 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-29 00:55:59,611 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-29 00:55:59,611 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-29 00:55:59,611 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-29 00:55:59,611 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:55:59,611 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-29 00:55:59,611 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-29 00:55:59,612 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-29 00:55:59,613 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/info 2023-07-29 00:55:59,613 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/info 2023-07-29 00:55:59,614 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-29 00:55:59,614 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:55:59,614 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-29 00:55:59,615 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/rep_barrier 2023-07-29 00:55:59,615 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/rep_barrier 2023-07-29 00:55:59,615 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-29 00:55:59,616 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:55:59,616 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-29 00:55:59,617 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/table 2023-07-29 00:55:59,617 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/table 2023-07-29 00:55:59,617 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-29 00:55:59,618 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:55:59,619 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740 2023-07-29 00:55:59,621 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740 2023-07-29 00:55:59,623 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-29 00:55:59,625 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-29 00:55:59,625 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=742614, jitterRate=-0.05571821331977844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-29 00:55:59,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-29 00:55:59,626 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690592159579 2023-07-29 00:55:59,631 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-29 00:55:59,631 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-29 00:55:59,632 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,44177,1690592159082, state=OPEN 2023-07-29 00:55:59,633 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-29 00:55:59,633 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-29 00:55:59,635 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-29 00:55:59,635 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,44177,1690592159082 in 211 msec 2023-07-29 00:55:59,637 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-29 00:55:59,637 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 371 msec 2023-07-29 00:55:59,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 417 msec 2023-07-29 00:55:59,638 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690592159638, completionTime=-1 2023-07-29 00:55:59,638 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-29 00:55:59,638 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-29 00:55:59,641 DEBUG [hconnection-0x153cb9a1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-29 00:55:59,643 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-29 00:55:59,644 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-29 00:55:59,644 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690592219644 2023-07-29 00:55:59,644 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690592279644 2023-07-29 00:55:59,644 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-07-29 00:55:59,649 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35737,1690592159043-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-29 00:55:59,649 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35737,1690592159043-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-29 00:55:59,649 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35737,1690592159043-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-29 00:55:59,649 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:35737, period=300000, unit=MILLISECONDS is enabled. 2023-07-29 00:55:59,649 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-29 00:55:59,650 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-29 00:55:59,650 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-29 00:55:59,651 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-29 00:55:59,651 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-29 00:55:59,654 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-29 00:55:59,654 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-29 00:55:59,656 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/.tmp/data/hbase/namespace/81e4267c6ca4b95cdc79ea1ded94898f 2023-07-29 00:55:59,657 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/.tmp/data/hbase/namespace/81e4267c6ca4b95cdc79ea1ded94898f empty. 2023-07-29 00:55:59,658 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/.tmp/data/hbase/namespace/81e4267c6ca4b95cdc79ea1ded94898f 2023-07-29 00:55:59,658 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-29 00:55:59,671 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-29 00:55:59,672 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 81e4267c6ca4b95cdc79ea1ded94898f, NAME => 'hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/.tmp 2023-07-29 00:55:59,680 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:55:59,680 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 81e4267c6ca4b95cdc79ea1ded94898f, disabling compactions & flushes 2023-07-29 00:55:59,680 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f. 2023-07-29 00:55:59,680 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f. 2023-07-29 00:55:59,680 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f. after waiting 0 ms 2023-07-29 00:55:59,680 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f. 2023-07-29 00:55:59,680 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f. 2023-07-29 00:55:59,681 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 81e4267c6ca4b95cdc79ea1ded94898f: 2023-07-29 00:55:59,683 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-29 00:55:59,684 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690592159684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690592159684"}]},"ts":"1690592159684"} 2023-07-29 00:55:59,686 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-29 00:55:59,686 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-29 00:55:59,687 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690592159687"}]},"ts":"1690592159687"} 2023-07-29 00:55:59,688 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-29 00:55:59,691 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=81e4267c6ca4b95cdc79ea1ded94898f, ASSIGN}] 2023-07-29 00:55:59,693 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=81e4267c6ca4b95cdc79ea1ded94898f, ASSIGN 2023-07-29 00:55:59,693 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=81e4267c6ca4b95cdc79ea1ded94898f, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44177,1690592159082; forceNewPlan=false, retain=false 2023-07-29 00:55:59,845 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=81e4267c6ca4b95cdc79ea1ded94898f, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44177,1690592159082 2023-07-29 00:55:59,845 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690592159845"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690592159845"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690592159845"}]},"ts":"1690592159845"} 2023-07-29 00:55:59,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 81e4267c6ca4b95cdc79ea1ded94898f, server=jenkins-hbase17.apache.org,44177,1690592159082}] 2023-07-29 00:56:00,008 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f. 2023-07-29 00:56:00,008 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 81e4267c6ca4b95cdc79ea1ded94898f, NAME => 'hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f.', STARTKEY => '', ENDKEY => ''} 2023-07-29 00:56:00,008 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 81e4267c6ca4b95cdc79ea1ded94898f 2023-07-29 00:56:00,008 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-29 00:56:00,008 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 81e4267c6ca4b95cdc79ea1ded94898f 2023-07-29 00:56:00,008 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 81e4267c6ca4b95cdc79ea1ded94898f 2023-07-29 00:56:00,010 INFO [StoreOpener-81e4267c6ca4b95cdc79ea1ded94898f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 81e4267c6ca4b95cdc79ea1ded94898f 2023-07-29 00:56:00,011 DEBUG [StoreOpener-81e4267c6ca4b95cdc79ea1ded94898f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/namespace/81e4267c6ca4b95cdc79ea1ded94898f/info 2023-07-29 00:56:00,011 DEBUG [StoreOpener-81e4267c6ca4b95cdc79ea1ded94898f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/namespace/81e4267c6ca4b95cdc79ea1ded94898f/info 2023-07-29 00:56:00,011 INFO [StoreOpener-81e4267c6ca4b95cdc79ea1ded94898f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81e4267c6ca4b95cdc79ea1ded94898f columnFamilyName info 2023-07-29 00:56:00,012 INFO [StoreOpener-81e4267c6ca4b95cdc79ea1ded94898f-1] regionserver.HStore(310): Store=81e4267c6ca4b95cdc79ea1ded94898f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-29 00:56:00,013 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/namespace/81e4267c6ca4b95cdc79ea1ded94898f 2023-07-29 00:56:00,014 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/namespace/81e4267c6ca4b95cdc79ea1ded94898f 2023-07-29 00:56:00,016 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 81e4267c6ca4b95cdc79ea1ded94898f 2023-07-29 00:56:00,018 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/namespace/81e4267c6ca4b95cdc79ea1ded94898f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-29 00:56:00,019 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 81e4267c6ca4b95cdc79ea1ded94898f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=832152, jitterRate=0.05813692510128021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-29 00:56:00,019 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 81e4267c6ca4b95cdc79ea1ded94898f: 2023-07-29 00:56:00,020 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f., pid=6, masterSystemTime=1690592160000 2023-07-29 00:56:00,021 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f. 2023-07-29 00:56:00,022 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f. 2023-07-29 00:56:00,022 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=81e4267c6ca4b95cdc79ea1ded94898f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44177,1690592159082 2023-07-29 00:56:00,022 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690592160022"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690592160022"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690592160022"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690592160022"}]},"ts":"1690592160022"} 2023-07-29 00:56:00,025 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-29 00:56:00,025 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 81e4267c6ca4b95cdc79ea1ded94898f, server=jenkins-hbase17.apache.org,44177,1690592159082 in 176 msec 2023-07-29 00:56:00,026 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-29 00:56:00,027 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=81e4267c6ca4b95cdc79ea1ded94898f, ASSIGN in 334 msec 2023-07-29 00:56:00,027 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-29 00:56:00,028 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690592160028"}]},"ts":"1690592160028"} 2023-07-29 00:56:00,029 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-29 00:56:00,031 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-29 00:56:00,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 381 msec 2023-07-29 00:56:00,052 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-29 00:56:00,053 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-29 00:56:00,053 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:56:00,056 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-29 00:56:00,062 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-29 00:56:00,065 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-07-29 00:56:00,068 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-29 00:56:00,073 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-29 00:56:00,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-07-29 00:56:00,081 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-29 00:56:00,083 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-29 00:56:00,083 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.982sec 2023-07-29 00:56:00,083 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-29 00:56:00,083 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-29 00:56:00,083 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-29 00:56:00,083 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35737,1690592159043-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-29 00:56:00,083 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35737,1690592159043-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-29 00:56:00,085 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-29 00:56:00,099 DEBUG [Listener at localhost.localdomain/45183] zookeeper.ReadOnlyZKClient(139): Connect 0x49613f94 to 127.0.0.1:52787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-29 00:56:00,106 DEBUG [Listener at localhost.localdomain/45183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fa79595, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-29 00:56:00,110 DEBUG [hconnection-0x17a157f5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-29 00:56:00,113 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-29 00:56:00,116 INFO [Listener at localhost.localdomain/45183] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,35737,1690592159043 2023-07-29 00:56:00,116 INFO [Listener at localhost.localdomain/45183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-29 00:56:00,119 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-29 00:56:00,119 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:56:00,120 INFO [Listener at localhost.localdomain/45183] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-29 00:56:00,120 INFO [Listener at localhost.localdomain/45183] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-29 00:56:00,123 INFO [Listener at localhost.localdomain/45183] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=test.com%2C8080%2C1, suffix=, logDir=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/WALs/test.com,8080,1, archiveDir=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/oldWALs, maxLogs=32 2023-07-29 00:56:00,137 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33865,DS-81039b7e-88fc-44a7-bc84-9980496d9b81,DISK] 2023-07-29 00:56:00,137 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36969,DS-baf08a8c-5ea9-4b9c-85ce-00e4fc8f8109,DISK] 2023-07-29 00:56:00,139 INFO [Listener at localhost.localdomain/45183] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/WALs/test.com,8080,1/test.com%2C8080%2C1.1690592160123 2023-07-29 00:56:00,140 DEBUG [Listener at localhost.localdomain/45183] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33865,DS-81039b7e-88fc-44a7-bc84-9980496d9b81,DISK], DatanodeInfoWithStorage[127.0.0.1:36969,DS-baf08a8c-5ea9-4b9c-85ce-00e4fc8f8109,DISK]] 2023-07-29 00:56:00,154 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33865,DS-81039b7e-88fc-44a7-bc84-9980496d9b81,DISK] 2023-07-29 00:56:00,154 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36969,DS-baf08a8c-5ea9-4b9c-85ce-00e4fc8f8109,DISK] 2023-07-29 00:56:00,156 INFO [Listener at localhost.localdomain/45183] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/WALs/test.com,8080,1/test.com%2C8080%2C1.1690592160123 with entries=0, filesize=83 B; new WAL /user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/WALs/test.com,8080,1/test.com%2C8080%2C1.1690592160140 2023-07-29 00:56:00,156 DEBUG [Listener at localhost.localdomain/45183] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33865,DS-81039b7e-88fc-44a7-bc84-9980496d9b81,DISK], DatanodeInfoWithStorage[127.0.0.1:36969,DS-baf08a8c-5ea9-4b9c-85ce-00e4fc8f8109,DISK]] 2023-07-29 00:56:00,156 DEBUG [Listener at localhost.localdomain/45183] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/WALs/test.com,8080,1/test.com%2C8080%2C1.1690592160123 is not closed yet, will try archiving it next time 2023-07-29 00:56:00,162 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/WALs/test.com,8080,1/test.com%2C8080%2C1.1690592160123 to hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/oldWALs/test.com%2C8080%2C1.1690592160123 2023-07-29 00:56:00,165 DEBUG [Listener at localhost.localdomain/45183] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/oldWALs 2023-07-29 00:56:00,166 INFO [Listener at localhost.localdomain/45183] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL test.com%2C8080%2C1:(num 1690592160140) 2023-07-29 00:56:00,166 INFO [Listener at localhost.localdomain/45183] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-29 00:56:00,166 DEBUG [Listener at localhost.localdomain/45183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49613f94 to 127.0.0.1:52787 2023-07-29 00:56:00,166 DEBUG [Listener at localhost.localdomain/45183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:56:00,167 DEBUG [Listener at localhost.localdomain/45183] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-29 00:56:00,167 DEBUG [Listener at localhost.localdomain/45183] util.JVMClusterUtil(257): Found active master hash=1365562022, stopped=false 2023-07-29 00:56:00,167 INFO [Listener at localhost.localdomain/45183] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,35737,1690592159043 2023-07-29 00:56:00,169 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-29 00:56:00,169 INFO [Listener at localhost.localdomain/45183] procedure2.ProcedureExecutor(629): Stopping 2023-07-29 00:56:00,169 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x101ae92a04f0001, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-29 00:56:00,169 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:56:00,170 DEBUG [Listener at localhost.localdomain/45183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b501d08 to 127.0.0.1:52787 2023-07-29 00:56:00,170 DEBUG [Listener at localhost.localdomain/45183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:56:00,170 INFO [Listener at localhost.localdomain/45183] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,44177,1690592159082' ***** 2023-07-29 00:56:00,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44177-0x101ae92a04f0001, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:56:00,170 INFO [Listener at localhost.localdomain/45183] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-29 00:56:00,170 INFO [RS:0;jenkins-hbase17:44177] regionserver.HeapMemoryManager(220): Stopping 2023-07-29 00:56:00,170 INFO [RS:0;jenkins-hbase17:44177] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-29 00:56:00,170 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-29 00:56:00,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-29 00:56:00,170 INFO [RS:0;jenkins-hbase17:44177] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-29 00:56:00,171 INFO [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(3305): Received CLOSE for 81e4267c6ca4b95cdc79ea1ded94898f 2023-07-29 00:56:00,171 INFO [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,44177,1690592159082 2023-07-29 00:56:00,171 DEBUG [RS:0;jenkins-hbase17:44177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51a9fe2d to 127.0.0.1:52787 2023-07-29 00:56:00,171 DEBUG [RS:0;jenkins-hbase17:44177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:56:00,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 81e4267c6ca4b95cdc79ea1ded94898f, disabling compactions & flushes 2023-07-29 00:56:00,172 INFO [RS:0;jenkins-hbase17:44177] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-29 00:56:00,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f. 2023-07-29 00:56:00,172 INFO [RS:0;jenkins-hbase17:44177] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-29 00:56:00,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f. 2023-07-29 00:56:00,172 INFO [RS:0;jenkins-hbase17:44177] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-29 00:56:00,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f. after waiting 0 ms 2023-07-29 00:56:00,172 INFO [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-29 00:56:00,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f. 2023-07-29 00:56:00,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 81e4267c6ca4b95cdc79ea1ded94898f 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-29 00:56:00,172 INFO [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-29 00:56:00,172 DEBUG [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 81e4267c6ca4b95cdc79ea1ded94898f=hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f.} 2023-07-29 00:56:00,172 DEBUG [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(1504): Waiting on 1588230740, 81e4267c6ca4b95cdc79ea1ded94898f 2023-07-29 00:56:00,173 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-29 00:56:00,173 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-29 00:56:00,173 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-29 00:56:00,173 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-29 00:56:00,173 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-29 00:56:00,173 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=1.26 KB heapSize=2.89 KB 2023-07-29 00:56:00,373 DEBUG [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(1504): Waiting on 1588230740, 81e4267c6ca4b95cdc79ea1ded94898f 2023-07-29 00:56:00,399 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-29 00:56:00,399 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-29 00:56:00,574 DEBUG [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(1504): Waiting on 1588230740, 81e4267c6ca4b95cdc79ea1ded94898f 2023-07-29 00:56:00,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/namespace/81e4267c6ca4b95cdc79ea1ded94898f/.tmp/info/80ca3063b71d44058c38c2ebcc06df94 2023-07-29 00:56:00,592 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.17 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/.tmp/info/64c8e759bbc14d42a74dd823870d7ba4 2023-07-29 00:56:00,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/namespace/81e4267c6ca4b95cdc79ea1ded94898f/.tmp/info/80ca3063b71d44058c38c2ebcc06df94 as hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/namespace/81e4267c6ca4b95cdc79ea1ded94898f/info/80ca3063b71d44058c38c2ebcc06df94 2023-07-29 00:56:00,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/namespace/81e4267c6ca4b95cdc79ea1ded94898f/info/80ca3063b71d44058c38c2ebcc06df94, entries=2, sequenceid=6, filesize=4.8 K 2023-07-29 00:56:00,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 81e4267c6ca4b95cdc79ea1ded94898f in 445ms, sequenceid=6, compaction requested=false 2023-07-29 00:56:00,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-29 00:56:00,620 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=94 B at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/.tmp/table/4370ca816123401c82c665b41a638045 2023-07-29 00:56:00,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/namespace/81e4267c6ca4b95cdc79ea1ded94898f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-29 00:56:00,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f. 2023-07-29 00:56:00,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 81e4267c6ca4b95cdc79ea1ded94898f: 2023-07-29 00:56:00,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690592159650.81e4267c6ca4b95cdc79ea1ded94898f. 2023-07-29 00:56:00,626 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/.tmp/info/64c8e759bbc14d42a74dd823870d7ba4 as hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/info/64c8e759bbc14d42a74dd823870d7ba4 2023-07-29 00:56:00,631 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/info/64c8e759bbc14d42a74dd823870d7ba4, entries=10, sequenceid=9, filesize=5.9 K 2023-07-29 00:56:00,632 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/.tmp/table/4370ca816123401c82c665b41a638045 as hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/table/4370ca816123401c82c665b41a638045 2023-07-29 00:56:00,637 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/table/4370ca816123401c82c665b41a638045, entries=2, sequenceid=9, filesize=4.7 K 2023-07-29 00:56:00,638 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.26 KB/1292, heapSize ~2.61 KB/2672, currentSize=0 B/0 for 1588230740 in 465ms, sequenceid=9, compaction requested=false 2023-07-29 00:56:00,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-29 00:56:00,644 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/data/hbase/meta/1588230740/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-07-29 00:56:00,644 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-29 00:56:00,644 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-29 00:56:00,644 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-29 00:56:00,644 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-29 00:56:00,774 INFO [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,44177,1690592159082; all regions closed. 2023-07-29 00:56:00,783 DEBUG [RS:0;jenkins-hbase17:44177] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/oldWALs 2023-07-29 00:56:00,783 INFO [RS:0;jenkins-hbase17:44177] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C44177%2C1690592159082.meta:.meta(num 1690592159594) 2023-07-29 00:56:00,788 DEBUG [RS:0;jenkins-hbase17:44177] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/oldWALs 2023-07-29 00:56:00,788 INFO [RS:0;jenkins-hbase17:44177] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C44177%2C1690592159082:(num 1690592159473) 2023-07-29 00:56:00,788 DEBUG [RS:0;jenkins-hbase17:44177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:56:00,788 INFO [RS:0;jenkins-hbase17:44177] regionserver.LeaseManager(133): Closed leases 2023-07-29 00:56:00,788 INFO [RS:0;jenkins-hbase17:44177] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-29 00:56:00,789 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-29 00:56:00,789 INFO [RS:0;jenkins-hbase17:44177] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:44177 2023-07-29 00:56:00,791 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x101ae92a04f0001, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,44177,1690592159082 2023-07-29 00:56:00,791 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-29 00:56:00,791 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x101ae92a04f0001, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-29 00:56:00,791 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,44177,1690592159082] 2023-07-29 00:56:00,791 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,44177,1690592159082; numProcessing=1 2023-07-29 00:56:00,792 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,44177,1690592159082 already deleted, retry=false 2023-07-29 00:56:00,792 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,44177,1690592159082 expired; onlineServers=0 2023-07-29 00:56:00,792 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,35737,1690592159043' ***** 2023-07-29 00:56:00,792 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-29 00:56:00,793 DEBUG [M:0;jenkins-hbase17:35737] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@555b5c52, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-29 00:56:00,793 INFO [M:0;jenkins-hbase17:35737] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,35737,1690592159043 2023-07-29 00:56:00,793 INFO [M:0;jenkins-hbase17:35737] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,35737,1690592159043; all regions closed. 2023-07-29 00:56:00,793 DEBUG [M:0;jenkins-hbase17:35737] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-29 00:56:00,793 DEBUG [M:0;jenkins-hbase17:35737] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-29 00:56:00,793 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-29 00:56:00,793 DEBUG [M:0;jenkins-hbase17:35737] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-29 00:56:00,793 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690592159229] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690592159229,5,FailOnTimeoutGroup] 2023-07-29 00:56:00,793 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690592159224] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690592159224,5,FailOnTimeoutGroup] 2023-07-29 00:56:00,793 INFO [M:0;jenkins-hbase17:35737] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-29 00:56:00,793 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-29 00:56:00,794 INFO [M:0;jenkins-hbase17:35737] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-29 00:56:00,794 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-29 00:56:00,794 INFO [M:0;jenkins-hbase17:35737] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-07-29 00:56:00,794 DEBUG [M:0;jenkins-hbase17:35737] master.HMaster(1512): Stopping service threads 2023-07-29 00:56:00,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-29 00:56:00,794 INFO [M:0;jenkins-hbase17:35737] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-29 00:56:00,794 ERROR [M:0;jenkins-hbase17:35737] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-7,5,PEWorkerGroup] 2023-07-29 00:56:00,794 INFO [M:0;jenkins-hbase17:35737] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-29 00:56:00,795 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-29 00:56:00,795 DEBUG [M:0;jenkins-hbase17:35737] zookeeper.ZKUtil(398): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-29 00:56:00,795 WARN [M:0;jenkins-hbase17:35737] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-29 00:56:00,795 INFO [M:0;jenkins-hbase17:35737] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-29 00:56:00,795 INFO [M:0;jenkins-hbase17:35737] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-29 00:56:00,796 DEBUG [M:0;jenkins-hbase17:35737] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-29 00:56:00,796 INFO [M:0;jenkins-hbase17:35737] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:56:00,796 DEBUG [M:0;jenkins-hbase17:35737] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:56:00,796 DEBUG [M:0;jenkins-hbase17:35737] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-29 00:56:00,796 DEBUG [M:0;jenkins-hbase17:35737] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:56:00,796 INFO [M:0;jenkins-hbase17:35737] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=24.09 KB heapSize=29.59 KB 2023-07-29 00:56:00,806 INFO [M:0;jenkins-hbase17:35737] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24.09 KB at sequenceid=66 (bloomFilter=true), to=hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6dd83ff0d2094b9bbb8d31744c507908 2023-07-29 00:56:00,810 DEBUG [M:0;jenkins-hbase17:35737] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6dd83ff0d2094b9bbb8d31744c507908 as hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6dd83ff0d2094b9bbb8d31744c507908 2023-07-29 00:56:00,815 INFO [M:0;jenkins-hbase17:35737] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39149/user/jenkins/test-data/10e75164-54b1-66f4-d009-dbc42f2d113e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6dd83ff0d2094b9bbb8d31744c507908, entries=8, sequenceid=66, filesize=6.3 K 2023-07-29 00:56:00,816 INFO [M:0;jenkins-hbase17:35737] regionserver.HRegion(2948): Finished flush of dataSize ~24.09 KB/24669, heapSize ~29.57 KB/30280, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=66, compaction requested=false 2023-07-29 00:56:00,817 INFO [M:0;jenkins-hbase17:35737] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-29 00:56:00,817 DEBUG [M:0;jenkins-hbase17:35737] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-29 00:56:00,821 INFO [M:0;jenkins-hbase17:35737] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-29 00:56:00,821 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-29 00:56:00,822 INFO [M:0;jenkins-hbase17:35737] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:35737 2023-07-29 00:56:00,824 DEBUG [M:0;jenkins-hbase17:35737] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,35737,1690592159043 already deleted, retry=false 2023-07-29 00:56:00,892 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x101ae92a04f0001, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:56:00,892 INFO [RS:0;jenkins-hbase17:44177] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,44177,1690592159082; zookeeper connection closed. 2023-07-29 00:56:00,892 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x101ae92a04f0001, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:56:00,893 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2d0c7fd5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2d0c7fd5 2023-07-29 00:56:00,893 INFO [Listener at localhost.localdomain/45183] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-29 00:56:00,992 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:56:00,992 INFO [M:0;jenkins-hbase17:35737] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,35737,1690592159043; zookeeper connection closed. 2023-07-29 00:56:00,993 DEBUG [Listener at localhost.localdomain/45183-EventThread] zookeeper.ZKWatcher(600): master:35737-0x101ae92a04f0000, quorum=127.0.0.1:52787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-29 00:56:00,997 WARN [Listener at localhost.localdomain/45183] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-29 00:56:01,005 INFO [Listener at localhost.localdomain/45183] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-29 00:56:01,111 WARN [BP-2131148086-136.243.18.41-1690592158584 heartbeating to localhost.localdomain/127.0.0.1:39149] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-29 00:56:01,112 WARN [BP-2131148086-136.243.18.41-1690592158584 heartbeating to localhost.localdomain/127.0.0.1:39149] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2131148086-136.243.18.41-1690592158584 (Datanode Uuid 50b69e61-fcbc-4fd1-b708-64003c724ddc) service to localhost.localdomain/127.0.0.1:39149 2023-07-29 00:56:01,113 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/cluster_2be59c66-cc59-c61f-5c2f-62d89e034ed1/dfs/data/data3/current/BP-2131148086-136.243.18.41-1690592158584] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:56:01,114 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/cluster_2be59c66-cc59-c61f-5c2f-62d89e034ed1/dfs/data/data4/current/BP-2131148086-136.243.18.41-1690592158584] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:56:01,115 WARN [Listener at localhost.localdomain/45183] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-29 00:56:01,121 INFO [Listener at localhost.localdomain/45183] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-29 00:56:01,229 WARN [BP-2131148086-136.243.18.41-1690592158584 heartbeating to localhost.localdomain/127.0.0.1:39149] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-29 00:56:01,230 WARN [BP-2131148086-136.243.18.41-1690592158584 heartbeating to localhost.localdomain/127.0.0.1:39149] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2131148086-136.243.18.41-1690592158584 (Datanode Uuid 94c0e099-1e21-4482-aaa3-78e57bfe656c) service to localhost.localdomain/127.0.0.1:39149 2023-07-29 00:56:01,232 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/cluster_2be59c66-cc59-c61f-5c2f-62d89e034ed1/dfs/data/data1/current/BP-2131148086-136.243.18.41-1690592158584] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:56:01,232 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/553a36ec-8e8e-5cc5-7313-33b761cf7014/cluster_2be59c66-cc59-c61f-5c2f-62d89e034ed1/dfs/data/data2/current/BP-2131148086-136.243.18.41-1690592158584] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-29 00:56:01,249 INFO [Listener at localhost.localdomain/45183] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-29 00:56:01,348 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-29 00:56:01,369 INFO [Listener at localhost.localdomain/45183] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-29 00:56:01,384 INFO [Listener at localhost.localdomain/45183] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-29 00:56:01,392 INFO [Listener at localhost.localdomain/45183] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=99 (was 77) - Thread LEAK? -, OpenFileDescriptor=497 (was 469) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 156), ProcessCount=171 (was 171), AvailableMemoryMB=10060 (was 10067)