2023-07-12 15:46:53,761 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30 2023-07-12 15:46:53,776 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRolling timeout: 13 mins 2023-07-12 15:46:53,807 INFO [Time-limited test] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=170, ProcessCount=161, AvailableMemoryMB=8269 2023-07-12 15:46:53,813 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 15:46:53,814 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e, deleteOnExit=true 2023-07-12 15:46:53,814 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 15:46:53,815 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/test.cache.data in system properties and HBase conf 2023-07-12 15:46:53,815 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 15:46:53,815 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/hadoop.log.dir in system properties and HBase conf 2023-07-12 15:46:53,816 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 15:46:53,816 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 15:46:53,816 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 15:46:53,948 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 15:46:54,372 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 15:46:54,377 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 15:46:54,378 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 15:46:54,378 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 15:46:54,379 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 15:46:54,379 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 15:46:54,380 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 15:46:54,380 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 15:46:54,381 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 15:46:54,381 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 15:46:54,382 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/nfs.dump.dir in system properties and HBase conf 2023-07-12 15:46:54,382 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/java.io.tmpdir in system properties and HBase conf 2023-07-12 15:46:54,382 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 15:46:54,383 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 15:46:54,383 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 15:46:54,994 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 15:46:54,998 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 15:46:55,297 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 15:46:55,470 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 15:46:55,484 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:46:55,521 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:46:55,580 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/java.io.tmpdir/Jetty_localhost_33133_hdfs____.2avnmt/webapp 2023-07-12 15:46:55,716 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33133 2023-07-12 15:46:55,726 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 15:46:55,727 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 15:46:56,187 WARN [Listener at localhost/35925] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:46:56,267 WARN [Listener at localhost/35925] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 15:46:56,288 WARN [Listener at localhost/35925] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:46:56,295 INFO [Listener at localhost/35925] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:46:56,304 INFO [Listener at localhost/35925] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/java.io.tmpdir/Jetty_localhost_45281_datanode____k2swa9/webapp 2023-07-12 15:46:56,432 INFO [Listener at localhost/35925] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45281 2023-07-12 15:46:56,789 WARN [Listener at localhost/37475] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:46:56,799 WARN [Listener at localhost/37475] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 15:46:56,805 WARN [Listener at localhost/37475] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:46:56,806 INFO [Listener at localhost/37475] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:46:56,811 INFO [Listener at localhost/37475] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/java.io.tmpdir/Jetty_localhost_42999_datanode____uovs5e/webapp 2023-07-12 15:46:56,911 INFO [Listener at localhost/37475] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42999 2023-07-12 15:46:56,920 WARN [Listener at localhost/33199] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:46:57,304 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x481f0aa128a1dcd7: Processing first storage report for DS-851b46a8-04a9-4978-8957-7e407d6032e4 from datanode 2d9205a7-58d1-4e06-aa97-3acf384e2a8e 2023-07-12 15:46:57,306 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x481f0aa128a1dcd7: from storage DS-851b46a8-04a9-4978-8957-7e407d6032e4 node DatanodeRegistration(127.0.0.1:43311, datanodeUuid=2d9205a7-58d1-4e06-aa97-3acf384e2a8e, infoPort=45319, infoSecurePort=0, ipcPort=37475, storageInfo=lv=-57;cid=testClusterID;nsid=491753498;c=1689176815071), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 15:46:57,306 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaf301c9ec60bdb92: Processing first storage report for DS-82e2c50f-ead8-48b0-8b6b-fd6f50f2a072 from datanode 8acb0951-a59c-4022-ad22-2b0eda5dadac 2023-07-12 15:46:57,306 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaf301c9ec60bdb92: from storage DS-82e2c50f-ead8-48b0-8b6b-fd6f50f2a072 node DatanodeRegistration(127.0.0.1:33993, datanodeUuid=8acb0951-a59c-4022-ad22-2b0eda5dadac, infoPort=35923, infoSecurePort=0, ipcPort=33199, storageInfo=lv=-57;cid=testClusterID;nsid=491753498;c=1689176815071), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:46:57,306 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x481f0aa128a1dcd7: Processing first storage report for DS-f76330d6-164c-4602-88c3-8e14729f6b15 from datanode 2d9205a7-58d1-4e06-aa97-3acf384e2a8e 2023-07-12 15:46:57,306 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x481f0aa128a1dcd7: from storage DS-f76330d6-164c-4602-88c3-8e14729f6b15 node DatanodeRegistration(127.0.0.1:43311, datanodeUuid=2d9205a7-58d1-4e06-aa97-3acf384e2a8e, infoPort=45319, infoSecurePort=0, ipcPort=37475, storageInfo=lv=-57;cid=testClusterID;nsid=491753498;c=1689176815071), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:46:57,306 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaf301c9ec60bdb92: Processing first storage report for DS-361b5884-b095-4e28-aa38-caa1aecd90d7 from datanode 8acb0951-a59c-4022-ad22-2b0eda5dadac 2023-07-12 15:46:57,306 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaf301c9ec60bdb92: from storage DS-361b5884-b095-4e28-aa38-caa1aecd90d7 node DatanodeRegistration(127.0.0.1:33993, datanodeUuid=8acb0951-a59c-4022-ad22-2b0eda5dadac, infoPort=35923, infoSecurePort=0, ipcPort=33199, storageInfo=lv=-57;cid=testClusterID;nsid=491753498;c=1689176815071), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:46:57,366 DEBUG [Listener at localhost/33199] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30 2023-07-12 15:46:57,436 INFO [Listener at localhost/33199] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e/zookeeper_0, clientPort=60564, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 15:46:57,449 INFO [Listener at localhost/33199] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60564 2023-07-12 15:46:57,457 INFO [Listener at localhost/33199] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:46:57,459 INFO [Listener at localhost/33199] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:46:58,120 INFO [Listener at localhost/33199] util.FSUtils(471): Created version file at hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee with version=8 2023-07-12 15:46:58,120 INFO [Listener at localhost/33199] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/hbase-staging 2023-07-12 15:46:58,427 INFO [Listener at localhost/33199] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 15:46:58,948 INFO [Listener at localhost/33199] client.ConnectionUtils(127): master/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 15:46:58,983 INFO [Listener at localhost/33199] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:46:58,984 INFO [Listener at localhost/33199] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 15:46:58,984 INFO [Listener at localhost/33199] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 15:46:58,984 INFO [Listener at localhost/33199] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:46:58,985 INFO [Listener at localhost/33199] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 15:46:59,124 INFO [Listener at localhost/33199] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 15:46:59,200 DEBUG [Listener at localhost/33199] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 15:46:59,291 INFO [Listener at localhost/33199] ipc.NettyRpcServer(120): Bind to /172.31.10.131:45897 2023-07-12 15:46:59,300 INFO [Listener at localhost/33199] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:46:59,302 INFO [Listener at localhost/33199] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:46:59,322 INFO [Listener at localhost/33199] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45897 connecting to ZooKeeper ensemble=127.0.0.1:60564 2023-07-12 15:46:59,361 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:458970x0, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 15:46:59,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45897-0x101c5d389690000 connected 2023-07-12 15:46:59,392 DEBUG [Listener at localhost/33199] zookeeper.ZKUtil(164): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 15:46:59,393 DEBUG [Listener at localhost/33199] zookeeper.ZKUtil(164): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:46:59,396 DEBUG [Listener at localhost/33199] zookeeper.ZKUtil(164): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 15:46:59,404 DEBUG [Listener at localhost/33199] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45897 2023-07-12 15:46:59,404 DEBUG [Listener at localhost/33199] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45897 2023-07-12 15:46:59,405 DEBUG [Listener at localhost/33199] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45897 2023-07-12 15:46:59,405 DEBUG [Listener at localhost/33199] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45897 2023-07-12 15:46:59,405 DEBUG [Listener at localhost/33199] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45897 2023-07-12 15:46:59,411 INFO [Listener at localhost/33199] master.HMaster(444): hbase.rootdir=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee, hbase.cluster.distributed=false 2023-07-12 15:46:59,492 INFO [Listener at localhost/33199] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 15:46:59,492 INFO [Listener at localhost/33199] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:46:59,492 INFO [Listener at localhost/33199] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 15:46:59,492 INFO [Listener at localhost/33199] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 15:46:59,492 INFO [Listener at localhost/33199] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:46:59,493 INFO [Listener at localhost/33199] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 15:46:59,497 INFO [Listener at localhost/33199] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 15:46:59,500 INFO [Listener at localhost/33199] ipc.NettyRpcServer(120): Bind to /172.31.10.131:35841 2023-07-12 15:46:59,502 INFO [Listener at localhost/33199] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 15:46:59,508 DEBUG [Listener at localhost/33199] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 15:46:59,509 INFO [Listener at localhost/33199] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:46:59,511 INFO [Listener at localhost/33199] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:46:59,513 INFO [Listener at localhost/33199] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35841 connecting to ZooKeeper ensemble=127.0.0.1:60564 2023-07-12 15:46:59,516 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): regionserver:358410x0, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 15:46:59,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35841-0x101c5d389690001 connected 2023-07-12 15:46:59,517 DEBUG [Listener at localhost/33199] zookeeper.ZKUtil(164): regionserver:35841-0x101c5d389690001, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 15:46:59,519 DEBUG [Listener at localhost/33199] zookeeper.ZKUtil(164): regionserver:35841-0x101c5d389690001, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:46:59,519 DEBUG [Listener at localhost/33199] zookeeper.ZKUtil(164): regionserver:35841-0x101c5d389690001, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 15:46:59,520 DEBUG [Listener at localhost/33199] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35841 2023-07-12 15:46:59,520 DEBUG [Listener at localhost/33199] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35841 2023-07-12 15:46:59,521 DEBUG [Listener at localhost/33199] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35841 2023-07-12 15:46:59,521 DEBUG [Listener at localhost/33199] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35841 2023-07-12 15:46:59,521 DEBUG [Listener at localhost/33199] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35841 2023-07-12 15:46:59,523 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase5.apache.org,45897,1689176818263 2023-07-12 15:46:59,533 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 15:46:59,534 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase5.apache.org,45897,1689176818263 2023-07-12 15:46:59,554 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 15:46:59,554 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): regionserver:35841-0x101c5d389690001, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 15:46:59,555 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:46:59,556 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 15:46:59,557 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase5.apache.org,45897,1689176818263 from backup master directory 2023-07-12 15:46:59,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 15:46:59,561 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase5.apache.org,45897,1689176818263 2023-07-12 15:46:59,561 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 15:46:59,562 WARN [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 15:46:59,562 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase5.apache.org,45897,1689176818263 2023-07-12 15:46:59,566 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 15:46:59,571 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 15:46:59,685 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/hbase.id with ID: d72297ac-681c-41aa-ab36-d3a45bb889af 2023-07-12 15:46:59,734 INFO [master/jenkins-hbase5:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:46:59,751 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:46:59,797 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x139671bd to 127.0.0.1:60564 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 15:46:59,831 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10c9394a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 15:46:59,853 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 15:46:59,855 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 15:46:59,864 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 15:46:59,904 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/data/master/store-tmp 2023-07-12 15:46:59,934 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:46:59,935 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 15:46:59,935 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:46:59,935 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:46:59,935 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 15:46:59,935 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:46:59,935 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:46:59,935 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 15:46:59,936 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/WALs/jenkins-hbase5.apache.org,45897,1689176818263 2023-07-12 15:46:59,959 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C45897%2C1689176818263, suffix=, logDir=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/WALs/jenkins-hbase5.apache.org,45897,1689176818263, archiveDir=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/oldWALs, maxLogs=10 2023-07-12 15:46:59,998 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 15:46:59,998 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 15:47:00,001 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:53) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:190) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:116) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:719) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:128) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:881) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:574) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.init(AbstractFSWAL.java:515) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:160) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:295) at org.apache.hadoop.hbase.master.region.MasterRegion.createWAL(MasterRegion.java:200) at org.apache.hadoop.hbase.master.region.MasterRegion.bootstrap(MasterRegion.java:220) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:348) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:00,049 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:417) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:00,051 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33993,DS-82e2c50f-ead8-48b0-8b6b-fd6f50f2a072,DISK] 2023-07-12 15:47:00,051 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43311,DS-851b46a8-04a9-4978-8957-7e407d6032e4,DISK] 2023-07-12 15:47:00,060 DEBUG [RS-EventLoopGroup-3-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:00,136 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/WALs/jenkins-hbase5.apache.org,45897,1689176818263/jenkins-hbase5.apache.org%2C45897%2C1689176818263.1689176819971 2023-07-12 15:47:00,137 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33993,DS-82e2c50f-ead8-48b0-8b6b-fd6f50f2a072,DISK], DatanodeInfoWithStorage[127.0.0.1:43311,DS-851b46a8-04a9-4978-8957-7e407d6032e4,DISK]] 2023-07-12 15:47:00,137 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 15:47:00,138 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:47:00,141 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:47:00,142 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:47:00,196 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:47:00,204 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 15:47:00,228 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 15:47:00,240 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:00,246 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:47:00,248 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:47:00,262 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:47:00,278 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 15:47:00,279 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=850071, jitterRate=0.08092153072357178}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 15:47:00,279 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 15:47:00,281 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 15:47:00,308 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 15:47:00,308 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 15:47:00,312 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 15:47:00,314 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 15:47:00,349 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-07-12 15:47:00,349 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 15:47:00,374 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 15:47:00,379 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 15:47:00,403 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 15:47:00,407 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 15:47:00,409 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 15:47:00,414 INFO [master/jenkins-hbase5:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 15:47:00,418 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 15:47:00,421 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:00,424 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 15:47:00,425 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 15:47:00,445 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 15:47:00,450 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 15:47:00,450 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:00,450 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): regionserver:35841-0x101c5d389690001, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 15:47:00,452 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase5.apache.org,45897,1689176818263, sessionid=0x101c5d389690000, setting cluster-up flag (Was=false) 2023-07-12 15:47:00,474 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:00,486 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 15:47:00,488 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,45897,1689176818263 2023-07-12 15:47:00,496 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:00,507 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 15:47:00,511 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,45897,1689176818263 2023-07-12 15:47:00,515 WARN [master/jenkins-hbase5:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/.hbase-snapshot/.tmp 2023-07-12 15:47:00,532 INFO [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(951): ClusterId : d72297ac-681c-41aa-ab36-d3a45bb889af 2023-07-12 15:47:00,544 DEBUG [RS:0;jenkins-hbase5:35841] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 15:47:00,550 DEBUG [RS:0;jenkins-hbase5:35841] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 15:47:00,551 DEBUG [RS:0;jenkins-hbase5:35841] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 15:47:00,554 DEBUG [RS:0;jenkins-hbase5:35841] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 15:47:00,555 DEBUG [RS:0;jenkins-hbase5:35841] zookeeper.ReadOnlyZKClient(139): Connect 0x0cbf7cd6 to 127.0.0.1:60564 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 15:47:00,560 DEBUG [RS:0;jenkins-hbase5:35841] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2789331, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 15:47:00,561 DEBUG [RS:0;jenkins-hbase5:35841] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64717a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 15:47:00,585 DEBUG [RS:0;jenkins-hbase5:35841] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase5:35841 2023-07-12 15:47:00,588 INFO [RS:0;jenkins-hbase5:35841] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 15:47:00,588 INFO [RS:0;jenkins-hbase5:35841] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 15:47:00,588 DEBUG [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 15:47:00,591 INFO [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,45897,1689176818263 with isa=jenkins-hbase5.apache.org/172.31.10.131:35841, startcode=1689176819491 2023-07-12 15:47:00,607 DEBUG [RS:0;jenkins-hbase5:35841] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 15:47:00,648 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 15:47:00,657 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:47:00,657 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:47:00,657 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:47:00,657 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:47:00,657 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase5:0, corePoolSize=10, maxPoolSize=10 2023-07-12 15:47:00,657 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:00,657 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 15:47:00,657 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:00,658 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:39289, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 15:47:00,658 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689176850658 2023-07-12 15:47:00,660 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 15:47:00,666 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45897] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 15:47:00,666 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 15:47:00,667 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 15:47:00,672 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 15:47:00,672 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 15:47:00,679 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 15:47:00,680 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 15:47:00,680 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 15:47:00,680 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 15:47:00,681 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:00,682 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 15:47:00,684 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 15:47:00,684 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 15:47:00,687 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 15:47:00,687 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 15:47:00,689 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689176820689,5,FailOnTimeoutGroup] 2023-07-12 15:47:00,689 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689176820689,5,FailOnTimeoutGroup] 2023-07-12 15:47:00,689 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:00,689 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 15:47:00,691 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:00,691 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:00,699 DEBUG [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 15:47:00,699 WARN [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 15:47:00,709 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 15:47:00,710 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 15:47:00,710 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee 2023-07-12 15:47:00,727 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:47:00,730 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 15:47:00,733 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/info 2023-07-12 15:47:00,734 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 15:47:00,736 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:00,736 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 15:47:00,740 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/rep_barrier 2023-07-12 15:47:00,740 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 15:47:00,741 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:00,741 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 15:47:00,744 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/table 2023-07-12 15:47:00,744 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 15:47:00,745 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:00,747 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740 2023-07-12 15:47:00,748 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740 2023-07-12 15:47:00,752 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-12 15:47:00,754 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 15:47:00,759 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 15:47:00,760 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=695345, jitterRate=-0.1158236563205719}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-12 15:47:00,761 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 15:47:00,761 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 15:47:00,761 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 15:47:00,761 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 15:47:00,761 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 15:47:00,761 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 15:47:00,762 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 15:47:00,763 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 15:47:00,768 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 15:47:00,768 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 15:47:00,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 15:47:00,797 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 15:47:00,799 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 15:47:00,800 INFO [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,45897,1689176818263 with isa=jenkins-hbase5.apache.org/172.31.10.131:35841, startcode=1689176819491 2023-07-12 15:47:00,806 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45897] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,35841,1689176819491 2023-07-12 15:47:00,812 DEBUG [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee 2023-07-12 15:47:00,812 DEBUG [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35925 2023-07-12 15:47:00,812 DEBUG [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 15:47:00,818 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 15:47:00,818 DEBUG [RS:0;jenkins-hbase5:35841] zookeeper.ZKUtil(162): regionserver:35841-0x101c5d389690001, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,35841,1689176819491 2023-07-12 15:47:00,818 WARN [RS:0;jenkins-hbase5:35841] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 15:47:00,819 INFO [RS:0;jenkins-hbase5:35841] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 15:47:00,819 DEBUG [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491 2023-07-12 15:47:00,820 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,35841,1689176819491] 2023-07-12 15:47:00,827 DEBUG [RS:0;jenkins-hbase5:35841] zookeeper.ZKUtil(162): regionserver:35841-0x101c5d389690001, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,35841,1689176819491 2023-07-12 15:47:00,837 DEBUG [RS:0;jenkins-hbase5:35841] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 15:47:00,848 INFO [RS:0;jenkins-hbase5:35841] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 15:47:00,870 INFO [RS:0;jenkins-hbase5:35841] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 15:47:00,873 INFO [RS:0;jenkins-hbase5:35841] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 15:47:00,873 INFO [RS:0;jenkins-hbase5:35841] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:00,874 INFO [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 15:47:00,881 INFO [RS:0;jenkins-hbase5:35841] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:00,881 DEBUG [RS:0;jenkins-hbase5:35841] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:00,882 DEBUG [RS:0;jenkins-hbase5:35841] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:00,882 DEBUG [RS:0;jenkins-hbase5:35841] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:00,882 DEBUG [RS:0;jenkins-hbase5:35841] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:00,882 DEBUG [RS:0;jenkins-hbase5:35841] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:00,883 DEBUG [RS:0;jenkins-hbase5:35841] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 15:47:00,883 DEBUG [RS:0;jenkins-hbase5:35841] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:00,883 DEBUG [RS:0;jenkins-hbase5:35841] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:00,883 DEBUG [RS:0;jenkins-hbase5:35841] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:00,883 DEBUG [RS:0;jenkins-hbase5:35841] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:00,884 INFO [RS:0;jenkins-hbase5:35841] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:00,885 INFO [RS:0;jenkins-hbase5:35841] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:00,885 INFO [RS:0;jenkins-hbase5:35841] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:00,902 INFO [RS:0;jenkins-hbase5:35841] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 15:47:00,904 INFO [RS:0;jenkins-hbase5:35841] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,35841,1689176819491-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:00,919 INFO [RS:0;jenkins-hbase5:35841] regionserver.Replication(203): jenkins-hbase5.apache.org,35841,1689176819491 started 2023-07-12 15:47:00,919 INFO [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,35841,1689176819491, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:35841, sessionid=0x101c5d389690001 2023-07-12 15:47:00,919 DEBUG [RS:0;jenkins-hbase5:35841] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 15:47:00,920 DEBUG [RS:0;jenkins-hbase5:35841] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,35841,1689176819491 2023-07-12 15:47:00,920 DEBUG [RS:0;jenkins-hbase5:35841] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,35841,1689176819491' 2023-07-12 15:47:00,920 DEBUG [RS:0;jenkins-hbase5:35841] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 15:47:00,920 DEBUG [RS:0;jenkins-hbase5:35841] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 15:47:00,921 DEBUG [RS:0;jenkins-hbase5:35841] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 15:47:00,921 DEBUG [RS:0;jenkins-hbase5:35841] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 15:47:00,921 DEBUG [RS:0;jenkins-hbase5:35841] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,35841,1689176819491 2023-07-12 15:47:00,921 DEBUG [RS:0;jenkins-hbase5:35841] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,35841,1689176819491' 2023-07-12 15:47:00,921 DEBUG [RS:0;jenkins-hbase5:35841] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 15:47:00,921 DEBUG [RS:0;jenkins-hbase5:35841] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 15:47:00,922 DEBUG [RS:0;jenkins-hbase5:35841] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 15:47:00,922 INFO [RS:0;jenkins-hbase5:35841] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 15:47:00,922 INFO [RS:0;jenkins-hbase5:35841] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 15:47:00,952 DEBUG [jenkins-hbase5:45897] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-12 15:47:00,955 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,35841,1689176819491, state=OPENING 2023-07-12 15:47:00,963 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 15:47:00,965 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:00,966 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 15:47:00,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,35841,1689176819491}] 2023-07-12 15:47:01,037 INFO [RS:0;jenkins-hbase5:35841] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C35841%2C1689176819491, suffix=, logDir=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491, archiveDir=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/oldWALs, maxLogs=32 2023-07-12 15:47:01,063 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43311,DS-851b46a8-04a9-4978-8957-7e407d6032e4,DISK] 2023-07-12 15:47:01,064 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33993,DS-82e2c50f-ead8-48b0-8b6b-fd6f50f2a072,DISK] 2023-07-12 15:47:01,068 INFO [RS:0;jenkins-hbase5:35841] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.1689176821042 2023-07-12 15:47:01,068 DEBUG [RS:0;jenkins-hbase5:35841] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43311,DS-851b46a8-04a9-4978-8957-7e407d6032e4,DISK], DatanodeInfoWithStorage[127.0.0.1:33993,DS-82e2c50f-ead8-48b0-8b6b-fd6f50f2a072,DISK]] 2023-07-12 15:47:01,159 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,35841,1689176819491 2023-07-12 15:47:01,162 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 15:47:01,165 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:34308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 15:47:01,177 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 15:47:01,178 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 15:47:01,181 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C35841%2C1689176819491.meta, suffix=.meta, logDir=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491, archiveDir=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/oldWALs, maxLogs=32 2023-07-12 15:47:01,198 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43311,DS-851b46a8-04a9-4978-8957-7e407d6032e4,DISK] 2023-07-12 15:47:01,198 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33993,DS-82e2c50f-ead8-48b0-8b6b-fd6f50f2a072,DISK] 2023-07-12 15:47:01,203 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.meta.1689176821182.meta 2023-07-12 15:47:01,203 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33993,DS-82e2c50f-ead8-48b0-8b6b-fd6f50f2a072,DISK], DatanodeInfoWithStorage[127.0.0.1:43311,DS-851b46a8-04a9-4978-8957-7e407d6032e4,DISK]] 2023-07-12 15:47:01,203 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 15:47:01,205 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 15:47:01,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 15:47:01,226 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 15:47:01,231 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 15:47:01,231 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:47:01,231 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 15:47:01,231 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 15:47:01,234 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 15:47:01,236 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/info 2023-07-12 15:47:01,236 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/info 2023-07-12 15:47:01,237 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 15:47:01,238 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:01,238 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 15:47:01,239 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/rep_barrier 2023-07-12 15:47:01,239 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/rep_barrier 2023-07-12 15:47:01,240 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 15:47:01,241 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:01,241 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 15:47:01,243 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/table 2023-07-12 15:47:01,243 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/table 2023-07-12 15:47:01,243 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 15:47:01,244 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:01,246 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740 2023-07-12 15:47:01,248 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740 2023-07-12 15:47:01,252 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-12 15:47:01,254 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 15:47:01,255 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=711932, jitterRate=-0.09473215043544769}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-12 15:47:01,256 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 15:47:01,265 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689176821152 2023-07-12 15:47:01,283 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 15:47:01,284 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 15:47:01,285 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,35841,1689176819491, state=OPEN 2023-07-12 15:47:01,288 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 15:47:01,288 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 15:47:01,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 15:47:01,294 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,35841,1689176819491 in 318 msec 2023-07-12 15:47:01,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 15:47:01,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 515 msec 2023-07-12 15:47:01,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 728 msec 2023-07-12 15:47:01,305 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689176821305, completionTime=-1 2023-07-12 15:47:01,305 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-12 15:47:01,306 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 15:47:01,377 DEBUG [hconnection-0x3b850af-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 15:47:01,381 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:34312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 15:47:01,403 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-12 15:47:01,403 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689176881403 2023-07-12 15:47:01,403 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689176941403 2023-07-12 15:47:01,403 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 96 msec 2023-07-12 15:47:01,433 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,45897,1689176818263-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:01,433 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,45897,1689176818263-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:01,433 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,45897,1689176818263-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:01,436 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase5:45897, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:01,436 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:01,445 DEBUG [master/jenkins-hbase5:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 15:47:01,453 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 15:47:01,455 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 15:47:01,466 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 15:47:01,469 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 15:47:01,472 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 15:47:01,501 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/.tmp/data/hbase/namespace/d293060e80c9c6a549396fde4bad400c 2023-07-12 15:47:01,503 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/.tmp/data/hbase/namespace/d293060e80c9c6a549396fde4bad400c empty. 2023-07-12 15:47:01,504 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/.tmp/data/hbase/namespace/d293060e80c9c6a549396fde4bad400c 2023-07-12 15:47:01,505 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 15:47:01,532 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 15:47:01,534 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d293060e80c9c6a549396fde4bad400c, NAME => 'hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/.tmp 2023-07-12 15:47:01,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:47:01,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d293060e80c9c6a549396fde4bad400c, disabling compactions & flushes 2023-07-12 15:47:01,552 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c. 2023-07-12 15:47:01,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c. 2023-07-12 15:47:01,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c. after waiting 0 ms 2023-07-12 15:47:01,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c. 2023-07-12 15:47:01,552 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c. 2023-07-12 15:47:01,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d293060e80c9c6a549396fde4bad400c: 2023-07-12 15:47:01,557 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 15:47:01,572 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689176821560"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689176821560"}]},"ts":"1689176821560"} 2023-07-12 15:47:01,602 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 15:47:01,605 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 15:47:01,610 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689176821605"}]},"ts":"1689176821605"} 2023-07-12 15:47:01,615 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 15:47:01,627 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d293060e80c9c6a549396fde4bad400c, ASSIGN}] 2023-07-12 15:47:01,630 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d293060e80c9c6a549396fde4bad400c, ASSIGN 2023-07-12 15:47:01,632 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d293060e80c9c6a549396fde4bad400c, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,35841,1689176819491; forceNewPlan=false, retain=false 2023-07-12 15:47:01,783 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d293060e80c9c6a549396fde4bad400c, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,35841,1689176819491 2023-07-12 15:47:01,784 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689176821783"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689176821783"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689176821783"}]},"ts":"1689176821783"} 2023-07-12 15:47:01,791 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d293060e80c9c6a549396fde4bad400c, server=jenkins-hbase5.apache.org,35841,1689176819491}] 2023-07-12 15:47:01,953 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c. 2023-07-12 15:47:01,953 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d293060e80c9c6a549396fde4bad400c, NAME => 'hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c.', STARTKEY => '', ENDKEY => ''} 2023-07-12 15:47:01,954 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d293060e80c9c6a549396fde4bad400c 2023-07-12 15:47:01,955 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:47:01,955 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for d293060e80c9c6a549396fde4bad400c 2023-07-12 15:47:01,955 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for d293060e80c9c6a549396fde4bad400c 2023-07-12 15:47:01,957 INFO [StoreOpener-d293060e80c9c6a549396fde4bad400c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d293060e80c9c6a549396fde4bad400c 2023-07-12 15:47:01,959 DEBUG [StoreOpener-d293060e80c9c6a549396fde4bad400c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/namespace/d293060e80c9c6a549396fde4bad400c/info 2023-07-12 15:47:01,959 DEBUG [StoreOpener-d293060e80c9c6a549396fde4bad400c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/namespace/d293060e80c9c6a549396fde4bad400c/info 2023-07-12 15:47:01,960 INFO [StoreOpener-d293060e80c9c6a549396fde4bad400c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d293060e80c9c6a549396fde4bad400c columnFamilyName info 2023-07-12 15:47:01,960 INFO [StoreOpener-d293060e80c9c6a549396fde4bad400c-1] regionserver.HStore(310): Store=d293060e80c9c6a549396fde4bad400c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:01,962 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/namespace/d293060e80c9c6a549396fde4bad400c 2023-07-12 15:47:01,963 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/namespace/d293060e80c9c6a549396fde4bad400c 2023-07-12 15:47:01,968 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for d293060e80c9c6a549396fde4bad400c 2023-07-12 15:47:01,971 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/namespace/d293060e80c9c6a549396fde4bad400c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 15:47:01,972 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened d293060e80c9c6a549396fde4bad400c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=709784, jitterRate=-0.09746329486370087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 15:47:01,972 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for d293060e80c9c6a549396fde4bad400c: 2023-07-12 15:47:01,974 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c., pid=6, masterSystemTime=1689176821946 2023-07-12 15:47:01,979 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c. 2023-07-12 15:47:01,979 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c. 2023-07-12 15:47:01,980 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d293060e80c9c6a549396fde4bad400c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,35841,1689176819491 2023-07-12 15:47:01,981 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689176821980"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689176821980"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689176821980"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689176821980"}]},"ts":"1689176821980"} 2023-07-12 15:47:01,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 15:47:01,989 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d293060e80c9c6a549396fde4bad400c, server=jenkins-hbase5.apache.org,35841,1689176819491 in 194 msec 2023-07-12 15:47:01,992 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 15:47:01,993 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d293060e80c9c6a549396fde4bad400c, ASSIGN in 363 msec 2023-07-12 15:47:01,994 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 15:47:01,994 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689176821994"}]},"ts":"1689176821994"} 2023-07-12 15:47:01,997 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 15:47:02,002 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 15:47:02,005 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 546 msec 2023-07-12 15:47:02,070 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 15:47:02,071 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 15:47:02,072 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:02,112 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 15:47:02,146 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 15:47:02,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 53 msec 2023-07-12 15:47:02,168 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 15:47:02,184 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 15:47:02,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 22 msec 2023-07-12 15:47:02,207 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 15:47:02,210 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 15:47:02,212 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.650sec 2023-07-12 15:47:02,214 INFO [master/jenkins-hbase5:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 15:47:02,216 INFO [master/jenkins-hbase5:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 15:47:02,216 INFO [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 15:47:02,217 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,45897,1689176818263-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 15:47:02,218 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,45897,1689176818263-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 15:47:02,231 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 15:47:02,237 DEBUG [Listener at localhost/33199] zookeeper.ReadOnlyZKClient(139): Connect 0x16756959 to 127.0.0.1:60564 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 15:47:02,243 DEBUG [Listener at localhost/33199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4edcbb8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 15:47:02,284 DEBUG [hconnection-0x195ad90f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 15:47:02,298 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:34324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 15:47:02,311 INFO [Listener at localhost/33199] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase5.apache.org,45897,1689176818263 2023-07-12 15:47:02,311 INFO [Listener at localhost/33199] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:47:02,321 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-12 15:47:02,321 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:02,323 INFO [Listener at localhost/33199] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-12 15:47:02,351 WARN [Listener at localhost/33199] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 15:47:02,360 WARN [Listener at localhost/33199] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:47:02,362 INFO [Listener at localhost/33199] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:47:02,374 INFO [Listener at localhost/33199] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/java.io.tmpdir/Jetty_localhost_42587_datanode____k24qe5/webapp 2023-07-12 15:47:02,495 INFO [Listener at localhost/33199] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42587 2023-07-12 15:47:02,510 WARN [Listener at localhost/37779] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:47:02,548 WARN [Listener at localhost/37779] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 15:47:02,551 WARN [Listener at localhost/37779] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:47:02,553 INFO [Listener at localhost/37779] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:47:02,588 INFO [Listener at localhost/37779] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/java.io.tmpdir/Jetty_localhost_33167_datanode____.mqoddz/webapp 2023-07-12 15:47:02,665 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x25b9af741116a1ef: Processing first storage report for DS-ab007bc0-4727-4136-9422-890d7102072c from datanode e94ec5a0-edd6-4f47-8c23-61405a8d3940 2023-07-12 15:47:02,665 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x25b9af741116a1ef: from storage DS-ab007bc0-4727-4136-9422-890d7102072c node DatanodeRegistration(127.0.0.1:38649, datanodeUuid=e94ec5a0-edd6-4f47-8c23-61405a8d3940, infoPort=45705, infoSecurePort=0, ipcPort=37779, storageInfo=lv=-57;cid=testClusterID;nsid=491753498;c=1689176815071), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:47:02,665 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x25b9af741116a1ef: Processing first storage report for DS-3024c930-1564-40d2-b48c-f3b45629bc8d from datanode e94ec5a0-edd6-4f47-8c23-61405a8d3940 2023-07-12 15:47:02,665 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x25b9af741116a1ef: from storage DS-3024c930-1564-40d2-b48c-f3b45629bc8d node DatanodeRegistration(127.0.0.1:38649, datanodeUuid=e94ec5a0-edd6-4f47-8c23-61405a8d3940, infoPort=45705, infoSecurePort=0, ipcPort=37779, storageInfo=lv=-57;cid=testClusterID;nsid=491753498;c=1689176815071), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:47:02,703 INFO [Listener at localhost/37779] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33167 2023-07-12 15:47:02,714 WARN [Listener at localhost/41771] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:47:02,732 WARN [Listener at localhost/41771] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 15:47:02,735 WARN [Listener at localhost/41771] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:47:02,737 INFO [Listener at localhost/41771] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:47:02,743 INFO [Listener at localhost/41771] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/java.io.tmpdir/Jetty_localhost_46711_datanode____.i9qbic/webapp 2023-07-12 15:47:02,828 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6f8de7d53fb8af54: Processing first storage report for DS-1839569a-09e8-4115-aa19-b8ae0ee9c38d from datanode 8bf5d95d-d007-462b-9890-073c593d01c4 2023-07-12 15:47:02,829 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6f8de7d53fb8af54: from storage DS-1839569a-09e8-4115-aa19-b8ae0ee9c38d node DatanodeRegistration(127.0.0.1:46831, datanodeUuid=8bf5d95d-d007-462b-9890-073c593d01c4, infoPort=35779, infoSecurePort=0, ipcPort=41771, storageInfo=lv=-57;cid=testClusterID;nsid=491753498;c=1689176815071), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:47:02,829 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6f8de7d53fb8af54: Processing first storage report for DS-77e93cc9-bf1f-4e21-b717-5daf9a99d88d from datanode 8bf5d95d-d007-462b-9890-073c593d01c4 2023-07-12 15:47:02,829 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6f8de7d53fb8af54: from storage DS-77e93cc9-bf1f-4e21-b717-5daf9a99d88d node DatanodeRegistration(127.0.0.1:46831, datanodeUuid=8bf5d95d-d007-462b-9890-073c593d01c4, infoPort=35779, infoSecurePort=0, ipcPort=41771, storageInfo=lv=-57;cid=testClusterID;nsid=491753498;c=1689176815071), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:47:02,860 INFO [Listener at localhost/41771] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46711 2023-07-12 15:47:02,869 WARN [Listener at localhost/36881] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:47:02,979 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x73e8ea6e0c84e9e2: Processing first storage report for DS-dd0f6980-82fe-4120-b328-2830d1621745 from datanode eda6d621-9730-4121-b8cb-0017c97c9925 2023-07-12 15:47:02,979 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x73e8ea6e0c84e9e2: from storage DS-dd0f6980-82fe-4120-b328-2830d1621745 node DatanodeRegistration(127.0.0.1:44797, datanodeUuid=eda6d621-9730-4121-b8cb-0017c97c9925, infoPort=42681, infoSecurePort=0, ipcPort=36881, storageInfo=lv=-57;cid=testClusterID;nsid=491753498;c=1689176815071), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:47:02,979 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x73e8ea6e0c84e9e2: Processing first storage report for DS-3462204a-6fa2-455b-9cd9-7126eb066581 from datanode eda6d621-9730-4121-b8cb-0017c97c9925 2023-07-12 15:47:02,979 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x73e8ea6e0c84e9e2: from storage DS-3462204a-6fa2-455b-9cd9-7126eb066581 node DatanodeRegistration(127.0.0.1:44797, datanodeUuid=eda6d621-9730-4121-b8cb-0017c97c9925, infoPort=42681, infoSecurePort=0, ipcPort=36881, storageInfo=lv=-57;cid=testClusterID;nsid=491753498;c=1689176815071), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 15:47:02,988 DEBUG [Listener at localhost/36881] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 15:47:02,991 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:49328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 15:47:03,000 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-07-12 15:47:03,000 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-07-12 15:47:03,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 15:47:03,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath 2023-07-12 15:47:03,009 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 15:47:03,011 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 15:47:03,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRollOnDatanodeDeath" procId is: 9 2023-07-12 15:47:03,015 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/14ac76c45febc8a09f41417b64397c0e 2023-07-12 15:47:03,017 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/14ac76c45febc8a09f41417b64397c0e empty. 2023-07-12 15:47:03,019 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/14ac76c45febc8a09f41417b64397c0e 2023-07-12 15:47:03,019 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRollOnDatanodeDeath regions 2023-07-12 15:47:03,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 15:47:03,042 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/.tabledesc/.tableinfo.0000000001 2023-07-12 15:47:03,044 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(7675): creating {ENCODED => 14ac76c45febc8a09f41417b64397c0e, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/.tmp 2023-07-12 15:47:03,064 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:47:03,065 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1604): Closing 14ac76c45febc8a09f41417b64397c0e, disabling compactions & flushes 2023-07-12 15:47:03,065 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e. 2023-07-12 15:47:03,065 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e. 2023-07-12 15:47:03,065 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e. after waiting 0 ms 2023-07-12 15:47:03,065 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e. 2023-07-12 15:47:03,065 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e. 2023-07-12 15:47:03,065 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1558): Region close journal for 14ac76c45febc8a09f41417b64397c0e: 2023-07-12 15:47:03,070 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 15:47:03,072 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1689176823071"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689176823071"}]},"ts":"1689176823071"} 2023-07-12 15:47:03,075 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 15:47:03,079 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 15:47:03,079 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689176823079"}]},"ts":"1689176823079"} 2023-07-12 15:47:03,082 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLING in hbase:meta 2023-07-12 15:47:03,087 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=14ac76c45febc8a09f41417b64397c0e, ASSIGN}] 2023-07-12 15:47:03,090 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=14ac76c45febc8a09f41417b64397c0e, ASSIGN 2023-07-12 15:47:03,092 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=14ac76c45febc8a09f41417b64397c0e, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,35841,1689176819491; forceNewPlan=false, retain=false 2023-07-12 15:47:03,244 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=14ac76c45febc8a09f41417b64397c0e, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,35841,1689176819491 2023-07-12 15:47:03,244 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1689176823244"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689176823244"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689176823244"}]},"ts":"1689176823244"} 2023-07-12 15:47:03,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 14ac76c45febc8a09f41417b64397c0e, server=jenkins-hbase5.apache.org,35841,1689176819491}] 2023-07-12 15:47:03,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e. 2023-07-12 15:47:03,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 14ac76c45febc8a09f41417b64397c0e, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e.', STARTKEY => '', ENDKEY => ''} 2023-07-12 15:47:03,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRollOnDatanodeDeath 14ac76c45febc8a09f41417b64397c0e 2023-07-12 15:47:03,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:47:03,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 14ac76c45febc8a09f41417b64397c0e 2023-07-12 15:47:03,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 14ac76c45febc8a09f41417b64397c0e 2023-07-12 15:47:03,416 INFO [StoreOpener-14ac76c45febc8a09f41417b64397c0e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 14ac76c45febc8a09f41417b64397c0e 2023-07-12 15:47:03,418 DEBUG [StoreOpener-14ac76c45febc8a09f41417b64397c0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/default/TestLogRolling-testLogRollOnDatanodeDeath/14ac76c45febc8a09f41417b64397c0e/info 2023-07-12 15:47:03,418 DEBUG [StoreOpener-14ac76c45febc8a09f41417b64397c0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/default/TestLogRolling-testLogRollOnDatanodeDeath/14ac76c45febc8a09f41417b64397c0e/info 2023-07-12 15:47:03,418 INFO [StoreOpener-14ac76c45febc8a09f41417b64397c0e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14ac76c45febc8a09f41417b64397c0e columnFamilyName info 2023-07-12 15:47:03,419 INFO [StoreOpener-14ac76c45febc8a09f41417b64397c0e-1] regionserver.HStore(310): Store=14ac76c45febc8a09f41417b64397c0e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:03,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/default/TestLogRolling-testLogRollOnDatanodeDeath/14ac76c45febc8a09f41417b64397c0e 2023-07-12 15:47:03,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/default/TestLogRolling-testLogRollOnDatanodeDeath/14ac76c45febc8a09f41417b64397c0e 2023-07-12 15:47:03,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 14ac76c45febc8a09f41417b64397c0e 2023-07-12 15:47:03,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/default/TestLogRolling-testLogRollOnDatanodeDeath/14ac76c45febc8a09f41417b64397c0e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 15:47:03,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 14ac76c45febc8a09f41417b64397c0e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=750581, jitterRate=-0.045587509870529175}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 15:47:03,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 14ac76c45febc8a09f41417b64397c0e: 2023-07-12 15:47:03,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e., pid=11, masterSystemTime=1689176823404 2023-07-12 15:47:03,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e. 2023-07-12 15:47:03,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e. 2023-07-12 15:47:03,434 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=14ac76c45febc8a09f41417b64397c0e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,35841,1689176819491 2023-07-12 15:47:03,434 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1689176823434"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689176823434"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689176823434"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689176823434"}]},"ts":"1689176823434"} 2023-07-12 15:47:03,440 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 15:47:03,440 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 14ac76c45febc8a09f41417b64397c0e, server=jenkins-hbase5.apache.org,35841,1689176819491 in 187 msec 2023-07-12 15:47:03,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 15:47:03,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=14ac76c45febc8a09f41417b64397c0e, ASSIGN in 353 msec 2023-07-12 15:47:03,445 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 15:47:03,445 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689176823445"}]},"ts":"1689176823445"} 2023-07-12 15:47:03,447 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLED in hbase:meta 2023-07-12 15:47:03,451 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 15:47:03,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath in 448 msec 2023-07-12 15:47:06,761 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-12 15:47:06,852 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 15:47:06,854 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 15:47:06,855 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRollOnDatanodeDeath' 2023-07-12 15:47:08,423 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 15:47:08,424 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 15:47:13,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 15:47:13,032 INFO [Listener at localhost/36881] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRollOnDatanodeDeath, procId: 9 completed 2023-07-12 15:47:13,032 DEBUG [Listener at localhost/36881] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestLogRolling-testLogRollOnDatanodeDeath get assigned. Timeout = 60000ms 2023-07-12 15:47:13,034 INFO [Listener at localhost/36881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 15:47:13,038 INFO [Listener at localhost/36881] hbase.HBaseTestingUtility(3484): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned to meta. Checking AM states. 2023-07-12 15:47:13,039 INFO [Listener at localhost/36881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 15:47:13,039 INFO [Listener at localhost/36881] hbase.HBaseTestingUtility(3504): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned. 2023-07-12 15:47:13,048 DEBUG [Listener at localhost/36881] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRollOnDatanodeDeath 2023-07-12 15:47:13,049 DEBUG [Listener at localhost/36881] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e. 2023-07-12 15:47:13,050 WARN [Listener at localhost/36881] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 15:47:13,052 INFO [Listener at localhost/36881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:47:13,055 WARN [BP-693421871-172.31.10.131-1689176815071 heartbeating to localhost/127.0.0.1:35925] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 15:47:13,055 WARN [BP-693421871-172.31.10.131-1689176815071 heartbeating to localhost/127.0.0.1:35925] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-693421871-172.31.10.131-1689176815071 (Datanode Uuid 2d9205a7-58d1-4e06-aa97-3acf384e2a8e) service to localhost/127.0.0.1:35925 2023-07-12 15:47:13,057 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e/dfs/data/data1/current/BP-693421871-172.31.10.131-1689176815071] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:47:13,057 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e/dfs/data/data2/current/BP-693421871-172.31.10.131-1689176815071] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:47:13,059 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-241155984_17 at /127.0.0.1:43764 [Receiving block BP-693421871-172.31.10.131-1689176815071:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:43311:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:43764 dst: /127.0.0.1:43311 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:13,060 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-241155984_17 at /127.0.0.1:53508 [Receiving block BP-693421871-172.31.10.131-1689176815071:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:33993:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:53508 dst: /127.0.0.1:33993 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:13,060 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_584302091_17 at /127.0.0.1:43728 [Receiving block BP-693421871-172.31.10.131-1689176815071:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:43311:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:43728 dst: /127.0.0.1:43311 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:13,060 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_584302091_17 at /127.0.0.1:53500 [Receiving block BP-693421871-172.31.10.131-1689176815071:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:33993:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:53500 dst: /127.0.0.1:33993 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:13,060 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-241155984_17 at /127.0.0.1:43776 [Receiving block BP-693421871-172.31.10.131-1689176815071:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:43311:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:43776 dst: /127.0.0.1:43311 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:13,059 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-241155984_17 at /127.0.0.1:53510 [Receiving block BP-693421871-172.31.10.131-1689176815071:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:33993:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:53510 dst: /127.0.0.1:33993 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:13,068 WARN [Listener at localhost/36881] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 15:47:13,071 WARN [Listener at localhost/36881] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:47:13,072 INFO [Listener at localhost/36881] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:47:13,076 INFO [Listener at localhost/36881] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/java.io.tmpdir/Jetty_localhost_34441_datanode____if0viv/webapp 2023-07-12 15:47:13,171 INFO [Listener at localhost/36881] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34441 2023-07-12 15:47:13,181 WARN [Listener at localhost/45565] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:47:13,187 WARN [AsyncFSWAL-0-hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee-prefix:jenkins-hbase5.apache.org,35841,1689176819491] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:13,188 DEBUG [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase5.apache.org%2C35841%2C1689176819491:(num 1689176821042) roll requested 2023-07-12 15:47:13,206 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38649,DS-ab007bc0-4727-4136-9422-890d7102072c,DISK] 2023-07-12 15:47:13,206 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44797,DS-dd0f6980-82fe-4120-b328-2830d1621745,DISK] 2023-07-12 15:47:13,210 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.1689176821042 with entries=6, filesize=3.19 KB; new WAL /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.1689176833189 2023-07-12 15:47:13,211 DEBUG [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38649,DS-ab007bc0-4727-4136-9422-890d7102072c,DISK], DatanodeInfoWithStorage[127.0.0.1:44797,DS-dd0f6980-82fe-4120-b328-2830d1621745,DISK]] 2023-07-12 15:47:13,211 DEBUG [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.1689176821042 is not closed yet, will try archiving it next time 2023-07-12 15:47:13,213 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 15:47:13,213 INFO [Listener at localhost/45565] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 15:47:13,215 DEBUG [Listener at localhost/45565] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16756959 to 127.0.0.1:60564 2023-07-12 15:47:13,216 DEBUG [Listener at localhost/45565] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:47:13,216 DEBUG [Listener at localhost/45565] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 15:47:13,217 DEBUG [Listener at localhost/45565] util.JVMClusterUtil(257): Found active master hash=1110079244, stopped=false 2023-07-12 15:47:13,217 INFO [Listener at localhost/45565] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase5.apache.org,45897,1689176818263 2023-07-12 15:47:13,218 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:13,219 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:13,219 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 15:47:13,219 INFO [Listener at localhost/45565] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 15:47:13,219 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:13,219 DEBUG [Listener at localhost/45565] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x139671bd to 127.0.0.1:60564 2023-07-12 15:47:13,220 DEBUG [Listener at localhost/45565] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:47:13,220 INFO [Listener at localhost/45565] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,35841,1689176819491' ***** 2023-07-12 15:47:13,221 INFO [Listener at localhost/45565] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 15:47:13,219 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): regionserver:35841-0x101c5d389690001, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 15:47:13,220 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:47:13,222 INFO [RS:0;jenkins-hbase5:35841] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 15:47:13,222 INFO [RS:0;jenkins-hbase5:35841] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 15:47:13,222 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 15:47:13,222 INFO [RS:0;jenkins-hbase5:35841] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 15:47:13,223 INFO [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(3305): Received CLOSE for d293060e80c9c6a549396fde4bad400c 2023-07-12 15:47:13,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35841-0x101c5d389690001, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:47:13,223 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.1689176821042 2023-07-12 15:47:13,224 INFO [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(3305): Received CLOSE for 14ac76c45febc8a09f41417b64397c0e 2023-07-12 15:47:13,225 INFO [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,35841,1689176819491 2023-07-12 15:47:13,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing d293060e80c9c6a549396fde4bad400c, disabling compactions & flushes 2023-07-12 15:47:13,225 DEBUG [RS:0;jenkins-hbase5:35841] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0cbf7cd6 to 127.0.0.1:60564 2023-07-12 15:47:13,225 DEBUG [RS:0;jenkins-hbase5:35841] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:47:13,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c. 2023-07-12 15:47:13,225 INFO [RS:0;jenkins-hbase5:35841] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 15:47:13,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c. 2023-07-12 15:47:13,225 INFO [RS:0;jenkins-hbase5:35841] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 15:47:13,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c. after waiting 0 ms 2023-07-12 15:47:13,225 INFO [RS:0;jenkins-hbase5:35841] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 15:47:13,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c. 2023-07-12 15:47:13,226 INFO [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 15:47:13,226 INFO [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-12 15:47:13,227 DEBUG [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(1478): Online Regions={d293060e80c9c6a549396fde4bad400c=hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c., 14ac76c45febc8a09f41417b64397c0e=TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e., 1588230740=hbase:meta,,1.1588230740} 2023-07-12 15:47:13,228 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 15:47:13,228 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 15:47:13,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing d293060e80c9c6a549396fde4bad400c 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 15:47:13,228 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 15:47:13,228 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 15:47:13,228 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 15:47:13,228 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.92 KB heapSize=5.45 KB 2023-07-12 15:47:13,229 DEBUG [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(1504): Waiting on 14ac76c45febc8a09f41417b64397c0e, 1588230740, d293060e80c9c6a549396fde4bad400c 2023-07-12 15:47:13,229 WARN [IPC Server handler 1 on default port 35925] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.1689176821042 has not been closed. Lease recovery is in progress. RecoveryId = 1015 for block blk_1073741832_1008 2023-07-12 15:47:13,233 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.1689176821042 after 9ms 2023-07-12 15:47:13,239 WARN [AsyncFSWAL-0-hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee-prefix:jenkins-hbase5.apache.org,35841,1689176819491.meta] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:13,240 DEBUG [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase5.apache.org%2C35841%2C1689176819491.meta:.meta(num 1689176821182) roll requested 2023-07-12 15:47:13,265 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44797,DS-dd0f6980-82fe-4120-b328-2830d1621745,DISK] 2023-07-12 15:47:13,269 WARN [regionserver/jenkins-hbase5:0.logRoller] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(571): create fan-out dfs output /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.meta.1689176833240.meta failed, retry = 0 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: /127.0.0.1:43311 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:13,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/namespace/d293060e80c9c6a549396fde4bad400c/.tmp/info/b0d017ab5df34ea0b31b3ba6b185810d 2023-07-12 15:47:13,348 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x577552b4dad454cc: Processing first storage report for DS-851b46a8-04a9-4978-8957-7e407d6032e4 from datanode 2d9205a7-58d1-4e06-aa97-3acf384e2a8e 2023-07-12 15:47:13,349 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x577552b4dad454cc: from storage DS-851b46a8-04a9-4978-8957-7e407d6032e4 node DatanodeRegistration(127.0.0.1:35085, datanodeUuid=2d9205a7-58d1-4e06-aa97-3acf384e2a8e, infoPort=43043, infoSecurePort=0, ipcPort=45565, storageInfo=lv=-57;cid=testClusterID;nsid=491753498;c=1689176815071), blocks: 6, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 15:47:13,350 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x577552b4dad454cc: Processing first storage report for DS-f76330d6-164c-4602-88c3-8e14729f6b15 from datanode 2d9205a7-58d1-4e06-aa97-3acf384e2a8e 2023-07-12 15:47:13,350 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x577552b4dad454cc: from storage DS-f76330d6-164c-4602-88c3-8e14729f6b15 node DatanodeRegistration(127.0.0.1:35085, datanodeUuid=2d9205a7-58d1-4e06-aa97-3acf384e2a8e, infoPort=43043, infoSecurePort=0, ipcPort=45565, storageInfo=lv=-57;cid=testClusterID;nsid=491753498;c=1689176815071), blocks: 5, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:47:13,374 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-241155984_17 at /127.0.0.1:34340 [Receiving block BP-693421871-172.31.10.131-1689176815071:blk_1073741839_1016]] datanode.DataXceiver(323): 127.0.0.1:44797:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:34340 dst: /127.0.0.1:44797 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:13,379 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38649,DS-ab007bc0-4727-4136-9422-890d7102072c,DISK] 2023-07-12 15:47:13,380 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46831,DS-1839569a-09e8-4115-aa19-b8ae0ee9c38d,DISK] 2023-07-12 15:47:13,388 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.meta.1689176821182.meta with entries=12, filesize=3.87 KB; new WAL /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.meta.1689176833240.meta 2023-07-12 15:47:13,391 DEBUG [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38649,DS-ab007bc0-4727-4136-9422-890d7102072c,DISK], DatanodeInfoWithStorage[127.0.0.1:46831,DS-1839569a-09e8-4115-aa19-b8ae0ee9c38d,DISK]] 2023-07-12 15:47:13,391 DEBUG [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.meta.1689176821182.meta is not closed yet, will try archiving it next time 2023-07-12 15:47:13,392 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:13,394 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:13,394 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.meta.1689176821182.meta 2023-07-12 15:47:13,396 WARN [IPC Server handler 1 on default port 35925] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.meta.1689176821182.meta has not been closed. Lease recovery is in progress. RecoveryId = 1019 for block blk_1073741833_1009 2023-07-12 15:47:13,397 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.meta.1689176821182.meta after 3ms 2023-07-12 15:47:13,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/namespace/d293060e80c9c6a549396fde4bad400c/.tmp/info/b0d017ab5df34ea0b31b3ba6b185810d as hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/namespace/d293060e80c9c6a549396fde4bad400c/info/b0d017ab5df34ea0b31b3ba6b185810d 2023-07-12 15:47:13,419 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.69 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/.tmp/info/f39c9eab08094f76a30ad26973ad98a3 2023-07-12 15:47:13,429 DEBUG [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(1504): Waiting on 14ac76c45febc8a09f41417b64397c0e, 1588230740, d293060e80c9c6a549396fde4bad400c 2023-07-12 15:47:13,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/namespace/d293060e80c9c6a549396fde4bad400c/info/b0d017ab5df34ea0b31b3ba6b185810d, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 15:47:13,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d293060e80c9c6a549396fde4bad400c in 206ms, sequenceid=6, compaction requested=false 2023-07-12 15:47:13,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/namespace/d293060e80c9c6a549396fde4bad400c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 15:47:13,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c. 2023-07-12 15:47:13,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for d293060e80c9c6a549396fde4bad400c: 2023-07-12 15:47:13,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689176821454.d293060e80c9c6a549396fde4bad400c. 2023-07-12 15:47:13,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 14ac76c45febc8a09f41417b64397c0e, disabling compactions & flushes 2023-07-12 15:47:13,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e. 2023-07-12 15:47:13,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e. 2023-07-12 15:47:13,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e. after waiting 0 ms 2023-07-12 15:47:13,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e. 2023-07-12 15:47:13,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 14ac76c45febc8a09f41417b64397c0e 1/1 column families, dataSize=2.05 KB heapSize=2.45 KB 2023-07-12 15:47:13,462 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=240 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/.tmp/table/2f59bd59dc1a4bd3b0073d99f67693f3 2023-07-12 15:47:13,472 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/.tmp/info/f39c9eab08094f76a30ad26973ad98a3 as hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/info/f39c9eab08094f76a30ad26973ad98a3 2023-07-12 15:47:13,486 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/info/f39c9eab08094f76a30ad26973ad98a3, entries=20, sequenceid=14, filesize=7.4 K 2023-07-12 15:47:13,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.05 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/default/TestLogRolling-testLogRollOnDatanodeDeath/14ac76c45febc8a09f41417b64397c0e/.tmp/info/54510e36eefa4b98b3d27754b56426b5 2023-07-12 15:47:13,488 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/.tmp/table/2f59bd59dc1a4bd3b0073d99f67693f3 as hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/table/2f59bd59dc1a4bd3b0073d99f67693f3 2023-07-12 15:47:13,498 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/table/2f59bd59dc1a4bd3b0073d99f67693f3, entries=4, sequenceid=14, filesize=4.8 K 2023-07-12 15:47:13,500 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.92 KB/2994, heapSize ~5.16 KB/5288, currentSize=0 B/0 for 1588230740 in 272ms, sequenceid=14, compaction requested=false 2023-07-12 15:47:13,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/default/TestLogRolling-testLogRollOnDatanodeDeath/14ac76c45febc8a09f41417b64397c0e/.tmp/info/54510e36eefa4b98b3d27754b56426b5 as hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/default/TestLogRolling-testLogRollOnDatanodeDeath/14ac76c45febc8a09f41417b64397c0e/info/54510e36eefa4b98b3d27754b56426b5 2023-07-12 15:47:13,510 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-07-12 15:47:13,510 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 15:47:13,511 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 15:47:13,511 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 15:47:13,511 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 15:47:13,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/default/TestLogRolling-testLogRollOnDatanodeDeath/14ac76c45febc8a09f41417b64397c0e/info/54510e36eefa4b98b3d27754b56426b5, entries=2, sequenceid=6, filesize=6.8 K 2023-07-12 15:47:13,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.05 KB/2102, heapSize ~2.44 KB/2496, currentSize=0 B/0 for 14ac76c45febc8a09f41417b64397c0e in 54ms, sequenceid=6, compaction requested=false 2023-07-12 15:47:13,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/data/default/TestLogRolling-testLogRollOnDatanodeDeath/14ac76c45febc8a09f41417b64397c0e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 15:47:13,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e. 2023-07-12 15:47:13,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 14ac76c45febc8a09f41417b64397c0e: 2023-07-12 15:47:13,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1689176823000.14ac76c45febc8a09f41417b64397c0e. 2023-07-12 15:47:13,630 INFO [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,35841,1689176819491; all regions closed. 2023-07-12 15:47:13,885 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 15:47:13,885 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 15:47:14,886 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 15:47:17,234 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.1689176821042 after 4010ms 2023-07-12 15:47:17,235 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.1689176821042 to hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/oldWALs/jenkins-hbase5.apache.org%2C35841%2C1689176819491.1689176821042 2023-07-12 15:47:17,398 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.meta.1689176821182.meta after 4004ms 2023-07-12 15:47:17,399 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/WALs/jenkins-hbase5.apache.org,35841,1689176819491/jenkins-hbase5.apache.org%2C35841%2C1689176819491.meta.1689176821182.meta to hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/oldWALs/jenkins-hbase5.apache.org%2C35841%2C1689176819491.meta.1689176821182.meta 2023-07-12 15:47:17,404 DEBUG [RS:0;jenkins-hbase5:35841] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/oldWALs 2023-07-12 15:47:17,404 INFO [RS:0;jenkins-hbase5:35841] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C35841%2C1689176819491.meta:.meta(num 1689176833240) 2023-07-12 15:47:17,414 DEBUG [RS:0;jenkins-hbase5:35841] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/oldWALs 2023-07-12 15:47:17,414 INFO [RS:0;jenkins-hbase5:35841] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C35841%2C1689176819491:(num 1689176833189) 2023-07-12 15:47:17,414 DEBUG [RS:0;jenkins-hbase5:35841] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:47:17,414 INFO [RS:0;jenkins-hbase5:35841] regionserver.LeaseManager(133): Closed leases 2023-07-12 15:47:17,414 INFO [RS:0;jenkins-hbase5:35841] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 15:47:17,415 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 15:47:17,416 INFO [RS:0;jenkins-hbase5:35841] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:35841 2023-07-12 15:47:17,422 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): regionserver:35841-0x101c5d389690001, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,35841,1689176819491 2023-07-12 15:47:17,422 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 15:47:17,422 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): regionserver:35841-0x101c5d389690001, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 15:47:17,424 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,35841,1689176819491] 2023-07-12 15:47:17,424 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,35841,1689176819491; numProcessing=1 2023-07-12 15:47:17,525 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): regionserver:35841-0x101c5d389690001, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:47:17,525 INFO [RS:0;jenkins-hbase5:35841] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,35841,1689176819491; zookeeper connection closed. 2023-07-12 15:47:17,525 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): regionserver:35841-0x101c5d389690001, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:47:17,527 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@487c8415] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@487c8415 2023-07-12 15:47:17,527 INFO [Listener at localhost/45565] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-12 15:47:17,527 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,35841,1689176819491 already deleted, retry=false 2023-07-12 15:47:17,528 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,35841,1689176819491 expired; onlineServers=0 2023-07-12 15:47:17,528 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,45897,1689176818263' ***** 2023-07-12 15:47:17,528 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 15:47:17,528 DEBUG [M:0;jenkins-hbase5:45897] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3177d37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 15:47:17,528 INFO [M:0;jenkins-hbase5:45897] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,45897,1689176818263 2023-07-12 15:47:17,528 INFO [M:0;jenkins-hbase5:45897] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,45897,1689176818263; all regions closed. 2023-07-12 15:47:17,528 DEBUG [M:0;jenkins-hbase5:45897] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:47:17,529 DEBUG [M:0;jenkins-hbase5:45897] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 15:47:17,529 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 15:47:17,529 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689176820689] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689176820689,5,FailOnTimeoutGroup] 2023-07-12 15:47:17,529 DEBUG [M:0;jenkins-hbase5:45897] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 15:47:17,529 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689176820689] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689176820689,5,FailOnTimeoutGroup] 2023-07-12 15:47:17,530 INFO [M:0;jenkins-hbase5:45897] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 15:47:17,530 INFO [M:0;jenkins-hbase5:45897] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 15:47:17,530 INFO [M:0;jenkins-hbase5:45897] hbase.ChoreService(369): Chore service for: master/jenkins-hbase5:0 had [] on shutdown 2023-07-12 15:47:17,530 DEBUG [M:0;jenkins-hbase5:45897] master.HMaster(1512): Stopping service threads 2023-07-12 15:47:17,531 INFO [M:0;jenkins-hbase5:45897] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 15:47:17,531 ERROR [M:0;jenkins-hbase5:45897] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] 2023-07-12 15:47:17,532 INFO [M:0;jenkins-hbase5:45897] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 15:47:17,532 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 15:47:17,532 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 15:47:17,532 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:17,532 DEBUG [M:0;jenkins-hbase5:45897] zookeeper.ZKUtil(398): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 15:47:17,532 WARN [M:0;jenkins-hbase5:45897] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 15:47:17,532 INFO [M:0;jenkins-hbase5:45897] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 15:47:17,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 15:47:17,533 INFO [M:0;jenkins-hbase5:45897] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 15:47:17,533 DEBUG [M:0;jenkins-hbase5:45897] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 15:47:17,533 INFO [M:0;jenkins-hbase5:45897] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:47:17,534 DEBUG [M:0;jenkins-hbase5:45897] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:47:17,534 DEBUG [M:0;jenkins-hbase5:45897] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 15:47:17,534 DEBUG [M:0;jenkins-hbase5:45897] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:47:17,534 INFO [M:0;jenkins-hbase5:45897] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.08 KB heapSize=45.73 KB 2023-07-12 15:47:17,534 WARN [AsyncFSWAL-0-hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData-prefix:jenkins-hbase5.apache.org,45897,1689176818263] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:17,534 DEBUG [master:store-WAL-Roller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase5.apache.org%2C45897%2C1689176818263:(num 1689176819971) roll requested 2023-07-12 15:47:17,554 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38649,DS-ab007bc0-4727-4136-9422-890d7102072c,DISK] 2023-07-12 15:47:17,554 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44797,DS-dd0f6980-82fe-4120-b328-2830d1621745,DISK] 2023-07-12 15:47:17,558 INFO [master:store-WAL-Roller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/WALs/jenkins-hbase5.apache.org,45897,1689176818263/jenkins-hbase5.apache.org%2C45897%2C1689176818263.1689176819971 with entries=89, filesize=43.93 KB; new WAL /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/WALs/jenkins-hbase5.apache.org,45897,1689176818263/jenkins-hbase5.apache.org%2C45897%2C1689176818263.1689176837535 2023-07-12 15:47:17,558 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38649,DS-ab007bc0-4727-4136-9422-890d7102072c,DISK], DatanodeInfoWithStorage[127.0.0.1:44797,DS-dd0f6980-82fe-4120-b328-2830d1621745,DISK]] 2023-07-12 15:47:17,559 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(716): hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/WALs/jenkins-hbase5.apache.org,45897,1689176818263/jenkins-hbase5.apache.org%2C45897%2C1689176818263.1689176819971 is not closed yet, will try archiving it next time 2023-07-12 15:47:17,559 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:17,559 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-12 15:47:17,559 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/WALs/jenkins-hbase5.apache.org,45897,1689176818263/jenkins-hbase5.apache.org%2C45897%2C1689176818263.1689176819971 2023-07-12 15:47:17,560 WARN [IPC Server handler 3 on default port 35925] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/WALs/jenkins-hbase5.apache.org,45897,1689176818263/jenkins-hbase5.apache.org%2C45897%2C1689176818263.1689176819971 has not been closed. Lease recovery is in progress. RecoveryId = 1024 for block blk_1073741829_1005 2023-07-12 15:47:17,561 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/WALs/jenkins-hbase5.apache.org,45897,1689176818263/jenkins-hbase5.apache.org%2C45897%2C1689176818263.1689176819971 after 2ms 2023-07-12 15:47:17,575 INFO [M:0;jenkins-hbase5:45897] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.08 KB at sequenceid=91 (bloomFilter=true), to=hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fe480640d7c44512ae24639813fee1d6 2023-07-12 15:47:17,585 DEBUG [M:0;jenkins-hbase5:45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fe480640d7c44512ae24639813fee1d6 as hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fe480640d7c44512ae24639813fee1d6 2023-07-12 15:47:17,594 INFO [M:0;jenkins-hbase5:45897] regionserver.HStore(1080): Added hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fe480640d7c44512ae24639813fee1d6, entries=11, sequenceid=91, filesize=7.0 K 2023-07-12 15:47:17,595 INFO [M:0;jenkins-hbase5:45897] regionserver.HRegion(2948): Finished flush of dataSize ~38.08 KB/38997, heapSize ~45.72 KB/46816, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 61ms, sequenceid=91, compaction requested=false 2023-07-12 15:47:17,597 INFO [M:0;jenkins-hbase5:45897] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:47:17,597 DEBUG [M:0;jenkins-hbase5:45897] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 15:47:17,602 WARN [Close-WAL-Writer-1] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/WALs/jenkins-hbase5.apache.org,45897,1689176818263/jenkins-hbase5.apache.org%2C45897%2C1689176818263.1689176837535 not finished, retry = 0 2023-07-12 15:47:18,422 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 15:47:19,006 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-12 15:47:21,562 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/WALs/jenkins-hbase5.apache.org,45897,1689176818263/jenkins-hbase5.apache.org%2C45897%2C1689176818263.1689176819971 after 4003ms 2023-07-12 15:47:21,563 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/WALs/jenkins-hbase5.apache.org,45897,1689176818263/jenkins-hbase5.apache.org%2C45897%2C1689176818263.1689176819971 to hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/oldWALs/jenkins-hbase5.apache.org%2C45897%2C1689176818263.1689176819971 2023-07-12 15:47:21,571 INFO [WAL-Archive-0] region.MasterRegionUtils(50): Moved hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/MasterData/oldWALs/jenkins-hbase5.apache.org%2C45897%2C1689176818263.1689176819971 to hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/oldWALs/jenkins-hbase5.apache.org%2C45897%2C1689176818263.1689176819971$masterlocalwal$ 2023-07-12 15:47:21,572 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 15:47:21,572 INFO [M:0;jenkins-hbase5:45897] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 15:47:21,572 INFO [M:0;jenkins-hbase5:45897] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:45897 2023-07-12 15:47:21,576 DEBUG [M:0;jenkins-hbase5:45897] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase5.apache.org,45897,1689176818263 already deleted, retry=false 2023-07-12 15:47:21,678 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:47:21,678 INFO [M:0;jenkins-hbase5:45897] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,45897,1689176818263; zookeeper connection closed. 2023-07-12 15:47:21,678 DEBUG [Listener at localhost/33199-EventThread] zookeeper.ZKWatcher(600): master:45897-0x101c5d389690000, quorum=127.0.0.1:60564, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:47:21,680 WARN [Listener at localhost/45565] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 15:47:21,684 INFO [Listener at localhost/45565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:47:21,788 WARN [BP-693421871-172.31.10.131-1689176815071 heartbeating to localhost/127.0.0.1:35925] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 15:47:21,788 WARN [BP-693421871-172.31.10.131-1689176815071 heartbeating to localhost/127.0.0.1:35925] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-693421871-172.31.10.131-1689176815071 (Datanode Uuid 2d9205a7-58d1-4e06-aa97-3acf384e2a8e) service to localhost/127.0.0.1:35925 2023-07-12 15:47:21,789 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e/dfs/data/data1/current/BP-693421871-172.31.10.131-1689176815071] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:47:21,789 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e/dfs/data/data2/current/BP-693421871-172.31.10.131-1689176815071] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:47:21,792 WARN [Listener at localhost/45565] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 15:47:21,797 INFO [Listener at localhost/45565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:47:21,900 WARN [BP-693421871-172.31.10.131-1689176815071 heartbeating to localhost/127.0.0.1:35925] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 15:47:21,900 WARN [BP-693421871-172.31.10.131-1689176815071 heartbeating to localhost/127.0.0.1:35925] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-693421871-172.31.10.131-1689176815071 (Datanode Uuid eda6d621-9730-4121-b8cb-0017c97c9925) service to localhost/127.0.0.1:35925 2023-07-12 15:47:21,901 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e/dfs/data/data9/current/BP-693421871-172.31.10.131-1689176815071] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:47:21,901 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e/dfs/data/data10/current/BP-693421871-172.31.10.131-1689176815071] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:47:21,903 WARN [Listener at localhost/45565] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 15:47:21,906 INFO [Listener at localhost/45565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:47:22,011 WARN [BP-693421871-172.31.10.131-1689176815071 heartbeating to localhost/127.0.0.1:35925] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 15:47:22,011 WARN [BP-693421871-172.31.10.131-1689176815071 heartbeating to localhost/127.0.0.1:35925] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-693421871-172.31.10.131-1689176815071 (Datanode Uuid 8bf5d95d-d007-462b-9890-073c593d01c4) service to localhost/127.0.0.1:35925 2023-07-12 15:47:22,012 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e/dfs/data/data7/current/BP-693421871-172.31.10.131-1689176815071] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:47:22,012 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e/dfs/data/data8/current/BP-693421871-172.31.10.131-1689176815071] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:47:22,013 WARN [Listener at localhost/45565] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 15:47:22,017 INFO [Listener at localhost/45565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:47:22,121 WARN [BP-693421871-172.31.10.131-1689176815071 heartbeating to localhost/127.0.0.1:35925] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 15:47:22,121 WARN [BP-693421871-172.31.10.131-1689176815071 heartbeating to localhost/127.0.0.1:35925] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-693421871-172.31.10.131-1689176815071 (Datanode Uuid e94ec5a0-edd6-4f47-8c23-61405a8d3940) service to localhost/127.0.0.1:35925 2023-07-12 15:47:22,121 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e/dfs/data/data5/current/BP-693421871-172.31.10.131-1689176815071] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:47:22,122 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e/dfs/data/data6/current/BP-693421871-172.31.10.131-1689176815071] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:47:22,123 WARN [Listener at localhost/45565] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 15:47:22,127 INFO [Listener at localhost/45565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:47:22,229 WARN [BP-693421871-172.31.10.131-1689176815071 heartbeating to localhost/127.0.0.1:35925] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 15:47:22,229 WARN [BP-693421871-172.31.10.131-1689176815071 heartbeating to localhost/127.0.0.1:35925] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-693421871-172.31.10.131-1689176815071 (Datanode Uuid 8acb0951-a59c-4022-ad22-2b0eda5dadac) service to localhost/127.0.0.1:35925 2023-07-12 15:47:22,230 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e/dfs/data/data3/current/BP-693421871-172.31.10.131-1689176815071] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:47:22,230 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/cluster_465fc90e-d4b9-fe69-d4bd-d09a79822a4e/dfs/data/data4/current/BP-693421871-172.31.10.131-1689176815071] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:47:22,266 INFO [Listener at localhost/45565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:47:22,290 INFO [Listener at localhost/45565] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 15:47:22,352 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-12 15:47:22,366 INFO [Listener at localhost/45565] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=78 (was 10) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase5:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase5:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1311286300) connection to localhost/127.0.0.1:35925 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35925 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1311286300) connection to localhost/127.0.0.1:35925 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase5:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45565 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: ForkJoinPool-3-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:35925 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@43701dd9 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1311286300) connection to localhost/127.0.0.1:35925 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=464 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=199 (was 170) - SystemLoadAverage LEAK? -, ProcessCount=161 (was 161), AvailableMemoryMB=7999 (was 8269) 2023-07-12 15:47:22,380 INFO [Listener at localhost/45565] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=78, OpenFileDescriptor=464, MaxFileDescriptor=60000, SystemLoadAverage=199, ProcessCount=161, AvailableMemoryMB=7997 2023-07-12 15:47:22,380 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 15:47:22,380 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/hadoop.log.dir so I do NOT create it in target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde 2023-07-12 15:47:22,381 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e43013ed-dbe0-ecd4-d3cc-74bc66fb7d30/hadoop.tmp.dir so I do NOT create it in target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde 2023-07-12 15:47:22,381 INFO [Listener at localhost/45565] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/cluster_f33d7e71-ff46-de78-c7fd-c901653bfaf2, deleteOnExit=true 2023-07-12 15:47:22,381 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 15:47:22,381 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/test.cache.data in system properties and HBase conf 2023-07-12 15:47:22,381 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 15:47:22,382 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/hadoop.log.dir in system properties and HBase conf 2023-07-12 15:47:22,382 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 15:47:22,382 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 15:47:22,382 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 15:47:22,382 DEBUG [Listener at localhost/45565] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 15:47:22,383 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 15:47:22,383 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 15:47:22,383 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 15:47:22,384 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 15:47:22,384 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 15:47:22,384 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 15:47:22,384 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 15:47:22,384 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 15:47:22,385 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 15:47:22,385 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/nfs.dump.dir in system properties and HBase conf 2023-07-12 15:47:22,385 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/java.io.tmpdir in system properties and HBase conf 2023-07-12 15:47:22,385 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 15:47:22,385 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 15:47:22,386 INFO [Listener at localhost/45565] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 15:47:22,394 WARN [Listener at localhost/45565] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 15:47:22,394 WARN [Listener at localhost/45565] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 15:47:22,450 WARN [Listener at localhost/45565] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:47:22,452 INFO [Listener at localhost/45565] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:47:22,458 INFO [Listener at localhost/45565] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/java.io.tmpdir/Jetty_localhost_43959_hdfs____.4kf9nc/webapp 2023-07-12 15:47:22,553 INFO [Listener at localhost/45565] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43959 2023-07-12 15:47:22,565 WARN [Listener at localhost/45565] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 15:47:22,565 WARN [Listener at localhost/45565] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 15:47:22,636 WARN [Listener at localhost/46697] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:47:22,664 WARN [Listener at localhost/46697] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 15:47:22,667 WARN [Listener at localhost/46697] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:47:22,668 INFO [Listener at localhost/46697] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:47:22,675 INFO [Listener at localhost/46697] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/java.io.tmpdir/Jetty_localhost_40671_datanode____sblj0b/webapp 2023-07-12 15:47:22,809 INFO [Listener at localhost/46697] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40671 2023-07-12 15:47:22,819 WARN [Listener at localhost/33649] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:47:22,852 WARN [Listener at localhost/33649] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 15:47:22,854 WARN [Listener at localhost/33649] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:47:22,856 INFO [Listener at localhost/33649] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:47:22,863 INFO [Listener at localhost/33649] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/java.io.tmpdir/Jetty_localhost_36361_datanode____uwo2mq/webapp 2023-07-12 15:47:22,952 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa729d69cb7b15e3d: Processing first storage report for DS-24a80e0e-894e-42d0-8277-c0e6ea9168ca from datanode cc46cd3c-b836-48b6-900a-fd3808851a2c 2023-07-12 15:47:22,953 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa729d69cb7b15e3d: from storage DS-24a80e0e-894e-42d0-8277-c0e6ea9168ca node DatanodeRegistration(127.0.0.1:39361, datanodeUuid=cc46cd3c-b836-48b6-900a-fd3808851a2c, infoPort=45499, infoSecurePort=0, ipcPort=33649, storageInfo=lv=-57;cid=testClusterID;nsid=880049146;c=1689176842399), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:47:22,953 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa729d69cb7b15e3d: Processing first storage report for DS-20915e38-5795-49bb-8757-a50e3d341c69 from datanode cc46cd3c-b836-48b6-900a-fd3808851a2c 2023-07-12 15:47:22,953 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa729d69cb7b15e3d: from storage DS-20915e38-5795-49bb-8757-a50e3d341c69 node DatanodeRegistration(127.0.0.1:39361, datanodeUuid=cc46cd3c-b836-48b6-900a-fd3808851a2c, infoPort=45499, infoSecurePort=0, ipcPort=33649, storageInfo=lv=-57;cid=testClusterID;nsid=880049146;c=1689176842399), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:47:22,990 INFO [Listener at localhost/33649] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36361 2023-07-12 15:47:23,005 WARN [Listener at localhost/44763] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:47:23,127 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x74abdcd2dfa387cc: Processing first storage report for DS-cc096cf7-4028-46d8-8627-81bb9c4751cf from datanode a26a6b05-6004-4340-8e98-db3eea5001a5 2023-07-12 15:47:23,128 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x74abdcd2dfa387cc: from storage DS-cc096cf7-4028-46d8-8627-81bb9c4751cf node DatanodeRegistration(127.0.0.1:38561, datanodeUuid=a26a6b05-6004-4340-8e98-db3eea5001a5, infoPort=35187, infoSecurePort=0, ipcPort=44763, storageInfo=lv=-57;cid=testClusterID;nsid=880049146;c=1689176842399), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:47:23,128 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x74abdcd2dfa387cc: Processing first storage report for DS-e7b0f369-4ecc-438c-9677-65bb89d5bcf8 from datanode a26a6b05-6004-4340-8e98-db3eea5001a5 2023-07-12 15:47:23,128 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x74abdcd2dfa387cc: from storage DS-e7b0f369-4ecc-438c-9677-65bb89d5bcf8 node DatanodeRegistration(127.0.0.1:38561, datanodeUuid=a26a6b05-6004-4340-8e98-db3eea5001a5, infoPort=35187, infoSecurePort=0, ipcPort=44763, storageInfo=lv=-57;cid=testClusterID;nsid=880049146;c=1689176842399), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:47:23,220 DEBUG [Listener at localhost/44763] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde 2023-07-12 15:47:23,232 INFO [Listener at localhost/44763] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/cluster_f33d7e71-ff46-de78-c7fd-c901653bfaf2/zookeeper_0, clientPort=55003, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/cluster_f33d7e71-ff46-de78-c7fd-c901653bfaf2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/cluster_f33d7e71-ff46-de78-c7fd-c901653bfaf2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 15:47:23,240 INFO [Listener at localhost/44763] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55003 2023-07-12 15:47:23,241 INFO [Listener at localhost/44763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:47:23,242 INFO [Listener at localhost/44763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:47:23,329 INFO [Listener at localhost/44763] util.FSUtils(471): Created version file at hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c with version=8 2023-07-12 15:47:23,329 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/hbase-staging 2023-07-12 15:47:23,331 INFO [Listener at localhost/44763] client.ConnectionUtils(127): master/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 15:47:23,331 INFO [Listener at localhost/44763] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:47:23,331 INFO [Listener at localhost/44763] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 15:47:23,331 INFO [Listener at localhost/44763] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 15:47:23,331 INFO [Listener at localhost/44763] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:47:23,332 INFO [Listener at localhost/44763] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 15:47:23,332 INFO [Listener at localhost/44763] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 15:47:23,334 INFO [Listener at localhost/44763] ipc.NettyRpcServer(120): Bind to /172.31.10.131:38075 2023-07-12 15:47:23,334 INFO [Listener at localhost/44763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:47:23,336 INFO [Listener at localhost/44763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:47:23,337 INFO [Listener at localhost/44763] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38075 connecting to ZooKeeper ensemble=127.0.0.1:55003 2023-07-12 15:47:23,345 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:380750x0, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 15:47:23,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38075-0x101c5d3ee390000 connected 2023-07-12 15:47:23,371 DEBUG [Listener at localhost/44763] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 15:47:23,372 DEBUG [Listener at localhost/44763] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:47:23,372 DEBUG [Listener at localhost/44763] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 15:47:23,375 DEBUG [Listener at localhost/44763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38075 2023-07-12 15:47:23,375 DEBUG [Listener at localhost/44763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38075 2023-07-12 15:47:23,376 DEBUG [Listener at localhost/44763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38075 2023-07-12 15:47:23,379 DEBUG [Listener at localhost/44763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38075 2023-07-12 15:47:23,379 DEBUG [Listener at localhost/44763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38075 2023-07-12 15:47:23,380 INFO [Listener at localhost/44763] master.HMaster(444): hbase.rootdir=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c, hbase.cluster.distributed=false 2023-07-12 15:47:23,393 INFO [Listener at localhost/44763] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 15:47:23,394 INFO [Listener at localhost/44763] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:47:23,394 INFO [Listener at localhost/44763] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 15:47:23,394 INFO [Listener at localhost/44763] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 15:47:23,394 INFO [Listener at localhost/44763] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:47:23,394 INFO [Listener at localhost/44763] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 15:47:23,394 INFO [Listener at localhost/44763] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 15:47:23,396 INFO [Listener at localhost/44763] ipc.NettyRpcServer(120): Bind to /172.31.10.131:41803 2023-07-12 15:47:23,397 INFO [Listener at localhost/44763] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 15:47:23,399 DEBUG [Listener at localhost/44763] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 15:47:23,400 INFO [Listener at localhost/44763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:47:23,402 INFO [Listener at localhost/44763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:47:23,403 INFO [Listener at localhost/44763] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41803 connecting to ZooKeeper ensemble=127.0.0.1:55003 2023-07-12 15:47:23,407 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:418030x0, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 15:47:23,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41803-0x101c5d3ee390001 connected 2023-07-12 15:47:23,408 DEBUG [Listener at localhost/44763] zookeeper.ZKUtil(164): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 15:47:23,409 DEBUG [Listener at localhost/44763] zookeeper.ZKUtil(164): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:47:23,410 DEBUG [Listener at localhost/44763] zookeeper.ZKUtil(164): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 15:47:23,412 DEBUG [Listener at localhost/44763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41803 2023-07-12 15:47:23,412 DEBUG [Listener at localhost/44763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41803 2023-07-12 15:47:23,412 DEBUG [Listener at localhost/44763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41803 2023-07-12 15:47:23,413 DEBUG [Listener at localhost/44763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41803 2023-07-12 15:47:23,413 DEBUG [Listener at localhost/44763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41803 2023-07-12 15:47:23,416 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase5.apache.org,38075,1689176843330 2023-07-12 15:47:23,418 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 15:47:23,419 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase5.apache.org,38075,1689176843330 2023-07-12 15:47:23,420 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 15:47:23,420 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 15:47:23,420 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:23,422 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 15:47:23,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 15:47:23,427 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase5.apache.org,38075,1689176843330 from backup master directory 2023-07-12 15:47:23,428 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase5.apache.org,38075,1689176843330 2023-07-12 15:47:23,428 WARN [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 15:47:23,428 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 15:47:23,428 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase5.apache.org,38075,1689176843330 2023-07-12 15:47:23,455 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/hbase.id with ID: 0940df13-b5bc-43e5-af0f-12cd0df83f3d 2023-07-12 15:47:23,472 INFO [master/jenkins-hbase5:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:47:23,475 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:23,490 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3141a719 to 127.0.0.1:55003 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 15:47:23,495 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d53324e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 15:47:23,495 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 15:47:23,496 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 15:47:23,496 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 15:47:23,498 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/MasterData/data/master/store-tmp 2023-07-12 15:47:23,918 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:47:23,919 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 15:47:23,919 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:47:23,919 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:47:23,919 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 15:47:23,919 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:47:23,919 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:47:23,919 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 15:47:23,920 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/MasterData/WALs/jenkins-hbase5.apache.org,38075,1689176843330 2023-07-12 15:47:23,924 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C38075%2C1689176843330, suffix=, logDir=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/MasterData/WALs/jenkins-hbase5.apache.org,38075,1689176843330, archiveDir=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/MasterData/oldWALs, maxLogs=10 2023-07-12 15:47:23,925 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-12 15:47:23,951 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38561,DS-cc096cf7-4028-46d8-8627-81bb9c4751cf,DISK] 2023-07-12 15:47:23,952 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39361,DS-24a80e0e-894e-42d0-8277-c0e6ea9168ca,DISK] 2023-07-12 15:47:23,955 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/MasterData/WALs/jenkins-hbase5.apache.org,38075,1689176843330/jenkins-hbase5.apache.org%2C38075%2C1689176843330.1689176843924 2023-07-12 15:47:23,955 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38561,DS-cc096cf7-4028-46d8-8627-81bb9c4751cf,DISK], DatanodeInfoWithStorage[127.0.0.1:39361,DS-24a80e0e-894e-42d0-8277-c0e6ea9168ca,DISK]] 2023-07-12 15:47:23,955 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 15:47:23,955 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:47:23,956 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:47:23,956 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:47:23,958 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:47:23,961 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 15:47:23,961 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 15:47:23,962 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:23,964 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:47:23,966 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:47:23,970 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:47:23,973 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 15:47:23,973 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=865258, jitterRate=0.10023273527622223}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 15:47:23,973 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 15:47:23,974 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 15:47:23,975 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 15:47:23,975 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 15:47:23,975 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 15:47:23,976 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 15:47:23,976 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-07-12 15:47:23,976 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 15:47:23,977 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 15:47:23,978 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 15:47:23,989 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 15:47:23,989 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 15:47:23,990 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 15:47:23,990 INFO [master/jenkins-hbase5:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 15:47:23,990 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 15:47:23,992 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:23,993 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 15:47:23,993 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 15:47:23,994 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 15:47:23,995 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 15:47:23,995 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 15:47:23,995 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:23,996 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase5.apache.org,38075,1689176843330, sessionid=0x101c5d3ee390000, setting cluster-up flag (Was=false) 2023-07-12 15:47:24,000 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:24,005 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 15:47:24,006 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,38075,1689176843330 2023-07-12 15:47:24,009 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:24,018 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 15:47:24,019 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,38075,1689176843330 2023-07-12 15:47:24,021 WARN [master/jenkins-hbase5:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/.hbase-snapshot/.tmp 2023-07-12 15:47:24,024 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 15:47:24,024 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:47:24,024 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:47:24,024 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:47:24,024 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:47:24,024 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase5:0, corePoolSize=10, maxPoolSize=10 2023-07-12 15:47:24,024 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:24,024 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 15:47:24,024 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:24,028 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689176874028 2023-07-12 15:47:24,029 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 15:47:24,029 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 15:47:24,029 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 15:47:24,029 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 15:47:24,029 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 15:47:24,029 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 15:47:24,029 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:24,030 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 15:47:24,030 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 15:47:24,030 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 15:47:24,030 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 15:47:24,030 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 15:47:24,031 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 15:47:24,035 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 15:47:24,035 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 15:47:24,036 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689176844036,5,FailOnTimeoutGroup] 2023-07-12 15:47:24,038 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689176844036,5,FailOnTimeoutGroup] 2023-07-12 15:47:24,038 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:24,038 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 15:47:24,038 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:24,038 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:24,049 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 15:47:24,050 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 15:47:24,050 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c 2023-07-12 15:47:24,060 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:47:24,062 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 15:47:24,064 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/info 2023-07-12 15:47:24,064 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 15:47:24,065 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:24,065 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 15:47:24,066 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/rep_barrier 2023-07-12 15:47:24,067 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 15:47:24,068 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:24,068 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 15:47:24,069 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/table 2023-07-12 15:47:24,070 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 15:47:24,070 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:24,071 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740 2023-07-12 15:47:24,072 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740 2023-07-12 15:47:24,075 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-12 15:47:24,076 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 15:47:24,079 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 15:47:24,079 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=761990, jitterRate=-0.031079664826393127}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-12 15:47:24,079 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 15:47:24,080 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 15:47:24,080 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 15:47:24,080 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 15:47:24,080 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 15:47:24,080 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 15:47:24,080 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 15:47:24,080 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 15:47:24,081 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 15:47:24,081 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 15:47:24,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 15:47:24,083 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 15:47:24,085 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 15:47:24,117 INFO [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(951): ClusterId : 0940df13-b5bc-43e5-af0f-12cd0df83f3d 2023-07-12 15:47:24,118 DEBUG [RS:0;jenkins-hbase5:41803] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 15:47:24,120 DEBUG [RS:0;jenkins-hbase5:41803] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 15:47:24,120 DEBUG [RS:0;jenkins-hbase5:41803] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 15:47:24,123 DEBUG [RS:0;jenkins-hbase5:41803] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 15:47:24,124 DEBUG [RS:0;jenkins-hbase5:41803] zookeeper.ReadOnlyZKClient(139): Connect 0x2d64618b to 127.0.0.1:55003 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 15:47:24,131 DEBUG [RS:0;jenkins-hbase5:41803] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23a38a57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 15:47:24,131 DEBUG [RS:0;jenkins-hbase5:41803] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@279c0afb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 15:47:24,140 DEBUG [RS:0;jenkins-hbase5:41803] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase5:41803 2023-07-12 15:47:24,140 INFO [RS:0;jenkins-hbase5:41803] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 15:47:24,140 INFO [RS:0;jenkins-hbase5:41803] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 15:47:24,140 DEBUG [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 15:47:24,141 INFO [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,38075,1689176843330 with isa=jenkins-hbase5.apache.org/172.31.10.131:41803, startcode=1689176843393 2023-07-12 15:47:24,141 DEBUG [RS:0;jenkins-hbase5:41803] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 15:47:24,144 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:41587, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 15:47:24,145 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38075] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:24,146 DEBUG [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c 2023-07-12 15:47:24,146 DEBUG [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46697 2023-07-12 15:47:24,146 DEBUG [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 15:47:24,147 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 15:47:24,148 DEBUG [RS:0;jenkins-hbase5:41803] zookeeper.ZKUtil(162): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:24,148 WARN [RS:0;jenkins-hbase5:41803] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 15:47:24,148 INFO [RS:0;jenkins-hbase5:41803] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 15:47:24,148 DEBUG [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:24,148 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,41803,1689176843393] 2023-07-12 15:47:24,152 DEBUG [RS:0;jenkins-hbase5:41803] zookeeper.ZKUtil(162): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:24,153 DEBUG [RS:0;jenkins-hbase5:41803] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 15:47:24,153 INFO [RS:0;jenkins-hbase5:41803] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 15:47:24,155 INFO [RS:0;jenkins-hbase5:41803] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 15:47:24,155 INFO [RS:0;jenkins-hbase5:41803] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 15:47:24,155 INFO [RS:0;jenkins-hbase5:41803] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:24,158 INFO [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 15:47:24,160 INFO [RS:0;jenkins-hbase5:41803] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:24,160 DEBUG [RS:0;jenkins-hbase5:41803] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:24,160 DEBUG [RS:0;jenkins-hbase5:41803] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:24,160 DEBUG [RS:0;jenkins-hbase5:41803] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:24,160 DEBUG [RS:0;jenkins-hbase5:41803] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:24,160 DEBUG [RS:0;jenkins-hbase5:41803] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:24,160 DEBUG [RS:0;jenkins-hbase5:41803] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 15:47:24,160 DEBUG [RS:0;jenkins-hbase5:41803] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:24,160 DEBUG [RS:0;jenkins-hbase5:41803] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:24,160 DEBUG [RS:0;jenkins-hbase5:41803] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:24,160 DEBUG [RS:0;jenkins-hbase5:41803] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:47:24,163 INFO [RS:0;jenkins-hbase5:41803] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:24,163 INFO [RS:0;jenkins-hbase5:41803] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:24,163 INFO [RS:0;jenkins-hbase5:41803] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:24,174 INFO [RS:0;jenkins-hbase5:41803] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 15:47:24,174 INFO [RS:0;jenkins-hbase5:41803] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,41803,1689176843393-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:24,185 INFO [RS:0;jenkins-hbase5:41803] regionserver.Replication(203): jenkins-hbase5.apache.org,41803,1689176843393 started 2023-07-12 15:47:24,185 INFO [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,41803,1689176843393, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:41803, sessionid=0x101c5d3ee390001 2023-07-12 15:47:24,185 DEBUG [RS:0;jenkins-hbase5:41803] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 15:47:24,185 DEBUG [RS:0;jenkins-hbase5:41803] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:24,185 DEBUG [RS:0;jenkins-hbase5:41803] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,41803,1689176843393' 2023-07-12 15:47:24,185 DEBUG [RS:0;jenkins-hbase5:41803] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 15:47:24,186 DEBUG [RS:0;jenkins-hbase5:41803] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 15:47:24,186 DEBUG [RS:0;jenkins-hbase5:41803] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 15:47:24,186 DEBUG [RS:0;jenkins-hbase5:41803] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 15:47:24,186 DEBUG [RS:0;jenkins-hbase5:41803] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:24,186 DEBUG [RS:0;jenkins-hbase5:41803] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,41803,1689176843393' 2023-07-12 15:47:24,186 DEBUG [RS:0;jenkins-hbase5:41803] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 15:47:24,186 DEBUG [RS:0;jenkins-hbase5:41803] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 15:47:24,187 DEBUG [RS:0;jenkins-hbase5:41803] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 15:47:24,187 INFO [RS:0;jenkins-hbase5:41803] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 15:47:24,187 INFO [RS:0;jenkins-hbase5:41803] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 15:47:24,235 DEBUG [jenkins-hbase5:38075] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-12 15:47:24,236 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,41803,1689176843393, state=OPENING 2023-07-12 15:47:24,237 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 15:47:24,238 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:24,239 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,41803,1689176843393}] 2023-07-12 15:47:24,239 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 15:47:24,289 INFO [RS:0;jenkins-hbase5:41803] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C41803%2C1689176843393, suffix=, logDir=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393, archiveDir=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/oldWALs, maxLogs=32 2023-07-12 15:47:24,307 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39361,DS-24a80e0e-894e-42d0-8277-c0e6ea9168ca,DISK] 2023-07-12 15:47:24,307 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38561,DS-cc096cf7-4028-46d8-8627-81bb9c4751cf,DISK] 2023-07-12 15:47:24,310 INFO [RS:0;jenkins-hbase5:41803] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393/jenkins-hbase5.apache.org%2C41803%2C1689176843393.1689176844291 2023-07-12 15:47:24,310 DEBUG [RS:0;jenkins-hbase5:41803] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39361,DS-24a80e0e-894e-42d0-8277-c0e6ea9168ca,DISK], DatanodeInfoWithStorage[127.0.0.1:38561,DS-cc096cf7-4028-46d8-8627-81bb9c4751cf,DISK]] 2023-07-12 15:47:24,393 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:24,393 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 15:47:24,395 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47908, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 15:47:24,400 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 15:47:24,400 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 15:47:24,402 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C41803%2C1689176843393.meta, suffix=.meta, logDir=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393, archiveDir=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/oldWALs, maxLogs=32 2023-07-12 15:47:24,420 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39361,DS-24a80e0e-894e-42d0-8277-c0e6ea9168ca,DISK] 2023-07-12 15:47:24,420 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38561,DS-cc096cf7-4028-46d8-8627-81bb9c4751cf,DISK] 2023-07-12 15:47:24,422 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393/jenkins-hbase5.apache.org%2C41803%2C1689176843393.meta.1689176844403.meta 2023-07-12 15:47:24,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38561,DS-cc096cf7-4028-46d8-8627-81bb9c4751cf,DISK], DatanodeInfoWithStorage[127.0.0.1:39361,DS-24a80e0e-894e-42d0-8277-c0e6ea9168ca,DISK]] 2023-07-12 15:47:24,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 15:47:24,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 15:47:24,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 15:47:24,424 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 15:47:24,424 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 15:47:24,424 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:47:24,424 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 15:47:24,424 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 15:47:24,426 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 15:47:24,427 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/info 2023-07-12 15:47:24,427 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/info 2023-07-12 15:47:24,428 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 15:47:24,429 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:24,429 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 15:47:24,430 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/rep_barrier 2023-07-12 15:47:24,430 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/rep_barrier 2023-07-12 15:47:24,431 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 15:47:24,431 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:24,432 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 15:47:24,433 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/table 2023-07-12 15:47:24,433 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/table 2023-07-12 15:47:24,434 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 15:47:24,436 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:24,436 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740 2023-07-12 15:47:24,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740 2023-07-12 15:47:24,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-12 15:47:24,442 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 15:47:24,443 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=785306, jitterRate=-0.0014322102069854736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-12 15:47:24,443 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 15:47:24,444 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689176844392 2023-07-12 15:47:24,448 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 15:47:24,448 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 15:47:24,449 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,41803,1689176843393, state=OPEN 2023-07-12 15:47:24,455 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 15:47:24,455 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 15:47:24,458 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 15:47:24,458 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,41803,1689176843393 in 216 msec 2023-07-12 15:47:24,460 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 15:47:24,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 376 msec 2023-07-12 15:47:24,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 439 msec 2023-07-12 15:47:24,463 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689176844463, completionTime=-1 2023-07-12 15:47:24,463 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-12 15:47:24,463 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 15:47:24,466 DEBUG [hconnection-0x1715ebba-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 15:47:24,468 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 15:47:24,470 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-12 15:47:24,470 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689176904470 2023-07-12 15:47:24,470 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689176964470 2023-07-12 15:47:24,470 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 6 msec 2023-07-12 15:47:24,476 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,38075,1689176843330-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:24,476 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,38075,1689176843330-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:24,476 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,38075,1689176843330-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:24,476 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase5:38075, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:24,476 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 15:47:24,476 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 15:47:24,476 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 15:47:24,478 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 15:47:24,478 DEBUG [master/jenkins-hbase5:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 15:47:24,480 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 15:47:24,481 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 15:47:24,484 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/.tmp/data/hbase/namespace/e3c5d91272e1b244031c2145e23bdc2a 2023-07-12 15:47:24,485 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/.tmp/data/hbase/namespace/e3c5d91272e1b244031c2145e23bdc2a empty. 2023-07-12 15:47:24,485 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/.tmp/data/hbase/namespace/e3c5d91272e1b244031c2145e23bdc2a 2023-07-12 15:47:24,486 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 15:47:24,503 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 15:47:24,505 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e3c5d91272e1b244031c2145e23bdc2a, NAME => 'hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/.tmp 2023-07-12 15:47:24,518 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:47:24,518 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e3c5d91272e1b244031c2145e23bdc2a, disabling compactions & flushes 2023-07-12 15:47:24,518 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. 2023-07-12 15:47:24,518 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. 2023-07-12 15:47:24,518 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. after waiting 0 ms 2023-07-12 15:47:24,518 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. 2023-07-12 15:47:24,518 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. 2023-07-12 15:47:24,518 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e3c5d91272e1b244031c2145e23bdc2a: 2023-07-12 15:47:24,522 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 15:47:24,523 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689176844523"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689176844523"}]},"ts":"1689176844523"} 2023-07-12 15:47:24,526 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 15:47:24,528 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 15:47:24,528 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689176844528"}]},"ts":"1689176844528"} 2023-07-12 15:47:24,530 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 15:47:24,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e3c5d91272e1b244031c2145e23bdc2a, ASSIGN}] 2023-07-12 15:47:24,545 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e3c5d91272e1b244031c2145e23bdc2a, ASSIGN 2023-07-12 15:47:24,547 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e3c5d91272e1b244031c2145e23bdc2a, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,41803,1689176843393; forceNewPlan=false, retain=false 2023-07-12 15:47:24,698 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e3c5d91272e1b244031c2145e23bdc2a, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:24,698 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689176844698"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689176844698"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689176844698"}]},"ts":"1689176844698"} 2023-07-12 15:47:24,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e3c5d91272e1b244031c2145e23bdc2a, server=jenkins-hbase5.apache.org,41803,1689176843393}] 2023-07-12 15:47:24,862 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. 2023-07-12 15:47:24,862 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e3c5d91272e1b244031c2145e23bdc2a, NAME => 'hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a.', STARTKEY => '', ENDKEY => ''} 2023-07-12 15:47:24,862 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e3c5d91272e1b244031c2145e23bdc2a 2023-07-12 15:47:24,863 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:47:24,863 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for e3c5d91272e1b244031c2145e23bdc2a 2023-07-12 15:47:24,863 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for e3c5d91272e1b244031c2145e23bdc2a 2023-07-12 15:47:24,864 INFO [StoreOpener-e3c5d91272e1b244031c2145e23bdc2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e3c5d91272e1b244031c2145e23bdc2a 2023-07-12 15:47:24,866 DEBUG [StoreOpener-e3c5d91272e1b244031c2145e23bdc2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/namespace/e3c5d91272e1b244031c2145e23bdc2a/info 2023-07-12 15:47:24,866 DEBUG [StoreOpener-e3c5d91272e1b244031c2145e23bdc2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/namespace/e3c5d91272e1b244031c2145e23bdc2a/info 2023-07-12 15:47:24,866 INFO [StoreOpener-e3c5d91272e1b244031c2145e23bdc2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3c5d91272e1b244031c2145e23bdc2a columnFamilyName info 2023-07-12 15:47:24,867 INFO [StoreOpener-e3c5d91272e1b244031c2145e23bdc2a-1] regionserver.HStore(310): Store=e3c5d91272e1b244031c2145e23bdc2a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:24,868 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/namespace/e3c5d91272e1b244031c2145e23bdc2a 2023-07-12 15:47:24,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/namespace/e3c5d91272e1b244031c2145e23bdc2a 2023-07-12 15:47:24,873 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for e3c5d91272e1b244031c2145e23bdc2a 2023-07-12 15:47:24,876 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/namespace/e3c5d91272e1b244031c2145e23bdc2a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 15:47:24,876 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened e3c5d91272e1b244031c2145e23bdc2a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=852941, jitterRate=0.08457158505916595}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 15:47:24,876 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for e3c5d91272e1b244031c2145e23bdc2a: 2023-07-12 15:47:24,877 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a., pid=6, masterSystemTime=1689176844857 2023-07-12 15:47:24,880 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. 2023-07-12 15:47:24,880 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. 2023-07-12 15:47:24,881 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e3c5d91272e1b244031c2145e23bdc2a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:24,881 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689176844881"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689176844881"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689176844881"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689176844881"}]},"ts":"1689176844881"} 2023-07-12 15:47:24,886 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 15:47:24,886 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e3c5d91272e1b244031c2145e23bdc2a, server=jenkins-hbase5.apache.org,41803,1689176843393 in 182 msec 2023-07-12 15:47:24,888 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 15:47:24,889 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e3c5d91272e1b244031c2145e23bdc2a, ASSIGN in 343 msec 2023-07-12 15:47:24,890 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 15:47:24,890 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689176844890"}]},"ts":"1689176844890"} 2023-07-12 15:47:24,892 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 15:47:24,894 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 15:47:24,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 417 msec 2023-07-12 15:47:24,980 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 15:47:24,982 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 15:47:24,982 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:24,991 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 15:47:25,002 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 15:47:25,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 19 msec 2023-07-12 15:47:25,013 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 15:47:25,022 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 15:47:25,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-12 15:47:25,044 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 15:47:25,047 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 15:47:25,047 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.618sec 2023-07-12 15:47:25,048 INFO [master/jenkins-hbase5:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 15:47:25,048 INFO [master/jenkins-hbase5:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 15:47:25,048 INFO [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 15:47:25,048 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,38075,1689176843330-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 15:47:25,048 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,38075,1689176843330-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 15:47:25,057 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 15:47:25,118 DEBUG [Listener at localhost/44763] zookeeper.ReadOnlyZKClient(139): Connect 0x12f71549 to 127.0.0.1:55003 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 15:47:25,122 DEBUG [Listener at localhost/44763] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@191a8e52, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 15:47:25,124 DEBUG [hconnection-0x42012195-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 15:47:25,126 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 15:47:25,127 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase5.apache.org,38075,1689176843330 2023-07-12 15:47:25,128 INFO [Listener at localhost/44763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:47:25,132 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-12 15:47:25,132 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:47:25,133 INFO [Listener at localhost/44763] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-12 15:47:25,135 DEBUG [Listener at localhost/44763] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 15:47:25,139 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:49400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 15:47:25,141 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-07-12 15:47:25,141 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-07-12 15:47:25,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 15:47:25,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:25,145 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 15:47:25,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testCompactionRecordDoesntBlockRolling" procId is: 9 2023-07-12 15:47:25,147 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 15:47:25,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 15:47:25,151 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3 2023-07-12 15:47:25,151 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3 empty. 2023-07-12 15:47:25,152 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3 2023-07-12 15:47:25,152 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testCompactionRecordDoesntBlockRolling regions 2023-07-12 15:47:25,172 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/.tabledesc/.tableinfo.0000000001 2023-07-12 15:47:25,174 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => 358e3eb8e44a2beb36ae03ca8028cbe3, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/.tmp 2023-07-12 15:47:25,186 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:47:25,186 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1604): Closing 358e3eb8e44a2beb36ae03ca8028cbe3, disabling compactions & flushes 2023-07-12 15:47:25,186 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:47:25,186 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:47:25,186 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. after waiting 0 ms 2023-07-12 15:47:25,186 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:47:25,186 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:47:25,186 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1558): Region close journal for 358e3eb8e44a2beb36ae03ca8028cbe3: 2023-07-12 15:47:25,189 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 15:47:25,192 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1689176845191"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689176845191"}]},"ts":"1689176845191"} 2023-07-12 15:47:25,194 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 15:47:25,195 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 15:47:25,195 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689176845195"}]},"ts":"1689176845195"} 2023-07-12 15:47:25,198 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLING in hbase:meta 2023-07-12 15:47:25,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=358e3eb8e44a2beb36ae03ca8028cbe3, ASSIGN}] 2023-07-12 15:47:25,204 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=358e3eb8e44a2beb36ae03ca8028cbe3, ASSIGN 2023-07-12 15:47:25,205 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=358e3eb8e44a2beb36ae03ca8028cbe3, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,41803,1689176843393; forceNewPlan=false, retain=false 2023-07-12 15:47:25,356 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=358e3eb8e44a2beb36ae03ca8028cbe3, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:25,356 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1689176845356"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689176845356"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689176845356"}]},"ts":"1689176845356"} 2023-07-12 15:47:25,359 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 358e3eb8e44a2beb36ae03ca8028cbe3, server=jenkins-hbase5.apache.org,41803,1689176843393}] 2023-07-12 15:47:25,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:47:25,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 358e3eb8e44a2beb36ae03ca8028cbe3, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3.', STARTKEY => '', ENDKEY => ''} 2023-07-12 15:47:25,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testCompactionRecordDoesntBlockRolling 358e3eb8e44a2beb36ae03ca8028cbe3 2023-07-12 15:47:25,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:47:25,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 358e3eb8e44a2beb36ae03ca8028cbe3 2023-07-12 15:47:25,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 358e3eb8e44a2beb36ae03ca8028cbe3 2023-07-12 15:47:25,520 INFO [StoreOpener-358e3eb8e44a2beb36ae03ca8028cbe3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 358e3eb8e44a2beb36ae03ca8028cbe3 2023-07-12 15:47:25,522 DEBUG [StoreOpener-358e3eb8e44a2beb36ae03ca8028cbe3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info 2023-07-12 15:47:25,522 DEBUG [StoreOpener-358e3eb8e44a2beb36ae03ca8028cbe3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info 2023-07-12 15:47:25,522 INFO [StoreOpener-358e3eb8e44a2beb36ae03ca8028cbe3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 358e3eb8e44a2beb36ae03ca8028cbe3 columnFamilyName info 2023-07-12 15:47:25,523 INFO [StoreOpener-358e3eb8e44a2beb36ae03ca8028cbe3-1] regionserver.HStore(310): Store=358e3eb8e44a2beb36ae03ca8028cbe3/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:47:25,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3 2023-07-12 15:47:25,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3 2023-07-12 15:47:25,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 358e3eb8e44a2beb36ae03ca8028cbe3 2023-07-12 15:47:25,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 15:47:25,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 358e3eb8e44a2beb36ae03ca8028cbe3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=693782, jitterRate=-0.11781154572963715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 15:47:25,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 358e3eb8e44a2beb36ae03ca8028cbe3: 2023-07-12 15:47:25,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3., pid=11, masterSystemTime=1689176845512 2023-07-12 15:47:25,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:47:25,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:47:25,536 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=358e3eb8e44a2beb36ae03ca8028cbe3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:25,536 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1689176845536"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689176845536"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689176845536"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689176845536"}]},"ts":"1689176845536"} 2023-07-12 15:47:25,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 15:47:25,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 358e3eb8e44a2beb36ae03ca8028cbe3, server=jenkins-hbase5.apache.org,41803,1689176843393 in 179 msec 2023-07-12 15:47:25,544 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 15:47:25,545 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=358e3eb8e44a2beb36ae03ca8028cbe3, ASSIGN in 340 msec 2023-07-12 15:47:25,545 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 15:47:25,546 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689176845545"}]},"ts":"1689176845545"} 2023-07-12 15:47:25,547 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLED in hbase:meta 2023-07-12 15:47:25,556 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 15:47:25,559 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling in 415 msec 2023-07-12 15:47:28,422 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 15:47:28,423 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 15:47:29,927 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-12 15:47:30,154 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 15:47:30,154 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 15:47:30,155 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-12 15:47:35,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 15:47:35,149 INFO [Listener at localhost/44763] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testCompactionRecordDoesntBlockRolling, procId: 9 completed 2023-07-12 15:47:35,152 DEBUG [Listener at localhost/44763] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:35,153 DEBUG [Listener at localhost/44763] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:47:35,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] master.MasterRpcServices(936): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-07-12 15:47:35,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] procedure.ProcedureCoordinator(165): Submitting procedure hbase:namespace 2023-07-12 15:47:35,174 INFO [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase:namespace' 2023-07-12 15:47:35,174 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 15:47:35,174 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase:namespace' starting 'acquire' 2023-07-12 15:47:35,174 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase:namespace', kicking off acquire phase on members. 2023-07-12 15:47:35,175 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-07-12 15:47:35,175 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-12 15:47:35,176 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 15:47:35,176 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 15:47:35,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 15:47:35,177 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,177 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 15:47:35,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase:namespace 2023-07-12 15:47:35,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-07-12 15:47:35,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 15:47:35,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-12 15:47:35,178 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase:namespace 2023-07-12 15:47:35,180 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase:namespace 2023-07-12 15:47:35,180 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase:namespace' with timeout 60000ms 2023-07-12 15:47:35,180 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 15:47:35,181 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase:namespace' starting 'acquire' stage 2023-07-12 15:47:35,181 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 15:47:35,182 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. 2023-07-12 15:47:35,182 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 15:47:35,182 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. started... 2023-07-12 15:47:35,182 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3c5d91272e1b244031c2145e23bdc2a 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 15:47:35,199 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/namespace/e3c5d91272e1b244031c2145e23bdc2a/.tmp/info/c05ffd24a7764d569fb3d52f05cf380c 2023-07-12 15:47:35,212 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/namespace/e3c5d91272e1b244031c2145e23bdc2a/.tmp/info/c05ffd24a7764d569fb3d52f05cf380c as hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/namespace/e3c5d91272e1b244031c2145e23bdc2a/info/c05ffd24a7764d569fb3d52f05cf380c 2023-07-12 15:47:35,221 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/namespace/e3c5d91272e1b244031c2145e23bdc2a/info/c05ffd24a7764d569fb3d52f05cf380c, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 15:47:35,222 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e3c5d91272e1b244031c2145e23bdc2a in 40ms, sequenceid=6, compaction requested=false 2023-07-12 15:47:35,223 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3c5d91272e1b244031c2145e23bdc2a: 2023-07-12 15:47:35,223 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. 2023-07-12 15:47:35,223 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 15:47:35,223 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 15:47:35,223 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,223 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase:namespace' locally acquired 2023-07-12 15:47:35,223 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41803,1689176843393' joining acquired barrier for procedure (hbase:namespace) in zk 2023-07-12 15:47:35,225 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,225 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-12 15:47:35,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 15:47:35,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 15:47:35,226 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace 2023-07-12 15:47:35,226 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase:namespace' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 15:47:35,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 15:47:35,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 15:47:35,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-12 15:47:35,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 15:47:35,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,41803,1689176843393' joining acquired barrier for procedure 'hbase:namespace' on coordinator 2023-07-12 15:47:35,228 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase:namespace' starting 'in-barrier' execution. 2023-07-12 15:47:35,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72ddefac[Count = 0] remaining members to acquire global barrier 2023-07-12 15:47:35,228 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-12 15:47:35,232 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-07-12 15:47:35,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-12 15:47:35,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-12 15:47:35,232 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase:namespace' received 'reached' from coordinator. 2023-07-12 15:47:35,232 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase:namespace' locally completed 2023-07-12 15:47:35,232 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase:namespace' completed for member 'jenkins-hbase5.apache.org,41803,1689176843393' in zk 2023-07-12 15:47:35,232 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,232 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 15:47:35,234 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase:namespace' has notified controller of completion 2023-07-12 15:47:35,234 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,234 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 15:47:35,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,234 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase:namespace' completed. 2023-07-12 15:47:35,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 15:47:35,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 15:47:35,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 15:47:35,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 15:47:35,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-12 15:47:35,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 15:47:35,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-12 15:47:35,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase:namespace' member 'jenkins-hbase5.apache.org,41803,1689176843393': 2023-07-12 15:47:35,238 INFO [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase:namespace' execution completed 2023-07-12 15:47:35,238 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 15:47:35,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,41803,1689176843393' released barrier for procedure'hbase:namespace', counting down latch. Waiting for 0 more 2023-07-12 15:47:35,238 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 15:47:35,238 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase:namespace 2023-07-12 15:47:35,238 INFO [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase:namespaceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 15:47:35,240 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-07-12 15:47:35,240 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-07-12 15:47:35,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase:namespace 2023-07-12 15:47:35,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 15:47:35,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 15:47:35,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase:namespace 2023-07-12 15:47:35,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-07-12 15:47:35,240 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 15:47:35,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 15:47:35,241 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 15:47:35,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-12 15:47:35,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 15:47:35,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 15:47:35,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-07-12 15:47:35,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-12 15:47:35,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,243 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 15:47:35,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-12 15:47:35,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,249 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,249 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 15:47:35,249 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-12 15:47:35,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 15:47:35,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 15:47:35,249 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 15:47:35,250 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 15:47:35,249 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-12 15:47:35,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase:namespace' 2023-07-12 15:47:35,250 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:35,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 15:47:35,251 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-07-12 15:47:35,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 15:47:35,251 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-07-12 15:47:35,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 15:47:35,251 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-07-12 15:47:35,252 DEBUG [Listener at localhost/44763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase:namespace'' to complete. (max 20000 ms per retry) 2023-07-12 15:47:35,253 DEBUG [Listener at localhost/44763] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-12 15:47:45,253 DEBUG [Listener at localhost/44763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 15:47:45,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 15:47:45,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] master.MasterRpcServices(936): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-07-12 15:47:45,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,272 INFO [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-12 15:47:45,272 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 15:47:45,272 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-12 15:47:45,272 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-12 15:47:45,273 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,273 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,274 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 15:47:45,275 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 15:47:45,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 15:47:45,275 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,275 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 15:47:45,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 15:47:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,276 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,277 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-12 15:47:45,277 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 15:47:45,277 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-12 15:47:45,277 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 15:47:45,277 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 15:47:45,277 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:47:45,277 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. started... 2023-07-12 15:47:45,278 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 358e3eb8e44a2beb36ae03ca8028cbe3 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-12 15:47:45,295 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/.tmp/info/5b3b8290707946b8b8a0be934fb50a73 2023-07-12 15:47:45,308 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/.tmp/info/5b3b8290707946b8b8a0be934fb50a73 as hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/5b3b8290707946b8b8a0be934fb50a73 2023-07-12 15:47:45,315 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/5b3b8290707946b8b8a0be934fb50a73, entries=1, sequenceid=5, filesize=5.8 K 2023-07-12 15:47:45,316 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 358e3eb8e44a2beb36ae03ca8028cbe3 in 38ms, sequenceid=5, compaction requested=false 2023-07-12 15:47:45,317 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 358e3eb8e44a2beb36ae03ca8028cbe3: 2023-07-12 15:47:45,317 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:47:45,317 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 15:47:45,317 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 15:47:45,317 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,317 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-12 15:47:45,317 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41803,1689176843393' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-12 15:47:45,319 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,319 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 15:47:45,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 15:47:45,320 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,320 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 15:47:45,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 15:47:45,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 15:47:45,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 15:47:45,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,41803,1689176843393' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-12 15:47:45,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76e2652f[Count = 0] remaining members to acquire global barrier 2023-07-12 15:47:45,322 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-12 15:47:45,322 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,323 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,323 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-12 15:47:45,324 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,324 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 15:47:45,324 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-12 15:47:45,324 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase5.apache.org,41803,1689176843393' in zk 2023-07-12 15:47:45,328 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-12 15:47:45,328 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,328 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 15:47:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 15:47:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 15:47:45,328 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-12 15:47:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 15:47:45,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 15:47:45,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 15:47:45,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase5.apache.org,41803,1689176843393': 2023-07-12 15:47:45,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,41803,1689176843393' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-12 15:47:45,332 INFO [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-12 15:47:45,332 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 15:47:45,332 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 15:47:45,332 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,332 INFO [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 15:47:45,337 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,337 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,337 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 15:47:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 15:47:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 15:47:45,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 15:47:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 15:47:45,337 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 15:47:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 15:47:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,339 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 15:47:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,342 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 15:47:45,342 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 15:47:45,342 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,342 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 15:47:45,342 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,342 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 15:47:45,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-07-12 15:47:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 15:47:45,342 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:45,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-12 15:47:45,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 15:47:45,343 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,343 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,343 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:45,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 15:47:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 15:47:45,344 DEBUG [Listener at localhost/44763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-12 15:47:45,344 DEBUG [Listener at localhost/44763] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-12 15:47:55,344 DEBUG [Listener at localhost/44763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 15:47:55,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 15:47:55,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] master.MasterRpcServices(936): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-07-12 15:47:55,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-07-12 15:47:55,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,354 INFO [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-12 15:47:55,355 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 15:47:55,355 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-12 15:47:55,355 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-12 15:47:55,356 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,356 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,357 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,357 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 15:47:55,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 15:47:55,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 15:47:55,357 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,357 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 15:47:55,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 15:47:55,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,358 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,358 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-07-12 15:47:55,358 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,358 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-12 15:47:55,358 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 15:47:55,359 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-12 15:47:55,359 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 15:47:55,359 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 15:47:55,359 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:47:55,359 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. started... 2023-07-12 15:47:55,359 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 358e3eb8e44a2beb36ae03ca8028cbe3 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-12 15:47:55,372 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/.tmp/info/b1268ac22acf490ba2866615de93b342 2023-07-12 15:47:55,380 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/.tmp/info/b1268ac22acf490ba2866615de93b342 as hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/b1268ac22acf490ba2866615de93b342 2023-07-12 15:47:55,386 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/b1268ac22acf490ba2866615de93b342, entries=1, sequenceid=9, filesize=5.8 K 2023-07-12 15:47:55,387 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 358e3eb8e44a2beb36ae03ca8028cbe3 in 28ms, sequenceid=9, compaction requested=false 2023-07-12 15:47:55,387 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 358e3eb8e44a2beb36ae03ca8028cbe3: 2023-07-12 15:47:55,387 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:47:55,387 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 15:47:55,388 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 15:47:55,388 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,388 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-12 15:47:55,388 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41803,1689176843393' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-12 15:47:55,390 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,390 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 15:47:55,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 15:47:55,390 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,390 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 15:47:55,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 15:47:55,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 15:47:55,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 15:47:55,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,41803,1689176843393' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-12 15:47:55,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33e0e597[Count = 0] remaining members to acquire global barrier 2023-07-12 15:47:55,392 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-12 15:47:55,392 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,394 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,394 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-12 15:47:55,394 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-12 15:47:55,394 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase5.apache.org,41803,1689176843393' in zk 2023-07-12 15:47:55,394 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,394 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 15:47:55,397 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-12 15:47:55,397 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,397 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 15:47:55,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 15:47:55,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 15:47:55,397 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-12 15:47:55,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 15:47:55,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 15:47:55,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 15:47:55,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase5.apache.org,41803,1689176843393': 2023-07-12 15:47:55,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,41803,1689176843393' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-12 15:47:55,401 INFO [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-12 15:47:55,401 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 15:47:55,401 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 15:47:55,401 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,401 INFO [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 15:47:55,402 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,402 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 15:47:55,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 15:47:55,403 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 15:47:55,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 15:47:55,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 15:47:55,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 15:47:55,403 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 15:47:55,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,405 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 15:47:55,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,407 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,407 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,407 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 15:47:55,407 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 15:47:55,407 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:47:55,407 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 15:47:55,407 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 15:47:55,407 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-07-12 15:47:55,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-12 15:47:55,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 15:47:55,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 15:47:55,408 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,408 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:47:55,409 DEBUG [Listener at localhost/44763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-12 15:47:55,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 15:47:55,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 15:47:55,409 DEBUG [Listener at localhost/44763] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-12 15:48:05,409 DEBUG [Listener at localhost/44763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 15:48:05,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 15:48:05,430 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38561,DS-cc096cf7-4028-46d8-8627-81bb9c4751cf,DISK] 2023-07-12 15:48:05,430 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39361,DS-24a80e0e-894e-42d0-8277-c0e6ea9168ca,DISK] 2023-07-12 15:48:05,433 INFO [Listener at localhost/44763] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393/jenkins-hbase5.apache.org%2C41803%2C1689176843393.1689176844291 with entries=13, filesize=6.36 KB; new WAL /user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393/jenkins-hbase5.apache.org%2C41803%2C1689176843393.1689176885413 2023-07-12 15:48:05,433 DEBUG [Listener at localhost/44763] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38561,DS-cc096cf7-4028-46d8-8627-81bb9c4751cf,DISK], DatanodeInfoWithStorage[127.0.0.1:39361,DS-24a80e0e-894e-42d0-8277-c0e6ea9168ca,DISK]] 2023-07-12 15:48:05,434 DEBUG [Listener at localhost/44763] wal.AbstractFSWAL(716): hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393/jenkins-hbase5.apache.org%2C41803%2C1689176843393.1689176844291 is not closed yet, will try archiving it next time 2023-07-12 15:48:05,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] master.MasterRpcServices(936): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-07-12 15:48:05,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-07-12 15:48:05,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,442 INFO [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-12 15:48:05,442 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 15:48:05,442 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-12 15:48:05,442 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-12 15:48:05,443 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,443 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,444 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,444 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 15:48:05,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 15:48:05,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 15:48:05,445 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,445 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 15:48:05,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 15:48:05,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,446 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,446 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-07-12 15:48:05,446 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,446 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-12 15:48:05,446 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 15:48:05,446 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-12 15:48:05,447 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 15:48:05,447 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 15:48:05,447 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:48:05,447 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. started... 2023-07-12 15:48:05,447 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 358e3eb8e44a2beb36ae03ca8028cbe3 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-12 15:48:05,460 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=13 (bloomFilter=true), to=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/.tmp/info/191862b9f0a14c36ba9fc98462597181 2023-07-12 15:48:05,467 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/.tmp/info/191862b9f0a14c36ba9fc98462597181 as hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/191862b9f0a14c36ba9fc98462597181 2023-07-12 15:48:05,476 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/191862b9f0a14c36ba9fc98462597181, entries=1, sequenceid=13, filesize=5.8 K 2023-07-12 15:48:05,477 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 358e3eb8e44a2beb36ae03ca8028cbe3 in 30ms, sequenceid=13, compaction requested=true 2023-07-12 15:48:05,477 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 358e3eb8e44a2beb36ae03ca8028cbe3: 2023-07-12 15:48:05,477 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:48:05,477 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 15:48:05,478 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 15:48:05,478 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,478 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-12 15:48:05,478 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41803,1689176843393' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-12 15:48:05,479 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,479 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 15:48:05,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 15:48:05,480 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,480 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 15:48:05,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 15:48:05,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 15:48:05,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 15:48:05,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,41803,1689176843393' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-12 15:48:05,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fa47d42[Count = 0] remaining members to acquire global barrier 2023-07-12 15:48:05,482 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-12 15:48:05,482 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,483 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,483 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-12 15:48:05,483 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-12 15:48:05,483 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,483 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 15:48:05,483 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase5.apache.org,41803,1689176843393' in zk 2023-07-12 15:48:05,485 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,485 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-12 15:48:05,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 15:48:05,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 15:48:05,486 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 15:48:05,486 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-12 15:48:05,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 15:48:05,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 15:48:05,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 15:48:05,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase5.apache.org,41803,1689176843393': 2023-07-12 15:48:05,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,41803,1689176843393' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-12 15:48:05,489 INFO [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-12 15:48:05,489 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 15:48:05,489 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 15:48:05,489 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,490 INFO [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 15:48:05,491 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,491 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 15:48:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 15:48:05,491 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 15:48:05,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 15:48:05,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 15:48:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 15:48:05,492 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 15:48:05,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,494 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 15:48:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,497 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,498 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 15:48:05,498 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,498 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 15:48:05,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-12 15:48:05,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 15:48:05,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 15:48:05,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 15:48:05,498 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,498 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 15:48:05,498 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:05,499 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,499 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,499 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:05,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 15:48:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 15:48:05,499 DEBUG [Listener at localhost/44763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-12 15:48:05,499 DEBUG [Listener at localhost/44763] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-12 15:48:15,499 DEBUG [Listener at localhost/44763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 15:48:15,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 15:48:15,502 DEBUG [Listener at localhost/44763] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 15:48:15,508 DEBUG [Listener at localhost/44763] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 17694 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 15:48:15,510 DEBUG [Listener at localhost/44763] regionserver.HStore(1912): 358e3eb8e44a2beb36ae03ca8028cbe3/info is initiating minor compaction (all files) 2023-07-12 15:48:15,511 INFO [Listener at localhost/44763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 15:48:15,511 INFO [Listener at localhost/44763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:15,511 INFO [Listener at localhost/44763] regionserver.HRegion(2259): Starting compaction of 358e3eb8e44a2beb36ae03ca8028cbe3/info in TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:48:15,511 INFO [Listener at localhost/44763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/5b3b8290707946b8b8a0be934fb50a73, hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/b1268ac22acf490ba2866615de93b342, hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/191862b9f0a14c36ba9fc98462597181] into tmpdir=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/.tmp, totalSize=17.3 K 2023-07-12 15:48:15,513 DEBUG [Listener at localhost/44763] compactions.Compactor(207): Compacting 5b3b8290707946b8b8a0be934fb50a73, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689176865264 2023-07-12 15:48:15,513 DEBUG [Listener at localhost/44763] compactions.Compactor(207): Compacting b1268ac22acf490ba2866615de93b342, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689176875347 2023-07-12 15:48:15,514 DEBUG [Listener at localhost/44763] compactions.Compactor(207): Compacting 191862b9f0a14c36ba9fc98462597181, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689176885412 2023-07-12 15:48:15,538 INFO [Listener at localhost/44763] throttle.PressureAwareThroughputController(145): 358e3eb8e44a2beb36ae03ca8028cbe3#info#compaction#9 average throughput is 3.01 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 15:48:15,558 DEBUG [Listener at localhost/44763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/.tmp/info/7bf89f80c5e14270a5afff61444a32a0 as hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/7bf89f80c5e14270a5afff61444a32a0 2023-07-12 15:48:15,577 INFO [Listener at localhost/44763] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 358e3eb8e44a2beb36ae03ca8028cbe3/info of 358e3eb8e44a2beb36ae03ca8028cbe3 into 7bf89f80c5e14270a5afff61444a32a0(size=7.9 K), total size for store is 7.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 15:48:15,577 DEBUG [Listener at localhost/44763] regionserver.HRegion(2289): Compaction status journal for 358e3eb8e44a2beb36ae03ca8028cbe3: 2023-07-12 15:48:15,600 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38561,DS-cc096cf7-4028-46d8-8627-81bb9c4751cf,DISK] 2023-07-12 15:48:15,603 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39361,DS-24a80e0e-894e-42d0-8277-c0e6ea9168ca,DISK] 2023-07-12 15:48:15,611 INFO [Listener at localhost/44763] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393/jenkins-hbase5.apache.org%2C41803%2C1689176843393.1689176885413 with entries=4, filesize=2.43 KB; new WAL /user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393/jenkins-hbase5.apache.org%2C41803%2C1689176843393.1689176895579 2023-07-12 15:48:15,611 DEBUG [Listener at localhost/44763] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38561,DS-cc096cf7-4028-46d8-8627-81bb9c4751cf,DISK], DatanodeInfoWithStorage[127.0.0.1:39361,DS-24a80e0e-894e-42d0-8277-c0e6ea9168ca,DISK]] 2023-07-12 15:48:15,611 DEBUG [Listener at localhost/44763] wal.AbstractFSWAL(716): hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393/jenkins-hbase5.apache.org%2C41803%2C1689176843393.1689176885413 is not closed yet, will try archiving it next time 2023-07-12 15:48:15,612 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393/jenkins-hbase5.apache.org%2C41803%2C1689176843393.1689176844291 to hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/oldWALs/jenkins-hbase5.apache.org%2C41803%2C1689176843393.1689176844291 2023-07-12 15:48:15,617 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393/jenkins-hbase5.apache.org%2C41803%2C1689176843393.1689176885413 not finished, retry = 0 2023-07-12 15:48:15,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] master.MasterRpcServices(936): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-07-12 15:48:15,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-07-12 15:48:15,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:15,625 INFO [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-12 15:48:15,625 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 15:48:15,626 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-12 15:48:15,626 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-12 15:48:15,626 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:15,626 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:15,631 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 15:48:15,631 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:15,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 15:48:15,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 15:48:15,632 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:15,632 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 15:48:15,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:15,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:15,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-12 15:48:15,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:15,632 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:15,633 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-07-12 15:48:15,633 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:15,633 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-12 15:48:15,633 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-12 15:48:15,633 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-12 15:48:15,634 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-12 15:48:15,634 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-12 15:48:15,634 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:48:15,634 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. started... 2023-07-12 15:48:15,634 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 358e3eb8e44a2beb36ae03ca8028cbe3 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-12 15:48:16,069 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=18 (bloomFilter=true), to=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/.tmp/info/e4c17079d18f4c5d830ae90238106b0c 2023-07-12 15:48:16,077 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/.tmp/info/e4c17079d18f4c5d830ae90238106b0c as hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/e4c17079d18f4c5d830ae90238106b0c 2023-07-12 15:48:16,083 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/e4c17079d18f4c5d830ae90238106b0c, entries=1, sequenceid=18, filesize=5.8 K 2023-07-12 15:48:16,084 INFO [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 358e3eb8e44a2beb36ae03ca8028cbe3 in 450ms, sequenceid=18, compaction requested=false 2023-07-12 15:48:16,084 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 358e3eb8e44a2beb36ae03ca8028cbe3: 2023-07-12 15:48:16,084 DEBUG [rs(jenkins-hbase5.apache.org,41803,1689176843393)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:48:16,084 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-12 15:48:16,085 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-12 15:48:16,085 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:16,085 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-12 15:48:16,085 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41803,1689176843393' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-12 15:48:16,087 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:16,087 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:16,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 15:48:16,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 15:48:16,087 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,087 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 15:48:16,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 15:48:16,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 15:48:16,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:16,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 15:48:16,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,41803,1689176843393' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-12 15:48:16,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2995195[Count = 0] remaining members to acquire global barrier 2023-07-12 15:48:16,089 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-12 15:48:16,089 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,091 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,091 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-12 15:48:16,091 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-12 15:48:16,091 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase5.apache.org,41803,1689176843393' in zk 2023-07-12 15:48:16,091 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:16,091 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 15:48:16,092 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-12 15:48:16,092 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:16,092 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 15:48:16,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:16,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 15:48:16,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 15:48:16,093 DEBUG [member: 'jenkins-hbase5.apache.org,41803,1689176843393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-12 15:48:16,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 15:48:16,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 15:48:16,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:16,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 15:48:16,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:16,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase5.apache.org,41803,1689176843393': 2023-07-12 15:48:16,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,41803,1689176843393' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-12 15:48:16,095 INFO [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-12 15:48:16,096 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 15:48:16,096 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 15:48:16,096 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,096 INFO [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-12 15:48:16,097 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,097 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 15:48:16,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-12 15:48:16,097 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 15:48:16,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 15:48:16,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 15:48:16,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 15:48:16,098 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:16,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 15:48:16,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:16,099 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:16,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 15:48:16,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:16,101 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:16,101 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,102 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-12 15:48:16,102 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-12 15:48:16,102 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:16,102 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-12 15:48:16,102 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,102 DEBUG [(jenkins-hbase5.apache.org,38075,1689176843330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 15:48:16,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-07-12 15:48:16,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 15:48:16,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-12 15:48:16,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-12 15:48:16,102 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,103 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-12 15:48:16,103 DEBUG [Listener at localhost/44763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-12 15:48:16,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-12 15:48:16,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 15:48:16,103 DEBUG [Listener at localhost/44763] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-12 15:48:26,103 DEBUG [Listener at localhost/44763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-12 15:48:26,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38075] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-12 15:48:26,122 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39361,DS-24a80e0e-894e-42d0-8277-c0e6ea9168ca,DISK] 2023-07-12 15:48:26,122 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38561,DS-cc096cf7-4028-46d8-8627-81bb9c4751cf,DISK] 2023-07-12 15:48:26,124 INFO [Listener at localhost/44763] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393/jenkins-hbase5.apache.org%2C41803%2C1689176843393.1689176895579 with entries=3, filesize=1.94 KB; new WAL /user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393/jenkins-hbase5.apache.org%2C41803%2C1689176843393.1689176906107 2023-07-12 15:48:26,125 DEBUG [Listener at localhost/44763] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38561,DS-cc096cf7-4028-46d8-8627-81bb9c4751cf,DISK], DatanodeInfoWithStorage[127.0.0.1:39361,DS-24a80e0e-894e-42d0-8277-c0e6ea9168ca,DISK]] 2023-07-12 15:48:26,125 DEBUG [Listener at localhost/44763] wal.AbstractFSWAL(716): hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393/jenkins-hbase5.apache.org%2C41803%2C1689176843393.1689176895579 is not closed yet, will try archiving it next time 2023-07-12 15:48:26,125 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 15:48:26,125 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/WALs/jenkins-hbase5.apache.org,41803,1689176843393/jenkins-hbase5.apache.org%2C41803%2C1689176843393.1689176885413 to hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/oldWALs/jenkins-hbase5.apache.org%2C41803%2C1689176843393.1689176885413 2023-07-12 15:48:26,125 INFO [Listener at localhost/44763] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 15:48:26,126 DEBUG [Listener at localhost/44763] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12f71549 to 127.0.0.1:55003 2023-07-12 15:48:26,126 DEBUG [Listener at localhost/44763] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:48:26,127 DEBUG [Listener at localhost/44763] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 15:48:26,127 DEBUG [Listener at localhost/44763] util.JVMClusterUtil(257): Found active master hash=1799627828, stopped=false 2023-07-12 15:48:26,127 INFO [Listener at localhost/44763] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase5.apache.org,38075,1689176843330 2023-07-12 15:48:26,130 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 15:48:26,130 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 15:48:26,130 INFO [Listener at localhost/44763] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 15:48:26,130 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:48:26,130 DEBUG [Listener at localhost/44763] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3141a719 to 127.0.0.1:55003 2023-07-12 15:48:26,131 DEBUG [Listener at localhost/44763] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:48:26,131 INFO [Listener at localhost/44763] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,41803,1689176843393' ***** 2023-07-12 15:48:26,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:48:26,131 INFO [Listener at localhost/44763] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 15:48:26,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:48:26,131 INFO [RS:0;jenkins-hbase5:41803] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 15:48:26,131 INFO [RS:0;jenkins-hbase5:41803] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 15:48:26,131 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 15:48:26,131 INFO [RS:0;jenkins-hbase5:41803] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 15:48:26,132 INFO [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(3305): Received CLOSE for e3c5d91272e1b244031c2145e23bdc2a 2023-07-12 15:48:26,132 INFO [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(3305): Received CLOSE for 358e3eb8e44a2beb36ae03ca8028cbe3 2023-07-12 15:48:26,132 INFO [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:26,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing e3c5d91272e1b244031c2145e23bdc2a, disabling compactions & flushes 2023-07-12 15:48:26,132 DEBUG [RS:0;jenkins-hbase5:41803] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d64618b to 127.0.0.1:55003 2023-07-12 15:48:26,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. 2023-07-12 15:48:26,132 DEBUG [RS:0;jenkins-hbase5:41803] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:48:26,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. 2023-07-12 15:48:26,132 INFO [RS:0;jenkins-hbase5:41803] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 15:48:26,133 INFO [RS:0;jenkins-hbase5:41803] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 15:48:26,133 INFO [RS:0;jenkins-hbase5:41803] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 15:48:26,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. after waiting 0 ms 2023-07-12 15:48:26,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. 2023-07-12 15:48:26,133 INFO [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 15:48:26,133 INFO [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-12 15:48:26,133 DEBUG [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(1478): Online Regions={e3c5d91272e1b244031c2145e23bdc2a=hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a., 1588230740=hbase:meta,,1.1588230740, 358e3eb8e44a2beb36ae03ca8028cbe3=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3.} 2023-07-12 15:48:26,133 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 15:48:26,134 DEBUG [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(1504): Waiting on 1588230740, 358e3eb8e44a2beb36ae03ca8028cbe3, e3c5d91272e1b244031c2145e23bdc2a 2023-07-12 15:48:26,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 15:48:26,134 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 15:48:26,134 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 15:48:26,134 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 15:48:26,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=3.10 KB heapSize=5.61 KB 2023-07-12 15:48:26,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/namespace/e3c5d91272e1b244031c2145e23bdc2a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 15:48:26,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. 2023-07-12 15:48:26,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for e3c5d91272e1b244031c2145e23bdc2a: 2023-07-12 15:48:26,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689176844476.e3c5d91272e1b244031c2145e23bdc2a. 2023-07-12 15:48:26,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 358e3eb8e44a2beb36ae03ca8028cbe3, disabling compactions & flushes 2023-07-12 15:48:26,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:48:26,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:48:26,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. after waiting 0 ms 2023-07-12 15:48:26,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:48:26,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 358e3eb8e44a2beb36ae03ca8028cbe3 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-12 15:48:26,150 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.84 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/.tmp/info/91097d04eaff4c11bec28d44f7f60517 2023-07-12 15:48:26,166 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 15:48:26,168 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 15:48:26,169 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 15:48:26,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=22 (bloomFilter=true), to=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/.tmp/info/c0e892ccbdfd4425ab03c07397191d04 2023-07-12 15:48:26,185 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=264 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/.tmp/table/462bed3430d34c6a954f737f24bb6b4f 2023-07-12 15:48:26,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/.tmp/info/c0e892ccbdfd4425ab03c07397191d04 as hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/c0e892ccbdfd4425ab03c07397191d04 2023-07-12 15:48:26,192 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/.tmp/info/91097d04eaff4c11bec28d44f7f60517 as hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/info/91097d04eaff4c11bec28d44f7f60517 2023-07-12 15:48:26,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/c0e892ccbdfd4425ab03c07397191d04, entries=1, sequenceid=22, filesize=5.8 K 2023-07-12 15:48:26,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 358e3eb8e44a2beb36ae03ca8028cbe3 in 52ms, sequenceid=22, compaction requested=true 2023-07-12 15:48:26,199 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/5b3b8290707946b8b8a0be934fb50a73, hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/b1268ac22acf490ba2866615de93b342, hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/191862b9f0a14c36ba9fc98462597181] to archive 2023-07-12 15:48:26,200 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 15:48:26,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/info/91097d04eaff4c11bec28d44f7f60517, entries=20, sequenceid=14, filesize=7.6 K 2023-07-12 15:48:26,204 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/5b3b8290707946b8b8a0be934fb50a73 to hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/5b3b8290707946b8b8a0be934fb50a73 2023-07-12 15:48:26,204 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/.tmp/table/462bed3430d34c6a954f737f24bb6b4f as hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/table/462bed3430d34c6a954f737f24bb6b4f 2023-07-12 15:48:26,206 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/b1268ac22acf490ba2866615de93b342 to hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/b1268ac22acf490ba2866615de93b342 2023-07-12 15:48:26,208 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/191862b9f0a14c36ba9fc98462597181 to hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/info/191862b9f0a14c36ba9fc98462597181 2023-07-12 15:48:26,212 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/table/462bed3430d34c6a954f737f24bb6b4f, entries=4, sequenceid=14, filesize=4.9 K 2023-07-12 15:48:26,213 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.10 KB/3174, heapSize ~5.33 KB/5456, currentSize=0 B/0 for 1588230740 in 79ms, sequenceid=14, compaction requested=false 2023-07-12 15:48:26,232 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-07-12 15:48:26,233 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 15:48:26,234 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 15:48:26,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 15:48:26,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 15:48:26,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/358e3eb8e44a2beb36ae03ca8028cbe3/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=1 2023-07-12 15:48:26,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:48:26,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 358e3eb8e44a2beb36ae03ca8028cbe3: 2023-07-12 15:48:26,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689176845141.358e3eb8e44a2beb36ae03ca8028cbe3. 2023-07-12 15:48:26,334 INFO [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,41803,1689176843393; all regions closed. 2023-07-12 15:48:26,340 DEBUG [RS:0;jenkins-hbase5:41803] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/oldWALs 2023-07-12 15:48:26,340 INFO [RS:0;jenkins-hbase5:41803] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C41803%2C1689176843393.meta:.meta(num 1689176844403) 2023-07-12 15:48:26,347 DEBUG [RS:0;jenkins-hbase5:41803] wal.AbstractFSWAL(1028): Moved 2 WAL file(s) to /user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/oldWALs 2023-07-12 15:48:26,347 INFO [RS:0;jenkins-hbase5:41803] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C41803%2C1689176843393:(num 1689176906107) 2023-07-12 15:48:26,347 DEBUG [RS:0;jenkins-hbase5:41803] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:48:26,347 INFO [RS:0;jenkins-hbase5:41803] regionserver.LeaseManager(133): Closed leases 2023-07-12 15:48:26,348 INFO [RS:0;jenkins-hbase5:41803] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 15:48:26,348 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 15:48:26,349 INFO [RS:0;jenkins-hbase5:41803] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:41803 2023-07-12 15:48:26,351 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,41803,1689176843393 2023-07-12 15:48:26,351 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 15:48:26,351 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 15:48:26,352 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,41803,1689176843393] 2023-07-12 15:48:26,352 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,41803,1689176843393; numProcessing=1 2023-07-12 15:48:26,354 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,41803,1689176843393 already deleted, retry=false 2023-07-12 15:48:26,354 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,41803,1689176843393 expired; onlineServers=0 2023-07-12 15:48:26,354 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,38075,1689176843330' ***** 2023-07-12 15:48:26,354 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 15:48:26,354 DEBUG [M:0;jenkins-hbase5:38075] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f7bad84, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 15:48:26,355 INFO [M:0;jenkins-hbase5:38075] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,38075,1689176843330 2023-07-12 15:48:26,355 INFO [M:0;jenkins-hbase5:38075] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,38075,1689176843330; all regions closed. 2023-07-12 15:48:26,355 DEBUG [M:0;jenkins-hbase5:38075] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:48:26,355 DEBUG [M:0;jenkins-hbase5:38075] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 15:48:26,355 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 15:48:26,355 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689176844036] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689176844036,5,FailOnTimeoutGroup] 2023-07-12 15:48:26,355 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689176844036] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689176844036,5,FailOnTimeoutGroup] 2023-07-12 15:48:26,355 DEBUG [M:0;jenkins-hbase5:38075] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 15:48:26,356 INFO [M:0;jenkins-hbase5:38075] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 15:48:26,356 INFO [M:0;jenkins-hbase5:38075] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 15:48:26,356 INFO [M:0;jenkins-hbase5:38075] hbase.ChoreService(369): Chore service for: master/jenkins-hbase5:0 had [] on shutdown 2023-07-12 15:48:26,356 DEBUG [M:0;jenkins-hbase5:38075] master.HMaster(1512): Stopping service threads 2023-07-12 15:48:26,356 INFO [M:0;jenkins-hbase5:38075] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 15:48:26,357 ERROR [M:0;jenkins-hbase5:38075] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 15:48:26,357 INFO [M:0;jenkins-hbase5:38075] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 15:48:26,357 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 15:48:26,358 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 15:48:26,358 DEBUG [M:0;jenkins-hbase5:38075] zookeeper.ZKUtil(398): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 15:48:26,358 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:48:26,358 WARN [M:0;jenkins-hbase5:38075] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 15:48:26,358 INFO [M:0;jenkins-hbase5:38075] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 15:48:26,359 INFO [M:0;jenkins-hbase5:38075] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 15:48:26,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 15:48:26,359 DEBUG [M:0;jenkins-hbase5:38075] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 15:48:26,359 INFO [M:0;jenkins-hbase5:38075] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:48:26,359 DEBUG [M:0;jenkins-hbase5:38075] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:48:26,359 DEBUG [M:0;jenkins-hbase5:38075] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 15:48:26,359 DEBUG [M:0;jenkins-hbase5:38075] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:48:26,359 INFO [M:0;jenkins-hbase5:38075] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.90 KB heapSize=47.33 KB 2023-07-12 15:48:26,375 INFO [M:0;jenkins-hbase5:38075] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.90 KB at sequenceid=100 (bloomFilter=true), to=hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/eb6e2635f437454ebf2712c76a10e6d4 2023-07-12 15:48:26,381 INFO [M:0;jenkins-hbase5:38075] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb6e2635f437454ebf2712c76a10e6d4 2023-07-12 15:48:26,382 DEBUG [M:0;jenkins-hbase5:38075] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/eb6e2635f437454ebf2712c76a10e6d4 as hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/eb6e2635f437454ebf2712c76a10e6d4 2023-07-12 15:48:26,388 INFO [M:0;jenkins-hbase5:38075] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb6e2635f437454ebf2712c76a10e6d4 2023-07-12 15:48:26,388 INFO [M:0;jenkins-hbase5:38075] regionserver.HStore(1080): Added hdfs://localhost:46697/user/jenkins/test-data/c7cc8d45-6180-0bdd-9127-02326022566c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/eb6e2635f437454ebf2712c76a10e6d4, entries=11, sequenceid=100, filesize=6.1 K 2023-07-12 15:48:26,389 INFO [M:0;jenkins-hbase5:38075] regionserver.HRegion(2948): Finished flush of dataSize ~38.90 KB/39836, heapSize ~47.31 KB/48448, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 30ms, sequenceid=100, compaction requested=false 2023-07-12 15:48:26,390 INFO [M:0;jenkins-hbase5:38075] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:48:26,390 DEBUG [M:0;jenkins-hbase5:38075] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 15:48:26,393 INFO [M:0;jenkins-hbase5:38075] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 15:48:26,393 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 15:48:26,394 INFO [M:0;jenkins-hbase5:38075] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:38075 2023-07-12 15:48:26,396 DEBUG [M:0;jenkins-hbase5:38075] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase5.apache.org,38075,1689176843330 already deleted, retry=false 2023-07-12 15:48:26,453 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:48:26,453 INFO [RS:0;jenkins-hbase5:41803] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,41803,1689176843393; zookeeper connection closed. 2023-07-12 15:48:26,453 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): regionserver:41803-0x101c5d3ee390001, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:48:26,454 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@453925b4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@453925b4 2023-07-12 15:48:26,454 INFO [Listener at localhost/44763] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-12 15:48:26,554 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:48:26,554 INFO [M:0;jenkins-hbase5:38075] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,38075,1689176843330; zookeeper connection closed. 2023-07-12 15:48:26,554 DEBUG [Listener at localhost/44763-EventThread] zookeeper.ZKWatcher(600): master:38075-0x101c5d3ee390000, quorum=127.0.0.1:55003, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:48:26,555 WARN [Listener at localhost/44763] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 15:48:26,559 INFO [Listener at localhost/44763] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:48:26,663 WARN [BP-235371765-172.31.10.131-1689176842399 heartbeating to localhost/127.0.0.1:46697] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 15:48:26,663 WARN [BP-235371765-172.31.10.131-1689176842399 heartbeating to localhost/127.0.0.1:46697] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-235371765-172.31.10.131-1689176842399 (Datanode Uuid a26a6b05-6004-4340-8e98-db3eea5001a5) service to localhost/127.0.0.1:46697 2023-07-12 15:48:26,664 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/cluster_f33d7e71-ff46-de78-c7fd-c901653bfaf2/dfs/data/data3/current/BP-235371765-172.31.10.131-1689176842399] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:48:26,664 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/cluster_f33d7e71-ff46-de78-c7fd-c901653bfaf2/dfs/data/data4/current/BP-235371765-172.31.10.131-1689176842399] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:48:26,665 WARN [Listener at localhost/44763] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 15:48:26,674 INFO [Listener at localhost/44763] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:48:26,777 WARN [BP-235371765-172.31.10.131-1689176842399 heartbeating to localhost/127.0.0.1:46697] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 15:48:26,777 WARN [BP-235371765-172.31.10.131-1689176842399 heartbeating to localhost/127.0.0.1:46697] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-235371765-172.31.10.131-1689176842399 (Datanode Uuid cc46cd3c-b836-48b6-900a-fd3808851a2c) service to localhost/127.0.0.1:46697 2023-07-12 15:48:26,778 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/cluster_f33d7e71-ff46-de78-c7fd-c901653bfaf2/dfs/data/data1/current/BP-235371765-172.31.10.131-1689176842399] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:48:26,778 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/cluster_f33d7e71-ff46-de78-c7fd-c901653bfaf2/dfs/data/data2/current/BP-235371765-172.31.10.131-1689176842399] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:48:26,800 INFO [Listener at localhost/44763] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:48:26,915 INFO [Listener at localhost/44763] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 15:48:26,931 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-12 15:48:26,942 INFO [Listener at localhost/44763] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=63 (was 78), OpenFileDescriptor=431 (was 464), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=149 (was 199), ProcessCount=162 (was 161) - ProcessCount LEAK? -, AvailableMemoryMB=7620 (was 7997) 2023-07-12 15:48:26,951 INFO [Listener at localhost/44763] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=64, OpenFileDescriptor=431, MaxFileDescriptor=60000, SystemLoadAverage=149, ProcessCount=162, AvailableMemoryMB=7620 2023-07-12 15:48:26,951 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 15:48:26,952 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/hadoop.log.dir so I do NOT create it in target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828 2023-07-12 15:48:26,952 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2346ba08-ffd1-7cde-4e37-d10700712fde/hadoop.tmp.dir so I do NOT create it in target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828 2023-07-12 15:48:26,952 INFO [Listener at localhost/44763] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/cluster_1e77dd3a-96b1-d5b3-8229-2c34cc449cae, deleteOnExit=true 2023-07-12 15:48:26,952 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 15:48:26,952 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/test.cache.data in system properties and HBase conf 2023-07-12 15:48:26,952 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 15:48:26,952 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/hadoop.log.dir in system properties and HBase conf 2023-07-12 15:48:26,953 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 15:48:26,953 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 15:48:26,953 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 15:48:26,953 DEBUG [Listener at localhost/44763] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 15:48:26,953 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 15:48:26,953 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 15:48:26,953 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 15:48:26,953 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 15:48:26,954 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 15:48:26,954 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 15:48:26,954 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 15:48:26,954 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 15:48:26,954 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 15:48:26,954 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/nfs.dump.dir in system properties and HBase conf 2023-07-12 15:48:26,954 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/java.io.tmpdir in system properties and HBase conf 2023-07-12 15:48:26,954 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 15:48:26,954 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 15:48:26,954 INFO [Listener at localhost/44763] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 15:48:26,959 WARN [Listener at localhost/44763] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 15:48:26,959 WARN [Listener at localhost/44763] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 15:48:27,002 WARN [Listener at localhost/44763] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:48:27,004 INFO [Listener at localhost/44763] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:48:27,008 INFO [Listener at localhost/44763] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/java.io.tmpdir/Jetty_localhost_43989_hdfs____.ebf60r/webapp 2023-07-12 15:48:27,102 INFO [Listener at localhost/44763] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43989 2023-07-12 15:48:27,107 WARN [Listener at localhost/44763] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 15:48:27,107 WARN [Listener at localhost/44763] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 15:48:27,145 WARN [Listener at localhost/40381] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:48:27,160 WARN [Listener at localhost/40381] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 15:48:27,162 WARN [Listener at localhost/40381] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:48:27,164 INFO [Listener at localhost/40381] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:48:27,168 INFO [Listener at localhost/40381] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/java.io.tmpdir/Jetty_localhost_37385_datanode____.do0ryl/webapp 2023-07-12 15:48:27,272 INFO [Listener at localhost/40381] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37385 2023-07-12 15:48:27,279 WARN [Listener at localhost/34381] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:48:27,293 WARN [Listener at localhost/34381] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 15:48:27,297 WARN [Listener at localhost/34381] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:48:27,298 INFO [Listener at localhost/34381] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:48:27,303 INFO [Listener at localhost/34381] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/java.io.tmpdir/Jetty_localhost_34885_datanode____.5qkzqd/webapp 2023-07-12 15:48:27,400 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdeefe5dc35dd0abe: Processing first storage report for DS-af97e704-7f66-44a9-94cc-53977aa95f8c from datanode 34cdf8ff-ea7a-46da-92d4-0683002ad106 2023-07-12 15:48:27,400 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdeefe5dc35dd0abe: from storage DS-af97e704-7f66-44a9-94cc-53977aa95f8c node DatanodeRegistration(127.0.0.1:42341, datanodeUuid=34cdf8ff-ea7a-46da-92d4-0683002ad106, infoPort=35135, infoSecurePort=0, ipcPort=34381, storageInfo=lv=-57;cid=testClusterID;nsid=970734934;c=1689176906961), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:48:27,400 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdeefe5dc35dd0abe: Processing first storage report for DS-9f6766a8-2a87-4af2-9874-83b1f891ea5a from datanode 34cdf8ff-ea7a-46da-92d4-0683002ad106 2023-07-12 15:48:27,400 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdeefe5dc35dd0abe: from storage DS-9f6766a8-2a87-4af2-9874-83b1f891ea5a node DatanodeRegistration(127.0.0.1:42341, datanodeUuid=34cdf8ff-ea7a-46da-92d4-0683002ad106, infoPort=35135, infoSecurePort=0, ipcPort=34381, storageInfo=lv=-57;cid=testClusterID;nsid=970734934;c=1689176906961), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:48:27,416 INFO [Listener at localhost/34381] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34885 2023-07-12 15:48:27,424 WARN [Listener at localhost/37417] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:48:27,524 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6faa60bd50f206c: Processing first storage report for DS-14b66fe8-8e0c-4059-8f4c-808d864a480c from datanode 972917cc-2723-4c7a-a857-562376940e54 2023-07-12 15:48:27,524 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6faa60bd50f206c: from storage DS-14b66fe8-8e0c-4059-8f4c-808d864a480c node DatanodeRegistration(127.0.0.1:39425, datanodeUuid=972917cc-2723-4c7a-a857-562376940e54, infoPort=46753, infoSecurePort=0, ipcPort=37417, storageInfo=lv=-57;cid=testClusterID;nsid=970734934;c=1689176906961), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:48:27,525 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6faa60bd50f206c: Processing first storage report for DS-fea7324a-20c9-4e5f-b02a-82b956b93bcc from datanode 972917cc-2723-4c7a-a857-562376940e54 2023-07-12 15:48:27,525 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6faa60bd50f206c: from storage DS-fea7324a-20c9-4e5f-b02a-82b956b93bcc node DatanodeRegistration(127.0.0.1:39425, datanodeUuid=972917cc-2723-4c7a-a857-562376940e54, infoPort=46753, infoSecurePort=0, ipcPort=37417, storageInfo=lv=-57;cid=testClusterID;nsid=970734934;c=1689176906961), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:48:27,535 DEBUG [Listener at localhost/37417] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828 2023-07-12 15:48:27,539 INFO [Listener at localhost/37417] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/cluster_1e77dd3a-96b1-d5b3-8229-2c34cc449cae/zookeeper_0, clientPort=65082, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/cluster_1e77dd3a-96b1-d5b3-8229-2c34cc449cae/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/cluster_1e77dd3a-96b1-d5b3-8229-2c34cc449cae/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 15:48:27,540 INFO [Listener at localhost/37417] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=65082 2023-07-12 15:48:27,541 INFO [Listener at localhost/37417] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:48:27,541 INFO [Listener at localhost/37417] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:48:27,555 INFO [Listener at localhost/37417] util.FSUtils(471): Created version file at hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466 with version=8 2023-07-12 15:48:27,555 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/hbase-staging 2023-07-12 15:48:27,557 INFO [Listener at localhost/37417] client.ConnectionUtils(127): master/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 15:48:27,557 INFO [Listener at localhost/37417] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:48:27,557 INFO [Listener at localhost/37417] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 15:48:27,557 INFO [Listener at localhost/37417] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 15:48:27,557 INFO [Listener at localhost/37417] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:48:27,557 INFO [Listener at localhost/37417] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 15:48:27,557 INFO [Listener at localhost/37417] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 15:48:27,558 INFO [Listener at localhost/37417] ipc.NettyRpcServer(120): Bind to /172.31.10.131:33705 2023-07-12 15:48:27,559 INFO [Listener at localhost/37417] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:48:27,560 INFO [Listener at localhost/37417] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:48:27,561 INFO [Listener at localhost/37417] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33705 connecting to ZooKeeper ensemble=127.0.0.1:65082 2023-07-12 15:48:27,567 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:337050x0, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 15:48:27,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33705-0x101c5d4e96c0000 connected 2023-07-12 15:48:27,583 DEBUG [Listener at localhost/37417] zookeeper.ZKUtil(164): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 15:48:27,583 DEBUG [Listener at localhost/37417] zookeeper.ZKUtil(164): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:48:27,584 DEBUG [Listener at localhost/37417] zookeeper.ZKUtil(164): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 15:48:27,585 DEBUG [Listener at localhost/37417] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33705 2023-07-12 15:48:27,585 DEBUG [Listener at localhost/37417] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33705 2023-07-12 15:48:27,586 DEBUG [Listener at localhost/37417] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33705 2023-07-12 15:48:27,586 DEBUG [Listener at localhost/37417] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33705 2023-07-12 15:48:27,586 DEBUG [Listener at localhost/37417] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33705 2023-07-12 15:48:27,586 INFO [Listener at localhost/37417] master.HMaster(444): hbase.rootdir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466, hbase.cluster.distributed=false 2023-07-12 15:48:27,599 INFO [Listener at localhost/37417] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 15:48:27,600 INFO [Listener at localhost/37417] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:48:27,600 INFO [Listener at localhost/37417] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 15:48:27,600 INFO [Listener at localhost/37417] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 15:48:27,600 INFO [Listener at localhost/37417] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:48:27,600 INFO [Listener at localhost/37417] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 15:48:27,600 INFO [Listener at localhost/37417] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 15:48:27,601 INFO [Listener at localhost/37417] ipc.NettyRpcServer(120): Bind to /172.31.10.131:44531 2023-07-12 15:48:27,601 INFO [Listener at localhost/37417] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 15:48:27,602 DEBUG [Listener at localhost/37417] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 15:48:27,603 INFO [Listener at localhost/37417] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:48:27,604 INFO [Listener at localhost/37417] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:48:27,605 INFO [Listener at localhost/37417] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44531 connecting to ZooKeeper ensemble=127.0.0.1:65082 2023-07-12 15:48:27,607 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): regionserver:445310x0, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 15:48:27,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44531-0x101c5d4e96c0001 connected 2023-07-12 15:48:27,609 DEBUG [Listener at localhost/37417] zookeeper.ZKUtil(164): regionserver:44531-0x101c5d4e96c0001, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 15:48:27,609 DEBUG [Listener at localhost/37417] zookeeper.ZKUtil(164): regionserver:44531-0x101c5d4e96c0001, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:48:27,610 DEBUG [Listener at localhost/37417] zookeeper.ZKUtil(164): regionserver:44531-0x101c5d4e96c0001, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 15:48:27,610 DEBUG [Listener at localhost/37417] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44531 2023-07-12 15:48:27,610 DEBUG [Listener at localhost/37417] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44531 2023-07-12 15:48:27,611 DEBUG [Listener at localhost/37417] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44531 2023-07-12 15:48:27,611 DEBUG [Listener at localhost/37417] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44531 2023-07-12 15:48:27,611 DEBUG [Listener at localhost/37417] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44531 2023-07-12 15:48:27,612 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase5.apache.org,33705,1689176907556 2023-07-12 15:48:27,613 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 15:48:27,614 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase5.apache.org,33705,1689176907556 2023-07-12 15:48:27,616 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 15:48:27,616 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): regionserver:44531-0x101c5d4e96c0001, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 15:48:27,616 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:48:27,616 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 15:48:27,617 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 15:48:27,617 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase5.apache.org,33705,1689176907556 from backup master directory 2023-07-12 15:48:27,619 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase5.apache.org,33705,1689176907556 2023-07-12 15:48:27,619 WARN [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 15:48:27,619 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 15:48:27,619 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase5.apache.org,33705,1689176907556 2023-07-12 15:48:27,635 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/hbase.id with ID: 95f335da-2e7b-4878-bd7e-ecf0b47f63c5 2023-07-12 15:48:27,648 INFO [master/jenkins-hbase5:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:48:27,651 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:48:27,660 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x19a11e29 to 127.0.0.1:65082 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 15:48:27,664 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@89d47b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 15:48:27,664 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 15:48:27,664 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 15:48:27,665 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 15:48:27,667 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/MasterData/data/master/store-tmp 2023-07-12 15:48:27,683 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:48:27,683 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 15:48:27,683 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:48:27,683 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:48:27,683 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 15:48:27,683 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:48:27,683 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:48:27,683 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 15:48:27,684 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/MasterData/WALs/jenkins-hbase5.apache.org,33705,1689176907556 2023-07-12 15:48:27,688 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C33705%2C1689176907556, suffix=, logDir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/MasterData/WALs/jenkins-hbase5.apache.org,33705,1689176907556, archiveDir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/MasterData/oldWALs, maxLogs=10 2023-07-12 15:48:27,708 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39425,DS-14b66fe8-8e0c-4059-8f4c-808d864a480c,DISK] 2023-07-12 15:48:27,711 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42341,DS-af97e704-7f66-44a9-94cc-53977aa95f8c,DISK] 2023-07-12 15:48:27,715 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/MasterData/WALs/jenkins-hbase5.apache.org,33705,1689176907556/jenkins-hbase5.apache.org%2C33705%2C1689176907556.1689176907688 2023-07-12 15:48:27,719 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39425,DS-14b66fe8-8e0c-4059-8f4c-808d864a480c,DISK], DatanodeInfoWithStorage[127.0.0.1:42341,DS-af97e704-7f66-44a9-94cc-53977aa95f8c,DISK]] 2023-07-12 15:48:27,719 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 15:48:27,720 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:48:27,720 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:48:27,720 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:48:27,724 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:48:27,728 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 15:48:27,728 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 15:48:27,729 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:48:27,730 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:48:27,731 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:48:27,735 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:48:27,738 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 15:48:27,738 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=848253, jitterRate=0.07860995829105377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 15:48:27,738 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 15:48:27,740 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 15:48:27,742 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 15:48:27,742 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 15:48:27,742 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 15:48:27,743 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 15:48:27,743 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-07-12 15:48:27,743 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 15:48:27,744 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 15:48:27,745 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 15:48:27,756 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 15:48:27,757 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 15:48:27,757 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 15:48:27,757 INFO [master/jenkins-hbase5:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 15:48:27,758 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 15:48:27,761 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:48:27,762 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 15:48:27,762 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 15:48:27,763 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 15:48:27,764 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 15:48:27,764 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): regionserver:44531-0x101c5d4e96c0001, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 15:48:27,764 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:48:27,766 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase5.apache.org,33705,1689176907556, sessionid=0x101c5d4e96c0000, setting cluster-up flag (Was=false) 2023-07-12 15:48:27,769 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:48:27,773 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 15:48:27,774 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,33705,1689176907556 2023-07-12 15:48:27,778 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:48:27,781 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 15:48:27,782 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,33705,1689176907556 2023-07-12 15:48:27,783 WARN [master/jenkins-hbase5:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/.hbase-snapshot/.tmp 2023-07-12 15:48:27,785 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 15:48:27,786 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:48:27,786 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:48:27,786 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:48:27,786 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:48:27,786 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase5:0, corePoolSize=10, maxPoolSize=10 2023-07-12 15:48:27,786 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:48:27,786 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 15:48:27,786 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:48:27,787 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689176937787 2023-07-12 15:48:27,788 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 15:48:27,788 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 15:48:27,788 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 15:48:27,788 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 15:48:27,788 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 15:48:27,788 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 15:48:27,791 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:27,791 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 15:48:27,791 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 15:48:27,792 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 15:48:27,792 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 15:48:27,792 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 15:48:27,793 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 15:48:27,793 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 15:48:27,793 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689176907793,5,FailOnTimeoutGroup] 2023-07-12 15:48:27,794 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 15:48:27,795 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689176907793,5,FailOnTimeoutGroup] 2023-07-12 15:48:27,795 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:27,795 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 15:48:27,795 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:27,795 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:27,813 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 15:48:27,815 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 15:48:27,815 INFO [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(951): ClusterId : 95f335da-2e7b-4878-bd7e-ecf0b47f63c5 2023-07-12 15:48:27,815 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466 2023-07-12 15:48:27,816 DEBUG [RS:0;jenkins-hbase5:44531] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 15:48:27,819 DEBUG [RS:0;jenkins-hbase5:44531] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 15:48:27,819 DEBUG [RS:0;jenkins-hbase5:44531] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 15:48:27,821 DEBUG [RS:0;jenkins-hbase5:44531] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 15:48:27,824 DEBUG [RS:0;jenkins-hbase5:44531] zookeeper.ReadOnlyZKClient(139): Connect 0x28d696de to 127.0.0.1:65082 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 15:48:27,831 DEBUG [RS:0;jenkins-hbase5:44531] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26116db4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 15:48:27,832 DEBUG [RS:0;jenkins-hbase5:44531] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@222efdae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 15:48:27,837 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:48:27,839 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 15:48:27,841 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/info 2023-07-12 15:48:27,841 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 15:48:27,842 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:48:27,842 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 15:48:27,843 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/rep_barrier 2023-07-12 15:48:27,844 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 15:48:27,844 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:48:27,844 DEBUG [RS:0;jenkins-hbase5:44531] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase5:44531 2023-07-12 15:48:27,845 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 15:48:27,845 INFO [RS:0;jenkins-hbase5:44531] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 15:48:27,845 INFO [RS:0;jenkins-hbase5:44531] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 15:48:27,845 DEBUG [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 15:48:27,846 INFO [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,33705,1689176907556 with isa=jenkins-hbase5.apache.org/172.31.10.131:44531, startcode=1689176907599 2023-07-12 15:48:27,846 DEBUG [RS:0;jenkins-hbase5:44531] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 15:48:27,846 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/table 2023-07-12 15:48:27,847 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 15:48:27,848 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:48:27,849 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740 2023-07-12 15:48:27,849 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:45833, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 15:48:27,850 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740 2023-07-12 15:48:27,851 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33705] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:27,851 DEBUG [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466 2023-07-12 15:48:27,851 DEBUG [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40381 2023-07-12 15:48:27,851 DEBUG [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 15:48:27,853 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 15:48:27,853 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-12 15:48:27,854 DEBUG [RS:0;jenkins-hbase5:44531] zookeeper.ZKUtil(162): regionserver:44531-0x101c5d4e96c0001, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:27,854 WARN [RS:0;jenkins-hbase5:44531] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 15:48:27,854 INFO [RS:0;jenkins-hbase5:44531] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 15:48:27,854 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,44531,1689176907599] 2023-07-12 15:48:27,854 DEBUG [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:27,855 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 15:48:27,861 DEBUG [RS:0;jenkins-hbase5:44531] zookeeper.ZKUtil(162): regionserver:44531-0x101c5d4e96c0001, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:27,861 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 15:48:27,861 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=749461, jitterRate=-0.047011807560920715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-12 15:48:27,862 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 15:48:27,862 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 15:48:27,862 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 15:48:27,862 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 15:48:27,862 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 15:48:27,862 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 15:48:27,862 DEBUG [RS:0;jenkins-hbase5:44531] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 15:48:27,862 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 15:48:27,862 INFO [RS:0;jenkins-hbase5:44531] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 15:48:27,862 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 15:48:27,863 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 15:48:27,863 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 15:48:27,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 15:48:27,868 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 15:48:27,868 INFO [RS:0;jenkins-hbase5:44531] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 15:48:27,868 INFO [RS:0;jenkins-hbase5:44531] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 15:48:27,869 INFO [RS:0;jenkins-hbase5:44531] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:27,869 INFO [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 15:48:27,869 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 15:48:27,870 INFO [RS:0;jenkins-hbase5:44531] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:27,870 DEBUG [RS:0;jenkins-hbase5:44531] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:48:27,870 DEBUG [RS:0;jenkins-hbase5:44531] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:48:27,870 DEBUG [RS:0;jenkins-hbase5:44531] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:48:27,870 DEBUG [RS:0;jenkins-hbase5:44531] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:48:27,870 DEBUG [RS:0;jenkins-hbase5:44531] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:48:27,870 DEBUG [RS:0;jenkins-hbase5:44531] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 15:48:27,871 DEBUG [RS:0;jenkins-hbase5:44531] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:48:27,871 DEBUG [RS:0;jenkins-hbase5:44531] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:48:27,871 DEBUG [RS:0;jenkins-hbase5:44531] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:48:27,871 DEBUG [RS:0;jenkins-hbase5:44531] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:48:27,871 INFO [RS:0;jenkins-hbase5:44531] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:27,871 INFO [RS:0;jenkins-hbase5:44531] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:27,872 INFO [RS:0;jenkins-hbase5:44531] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:27,886 INFO [RS:0;jenkins-hbase5:44531] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 15:48:27,886 INFO [RS:0;jenkins-hbase5:44531] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,44531,1689176907599-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:27,899 INFO [RS:0;jenkins-hbase5:44531] regionserver.Replication(203): jenkins-hbase5.apache.org,44531,1689176907599 started 2023-07-12 15:48:27,899 INFO [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,44531,1689176907599, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:44531, sessionid=0x101c5d4e96c0001 2023-07-12 15:48:27,899 DEBUG [RS:0;jenkins-hbase5:44531] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 15:48:27,899 DEBUG [RS:0;jenkins-hbase5:44531] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:27,899 DEBUG [RS:0;jenkins-hbase5:44531] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,44531,1689176907599' 2023-07-12 15:48:27,899 DEBUG [RS:0;jenkins-hbase5:44531] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 15:48:27,900 DEBUG [RS:0;jenkins-hbase5:44531] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 15:48:27,900 DEBUG [RS:0;jenkins-hbase5:44531] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 15:48:27,900 DEBUG [RS:0;jenkins-hbase5:44531] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 15:48:27,900 DEBUG [RS:0;jenkins-hbase5:44531] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:27,900 DEBUG [RS:0;jenkins-hbase5:44531] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,44531,1689176907599' 2023-07-12 15:48:27,900 DEBUG [RS:0;jenkins-hbase5:44531] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 15:48:27,900 DEBUG [RS:0;jenkins-hbase5:44531] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 15:48:27,901 DEBUG [RS:0;jenkins-hbase5:44531] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 15:48:27,901 INFO [RS:0;jenkins-hbase5:44531] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 15:48:27,901 INFO [RS:0;jenkins-hbase5:44531] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 15:48:28,003 INFO [RS:0;jenkins-hbase5:44531] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C44531%2C1689176907599, suffix=, logDir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599, archiveDir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/oldWALs, maxLogs=32 2023-07-12 15:48:28,020 DEBUG [jenkins-hbase5:33705] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-12 15:48:28,020 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42341,DS-af97e704-7f66-44a9-94cc-53977aa95f8c,DISK] 2023-07-12 15:48:28,020 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39425,DS-14b66fe8-8e0c-4059-8f4c-808d864a480c,DISK] 2023-07-12 15:48:28,020 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,44531,1689176907599, state=OPENING 2023-07-12 15:48:28,023 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 15:48:28,023 INFO [RS:0;jenkins-hbase5:44531] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599/jenkins-hbase5.apache.org%2C44531%2C1689176907599.1689176908004 2023-07-12 15:48:28,024 DEBUG [RS:0;jenkins-hbase5:44531] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39425,DS-14b66fe8-8e0c-4059-8f4c-808d864a480c,DISK], DatanodeInfoWithStorage[127.0.0.1:42341,DS-af97e704-7f66-44a9-94cc-53977aa95f8c,DISK]] 2023-07-12 15:48:28,024 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:48:28,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,44531,1689176907599}] 2023-07-12 15:48:28,025 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 15:48:28,178 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:28,179 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 15:48:28,181 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:42582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 15:48:28,185 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 15:48:28,185 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 15:48:28,187 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C44531%2C1689176907599.meta, suffix=.meta, logDir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599, archiveDir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/oldWALs, maxLogs=32 2023-07-12 15:48:28,203 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42341,DS-af97e704-7f66-44a9-94cc-53977aa95f8c,DISK] 2023-07-12 15:48:28,203 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39425,DS-14b66fe8-8e0c-4059-8f4c-808d864a480c,DISK] 2023-07-12 15:48:28,205 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599/jenkins-hbase5.apache.org%2C44531%2C1689176907599.meta.1689176908188.meta 2023-07-12 15:48:28,206 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42341,DS-af97e704-7f66-44a9-94cc-53977aa95f8c,DISK], DatanodeInfoWithStorage[127.0.0.1:39425,DS-14b66fe8-8e0c-4059-8f4c-808d864a480c,DISK]] 2023-07-12 15:48:28,206 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 15:48:28,206 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 15:48:28,206 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 15:48:28,207 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 15:48:28,207 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 15:48:28,207 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:48:28,207 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 15:48:28,207 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 15:48:28,208 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 15:48:28,209 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/info 2023-07-12 15:48:28,209 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/info 2023-07-12 15:48:28,210 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 15:48:28,211 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:48:28,211 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 15:48:28,212 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/rep_barrier 2023-07-12 15:48:28,212 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/rep_barrier 2023-07-12 15:48:28,212 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 15:48:28,213 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:48:28,213 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 15:48:28,214 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/table 2023-07-12 15:48:28,214 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/table 2023-07-12 15:48:28,214 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 15:48:28,215 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:48:28,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740 2023-07-12 15:48:28,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740 2023-07-12 15:48:28,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-12 15:48:28,220 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 15:48:28,221 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=873485, jitterRate=0.11069421470165253}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-12 15:48:28,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 15:48:28,222 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689176908178 2023-07-12 15:48:28,225 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 15:48:28,226 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 15:48:28,226 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,44531,1689176907599, state=OPEN 2023-07-12 15:48:28,228 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 15:48:28,228 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 15:48:28,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 15:48:28,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,44531,1689176907599 in 203 msec 2023-07-12 15:48:28,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 15:48:28,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 366 msec 2023-07-12 15:48:28,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 449 msec 2023-07-12 15:48:28,235 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689176908235, completionTime=-1 2023-07-12 15:48:28,235 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-12 15:48:28,235 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 15:48:28,237 DEBUG [hconnection-0x69eb103d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 15:48:28,239 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:42588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 15:48:28,240 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-12 15:48:28,240 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689176968240 2023-07-12 15:48:28,240 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689177028240 2023-07-12 15:48:28,240 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-07-12 15:48:28,246 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,33705,1689176907556-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:28,246 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,33705,1689176907556-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:28,246 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,33705,1689176907556-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:28,246 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase5:33705, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:28,246 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 15:48:28,246 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 15:48:28,246 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 15:48:28,247 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 15:48:28,247 DEBUG [master/jenkins-hbase5:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 15:48:28,249 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 15:48:28,249 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 15:48:28,251 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/.tmp/data/hbase/namespace/ecf9cf3b4dd87dee1be11b036411ba1d 2023-07-12 15:48:28,252 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/.tmp/data/hbase/namespace/ecf9cf3b4dd87dee1be11b036411ba1d empty. 2023-07-12 15:48:28,252 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/.tmp/data/hbase/namespace/ecf9cf3b4dd87dee1be11b036411ba1d 2023-07-12 15:48:28,252 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 15:48:28,263 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 15:48:28,265 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => ecf9cf3b4dd87dee1be11b036411ba1d, NAME => 'hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/.tmp 2023-07-12 15:48:28,274 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:48:28,274 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing ecf9cf3b4dd87dee1be11b036411ba1d, disabling compactions & flushes 2023-07-12 15:48:28,274 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d. 2023-07-12 15:48:28,274 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d. 2023-07-12 15:48:28,274 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d. after waiting 0 ms 2023-07-12 15:48:28,274 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d. 2023-07-12 15:48:28,274 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d. 2023-07-12 15:48:28,274 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for ecf9cf3b4dd87dee1be11b036411ba1d: 2023-07-12 15:48:28,277 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 15:48:28,278 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689176908278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689176908278"}]},"ts":"1689176908278"} 2023-07-12 15:48:28,281 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 15:48:28,282 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 15:48:28,282 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689176908282"}]},"ts":"1689176908282"} 2023-07-12 15:48:28,283 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 15:48:28,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ecf9cf3b4dd87dee1be11b036411ba1d, ASSIGN}] 2023-07-12 15:48:28,290 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ecf9cf3b4dd87dee1be11b036411ba1d, ASSIGN 2023-07-12 15:48:28,291 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ecf9cf3b4dd87dee1be11b036411ba1d, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44531,1689176907599; forceNewPlan=false, retain=false 2023-07-12 15:48:28,442 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ecf9cf3b4dd87dee1be11b036411ba1d, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:28,443 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689176908442"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689176908442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689176908442"}]},"ts":"1689176908442"} 2023-07-12 15:48:28,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ecf9cf3b4dd87dee1be11b036411ba1d, server=jenkins-hbase5.apache.org,44531,1689176907599}] 2023-07-12 15:48:28,602 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d. 2023-07-12 15:48:28,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ecf9cf3b4dd87dee1be11b036411ba1d, NAME => 'hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d.', STARTKEY => '', ENDKEY => ''} 2023-07-12 15:48:28,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ecf9cf3b4dd87dee1be11b036411ba1d 2023-07-12 15:48:28,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:48:28,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for ecf9cf3b4dd87dee1be11b036411ba1d 2023-07-12 15:48:28,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for ecf9cf3b4dd87dee1be11b036411ba1d 2023-07-12 15:48:28,604 INFO [StoreOpener-ecf9cf3b4dd87dee1be11b036411ba1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ecf9cf3b4dd87dee1be11b036411ba1d 2023-07-12 15:48:28,606 DEBUG [StoreOpener-ecf9cf3b4dd87dee1be11b036411ba1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/namespace/ecf9cf3b4dd87dee1be11b036411ba1d/info 2023-07-12 15:48:28,606 DEBUG [StoreOpener-ecf9cf3b4dd87dee1be11b036411ba1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/namespace/ecf9cf3b4dd87dee1be11b036411ba1d/info 2023-07-12 15:48:28,606 INFO [StoreOpener-ecf9cf3b4dd87dee1be11b036411ba1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecf9cf3b4dd87dee1be11b036411ba1d columnFamilyName info 2023-07-12 15:48:28,607 INFO [StoreOpener-ecf9cf3b4dd87dee1be11b036411ba1d-1] regionserver.HStore(310): Store=ecf9cf3b4dd87dee1be11b036411ba1d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:48:28,608 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/namespace/ecf9cf3b4dd87dee1be11b036411ba1d 2023-07-12 15:48:28,610 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/namespace/ecf9cf3b4dd87dee1be11b036411ba1d 2023-07-12 15:48:28,613 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for ecf9cf3b4dd87dee1be11b036411ba1d 2023-07-12 15:48:28,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/namespace/ecf9cf3b4dd87dee1be11b036411ba1d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 15:48:28,616 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened ecf9cf3b4dd87dee1be11b036411ba1d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=799094, jitterRate=0.01610124111175537}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 15:48:28,616 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for ecf9cf3b4dd87dee1be11b036411ba1d: 2023-07-12 15:48:28,617 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d., pid=6, masterSystemTime=1689176908598 2023-07-12 15:48:28,619 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d. 2023-07-12 15:48:28,619 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d. 2023-07-12 15:48:28,620 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ecf9cf3b4dd87dee1be11b036411ba1d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:28,620 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689176908620"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689176908620"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689176908620"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689176908620"}]},"ts":"1689176908620"} 2023-07-12 15:48:28,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 15:48:28,625 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ecf9cf3b4dd87dee1be11b036411ba1d, server=jenkins-hbase5.apache.org,44531,1689176907599 in 177 msec 2023-07-12 15:48:28,627 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 15:48:28,628 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ecf9cf3b4dd87dee1be11b036411ba1d, ASSIGN in 336 msec 2023-07-12 15:48:28,628 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 15:48:28,629 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689176908628"}]},"ts":"1689176908628"} 2023-07-12 15:48:28,630 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 15:48:28,633 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 15:48:28,635 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 388 msec 2023-07-12 15:48:28,648 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 15:48:28,649 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 15:48:28,650 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:48:28,654 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 15:48:28,663 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 15:48:28,666 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-07-12 15:48:28,677 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 15:48:28,686 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 15:48:28,689 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-07-12 15:48:28,702 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 15:48:28,705 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 15:48:28,705 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.086sec 2023-07-12 15:48:28,706 INFO [master/jenkins-hbase5:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 15:48:28,706 INFO [master/jenkins-hbase5:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 15:48:28,706 INFO [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 15:48:28,706 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,33705,1689176907556-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 15:48:28,706 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,33705,1689176907556-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 15:48:28,708 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 15:48:28,715 DEBUG [Listener at localhost/37417] zookeeper.ReadOnlyZKClient(139): Connect 0x6b1d42c4 to 127.0.0.1:65082 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 15:48:28,719 DEBUG [Listener at localhost/37417] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24d15b16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 15:48:28,721 DEBUG [hconnection-0x5a0397d8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 15:48:28,723 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:42592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 15:48:28,724 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase5.apache.org,33705,1689176907556 2023-07-12 15:48:28,725 INFO [Listener at localhost/37417] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:48:28,729 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-12 15:48:28,729 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:48:28,729 INFO [Listener at localhost/37417] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-12 15:48:28,731 DEBUG [Listener at localhost/37417] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 15:48:28,734 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:46004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 15:48:28,735 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33705] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-07-12 15:48:28,735 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33705] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-07-12 15:48:28,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33705] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 15:48:28,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33705] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRolling 2023-07-12 15:48:28,738 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 15:48:28,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33705] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRolling" procId is: 9 2023-07-12 15:48:28,739 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 15:48:28,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33705] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 15:48:28,741 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/.tmp/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:28,742 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/.tmp/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3 empty. 2023-07-12 15:48:28,742 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/.tmp/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:28,742 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRolling regions 2023-07-12 15:48:28,754 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/.tmp/data/default/TestLogRolling-testLogRolling/.tabledesc/.tableinfo.0000000001 2023-07-12 15:48:28,755 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => 580433e5301d9299b394874c7507a2b3, NAME => 'TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/.tmp 2023-07-12 15:48:28,765 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:48:28,765 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1604): Closing 580433e5301d9299b394874c7507a2b3, disabling compactions & flushes 2023-07-12 15:48:28,765 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. 2023-07-12 15:48:28,765 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. 2023-07-12 15:48:28,765 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. after waiting 0 ms 2023-07-12 15:48:28,765 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. 2023-07-12 15:48:28,765 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. 2023-07-12 15:48:28,765 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1558): Region close journal for 580433e5301d9299b394874c7507a2b3: 2023-07-12 15:48:28,768 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 15:48:28,769 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689176908769"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689176908769"}]},"ts":"1689176908769"} 2023-07-12 15:48:28,771 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 15:48:28,772 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 15:48:28,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689176908772"}]},"ts":"1689176908772"} 2023-07-12 15:48:28,773 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLING in hbase:meta 2023-07-12 15:48:28,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=580433e5301d9299b394874c7507a2b3, ASSIGN}] 2023-07-12 15:48:28,778 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=580433e5301d9299b394874c7507a2b3, ASSIGN 2023-07-12 15:48:28,779 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=580433e5301d9299b394874c7507a2b3, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44531,1689176907599; forceNewPlan=false, retain=false 2023-07-12 15:48:28,930 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=580433e5301d9299b394874c7507a2b3, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:28,930 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689176908930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689176908930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689176908930"}]},"ts":"1689176908930"} 2023-07-12 15:48:28,933 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 580433e5301d9299b394874c7507a2b3, server=jenkins-hbase5.apache.org,44531,1689176907599}] 2023-07-12 15:48:29,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. 2023-07-12 15:48:29,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 580433e5301d9299b394874c7507a2b3, NAME => 'TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.', STARTKEY => '', ENDKEY => ''} 2023-07-12 15:48:29,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:29,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:48:29,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:29,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:29,092 INFO [StoreOpener-580433e5301d9299b394874c7507a2b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:29,094 DEBUG [StoreOpener-580433e5301d9299b394874c7507a2b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info 2023-07-12 15:48:29,094 DEBUG [StoreOpener-580433e5301d9299b394874c7507a2b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info 2023-07-12 15:48:29,094 INFO [StoreOpener-580433e5301d9299b394874c7507a2b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 580433e5301d9299b394874c7507a2b3 columnFamilyName info 2023-07-12 15:48:29,095 INFO [StoreOpener-580433e5301d9299b394874c7507a2b3-1] regionserver.HStore(310): Store=580433e5301d9299b394874c7507a2b3/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:48:29,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:29,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:29,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:29,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 15:48:29,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 580433e5301d9299b394874c7507a2b3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=869921, jitterRate=0.10616223514080048}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 15:48:29,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 580433e5301d9299b394874c7507a2b3: 2023-07-12 15:48:29,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3., pid=11, masterSystemTime=1689176909086 2023-07-12 15:48:29,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. 2023-07-12 15:48:29,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. 2023-07-12 15:48:29,105 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=580433e5301d9299b394874c7507a2b3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:29,105 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689176909105"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689176909105"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689176909105"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689176909105"}]},"ts":"1689176909105"} 2023-07-12 15:48:29,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 15:48:29,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 580433e5301d9299b394874c7507a2b3, server=jenkins-hbase5.apache.org,44531,1689176907599 in 174 msec 2023-07-12 15:48:29,111 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 15:48:29,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=580433e5301d9299b394874c7507a2b3, ASSIGN in 333 msec 2023-07-12 15:48:29,113 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 15:48:29,113 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689176909113"}]},"ts":"1689176909113"} 2023-07-12 15:48:29,115 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLED in hbase:meta 2023-07-12 15:48:29,117 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 15:48:29,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRolling in 383 msec 2023-07-12 15:48:31,673 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-12 15:48:33,862 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 15:48:33,863 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 15:48:33,864 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRolling' 2023-07-12 15:48:38,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33705] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 15:48:38,742 INFO [Listener at localhost/37417] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRolling, procId: 9 completed 2023-07-12 15:48:38,745 DEBUG [Listener at localhost/37417] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRolling 2023-07-12 15:48:38,746 DEBUG [Listener at localhost/37417] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. 2023-07-12 15:48:38,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:38,770 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 580433e5301d9299b394874c7507a2b3 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-12 15:48:38,796 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=12 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp/info/8cff5ddb1107434f8d5037e563ce23c1 2023-07-12 15:48:38,807 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp/info/8cff5ddb1107434f8d5037e563ce23c1 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/8cff5ddb1107434f8d5037e563ce23c1 2023-07-12 15:48:38,814 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=580433e5301d9299b394874c7507a2b3, server=jenkins-hbase5.apache.org,44531,1689176907599 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 15:48:38,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] ipc.CallRunner(144): callId: 38 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.10.131:42592 deadline: 1689176928813, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=580433e5301d9299b394874c7507a2b3, server=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:38,824 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/8cff5ddb1107434f8d5037e563ce23c1, entries=8, sequenceid=12, filesize=13.0 K 2023-07-12 15:48:38,825 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 580433e5301d9299b394874c7507a2b3 in 55ms, sequenceid=12, compaction requested=false 2023-07-12 15:48:38,826 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 580433e5301d9299b394874c7507a2b3: 2023-07-12 15:48:48,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:48,857 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 580433e5301d9299b394874c7507a2b3 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-12 15:48:48,895 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=37 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp/info/94288f3ed91d4a5f974d48747746a94b 2023-07-12 15:48:48,914 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp/info/94288f3ed91d4a5f974d48747746a94b as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/94288f3ed91d4a5f974d48747746a94b 2023-07-12 15:48:48,941 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/94288f3ed91d4a5f974d48747746a94b, entries=22, sequenceid=37, filesize=27.4 K 2023-07-12 15:48:48,944 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=2.05 KB/2102 for 580433e5301d9299b394874c7507a2b3 in 87ms, sequenceid=37, compaction requested=false 2023-07-12 15:48:48,945 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 580433e5301d9299b394874c7507a2b3: 2023-07-12 15:48:48,945 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=40.3 K, sizeToCheck=16.0 K 2023-07-12 15:48:48,946 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-12 15:48:48,948 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/94288f3ed91d4a5f974d48747746a94b because midkey is the same as first or last row 2023-07-12 15:48:50,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:50,871 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 580433e5301d9299b394874c7507a2b3 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-12 15:48:50,887 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=48 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp/info/fd14bfe0da6740d990bec812e4aa5706 2023-07-12 15:48:50,899 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp/info/fd14bfe0da6740d990bec812e4aa5706 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/fd14bfe0da6740d990bec812e4aa5706 2023-07-12 15:48:50,907 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/fd14bfe0da6740d990bec812e4aa5706, entries=8, sequenceid=48, filesize=13.0 K 2023-07-12 15:48:50,908 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=17.45 KB/17867 for 580433e5301d9299b394874c7507a2b3 in 36ms, sequenceid=48, compaction requested=true 2023-07-12 15:48:50,908 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 580433e5301d9299b394874c7507a2b3: 2023-07-12 15:48:50,908 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=53.3 K, sizeToCheck=16.0 K 2023-07-12 15:48:50,908 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-12 15:48:50,908 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/94288f3ed91d4a5f974d48747746a94b because midkey is the same as first or last row 2023-07-12 15:48:50,909 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:48:50,909 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 15:48:50,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:50,912 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 580433e5301d9299b394874c7507a2b3 1/1 column families, dataSize=18.47 KB heapSize=20.08 KB 2023-07-12 15:48:50,912 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 54576 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 15:48:50,912 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1912): 580433e5301d9299b394874c7507a2b3/info is initiating minor compaction (all files) 2023-07-12 15:48:50,912 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 580433e5301d9299b394874c7507a2b3/info in TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. 2023-07-12 15:48:50,912 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/8cff5ddb1107434f8d5037e563ce23c1, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/94288f3ed91d4a5f974d48747746a94b, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/fd14bfe0da6740d990bec812e4aa5706] into tmpdir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp, totalSize=53.3 K 2023-07-12 15:48:50,913 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting 8cff5ddb1107434f8d5037e563ce23c1, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1689176918750 2023-07-12 15:48:50,914 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting 94288f3ed91d4a5f974d48747746a94b, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=37, earliestPutTs=1689176918771 2023-07-12 15:48:50,915 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting fd14bfe0da6740d990bec812e4aa5706, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1689176928858 2023-07-12 15:48:50,940 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=18.47 KB at sequenceid=69 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp/info/9f9cab29b13f4f469eb3562502bebb2a 2023-07-12 15:48:50,945 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] throttle.PressureAwareThroughputController(145): 580433e5301d9299b394874c7507a2b3#info#compaction#19 average throughput is 19.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 15:48:50,950 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp/info/9f9cab29b13f4f469eb3562502bebb2a as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/9f9cab29b13f4f469eb3562502bebb2a 2023-07-12 15:48:50,961 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/9f9cab29b13f4f469eb3562502bebb2a, entries=18, sequenceid=69, filesize=23.3 K 2023-07-12 15:48:50,962 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~18.47 KB/18918, heapSize ~20.06 KB/20544, currentSize=8.21 KB/8408 for 580433e5301d9299b394874c7507a2b3 in 50ms, sequenceid=69, compaction requested=false 2023-07-12 15:48:50,962 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 580433e5301d9299b394874c7507a2b3: 2023-07-12 15:48:50,963 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=76.6 K, sizeToCheck=16.0 K 2023-07-12 15:48:50,963 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-12 15:48:50,963 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/94288f3ed91d4a5f974d48747746a94b because midkey is the same as first or last row 2023-07-12 15:48:50,974 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp/info/325501b040814c719d24c468443cf69b as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/325501b040814c719d24c468443cf69b 2023-07-12 15:48:50,981 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 580433e5301d9299b394874c7507a2b3/info of 580433e5301d9299b394874c7507a2b3 into 325501b040814c719d24c468443cf69b(size=43.9 K), total size for store is 67.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 15:48:50,981 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 580433e5301d9299b394874c7507a2b3: 2023-07-12 15:48:50,981 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3., storeName=580433e5301d9299b394874c7507a2b3/info, priority=13, startTime=1689176930909; duration=0sec 2023-07-12 15:48:50,982 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=67.2 K, sizeToCheck=16.0 K 2023-07-12 15:48:50,982 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-12 15:48:50,982 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.StoreUtils(129): cannot split hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/325501b040814c719d24c468443cf69b because midkey is the same as first or last row 2023-07-12 15:48:50,983 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:48:52,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:52,932 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 580433e5301d9299b394874c7507a2b3 1/1 column families, dataSize=9.24 KB heapSize=10.16 KB 2023-07-12 15:48:52,952 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=9.24 KB at sequenceid=82 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp/info/c5538768bcaa4271bc2f3d3c493ebedc 2023-07-12 15:48:52,966 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp/info/c5538768bcaa4271bc2f3d3c493ebedc as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/c5538768bcaa4271bc2f3d3c493ebedc 2023-07-12 15:48:52,978 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=580433e5301d9299b394874c7507a2b3, server=jenkins-hbase5.apache.org,44531,1689176907599 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 15:48:52,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.10.131:42592 deadline: 1689176942978, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=580433e5301d9299b394874c7507a2b3, server=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:52,979 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/c5538768bcaa4271bc2f3d3c493ebedc, entries=9, sequenceid=82, filesize=14.0 K 2023-07-12 15:48:52,984 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~9.24 KB/9459, heapSize ~10.15 KB/10392, currentSize=20.53 KB/21020 for 580433e5301d9299b394874c7507a2b3 in 51ms, sequenceid=82, compaction requested=true 2023-07-12 15:48:52,984 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 580433e5301d9299b394874c7507a2b3: 2023-07-12 15:48:52,984 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=81.2 K, sizeToCheck=16.0 K 2023-07-12 15:48:52,984 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-12 15:48:52,984 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/325501b040814c719d24c468443cf69b because midkey is the same as first or last row 2023-07-12 15:48:52,984 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:48:52,984 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 15:48:52,986 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 83139 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 15:48:52,986 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1912): 580433e5301d9299b394874c7507a2b3/info is initiating minor compaction (all files) 2023-07-12 15:48:52,987 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 580433e5301d9299b394874c7507a2b3/info in TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. 2023-07-12 15:48:52,987 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/325501b040814c719d24c468443cf69b, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/9f9cab29b13f4f469eb3562502bebb2a, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/c5538768bcaa4271bc2f3d3c493ebedc] into tmpdir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp, totalSize=81.2 K 2023-07-12 15:48:52,987 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting 325501b040814c719d24c468443cf69b, keycount=38, bloomtype=ROW, size=43.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1689176918750 2023-07-12 15:48:52,988 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting 9f9cab29b13f4f469eb3562502bebb2a, keycount=18, bloomtype=ROW, size=23.3 K, encoding=NONE, compression=NONE, seqNum=69, earliestPutTs=1689176930872 2023-07-12 15:48:52,989 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting c5538768bcaa4271bc2f3d3c493ebedc, keycount=9, bloomtype=ROW, size=14.0 K, encoding=NONE, compression=NONE, seqNum=82, earliestPutTs=1689176930913 2023-07-12 15:48:53,006 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] throttle.PressureAwareThroughputController(145): 580433e5301d9299b394874c7507a2b3#info#compaction#21 average throughput is 16.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 15:48:53,031 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp/info/adc82fa39c5941dd80abf17ba0ffbedb as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/adc82fa39c5941dd80abf17ba0ffbedb 2023-07-12 15:48:53,038 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 580433e5301d9299b394874c7507a2b3/info of 580433e5301d9299b394874c7507a2b3 into adc82fa39c5941dd80abf17ba0ffbedb(size=71.9 K), total size for store is 71.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 15:48:53,038 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 580433e5301d9299b394874c7507a2b3: 2023-07-12 15:48:53,038 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3., storeName=580433e5301d9299b394874c7507a2b3/info, priority=13, startTime=1689176932984; duration=0sec 2023-07-12 15:48:53,038 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=71.9 K, sizeToCheck=16.0 K 2023-07-12 15:48:53,038 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-12 15:48:53,039 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit(227): Splitting TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3., compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:48:53,039 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:48:53,040 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33705] assignment.AssignmentManager(1140): Split request from jenkins-hbase5.apache.org,44531,1689176907599, parent={ENCODED => 580433e5301d9299b394874c7507a2b3, NAME => 'TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.', STARTKEY => '', ENDKEY => ''} splitKey=row0064 2023-07-12 15:48:53,048 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33705] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:53,054 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33705] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=580433e5301d9299b394874c7507a2b3, daughterA=10975ad2c23ad18425c7b83e83947278, daughterB=6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:48:53,055 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=580433e5301d9299b394874c7507a2b3, daughterA=10975ad2c23ad18425c7b83e83947278, daughterB=6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:48:53,055 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=580433e5301d9299b394874c7507a2b3, daughterA=10975ad2c23ad18425c7b83e83947278, daughterB=6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:48:53,055 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=580433e5301d9299b394874c7507a2b3, daughterA=10975ad2c23ad18425c7b83e83947278, daughterB=6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:48:53,063 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=580433e5301d9299b394874c7507a2b3, UNASSIGN}] 2023-07-12 15:48:53,065 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=580433e5301d9299b394874c7507a2b3, UNASSIGN 2023-07-12 15:48:53,066 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=580433e5301d9299b394874c7507a2b3, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:53,066 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689176933065"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689176933065"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689176933065"}]},"ts":"1689176933065"} 2023-07-12 15:48:53,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; CloseRegionProcedure 580433e5301d9299b394874c7507a2b3, server=jenkins-hbase5.apache.org,44531,1689176907599}] 2023-07-12 15:48:53,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:53,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 580433e5301d9299b394874c7507a2b3, disabling compactions & flushes 2023-07-12 15:48:53,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. 2023-07-12 15:48:53,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. 2023-07-12 15:48:53,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. after waiting 0 ms 2023-07-12 15:48:53,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. 2023-07-12 15:48:53,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 580433e5301d9299b394874c7507a2b3 1/1 column families, dataSize=20.53 KB heapSize=22.28 KB 2023-07-12 15:48:53,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=20.53 KB at sequenceid=106 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp/info/b0c794d6d4034108a213fbe3f2cfa359 2023-07-12 15:48:53,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.tmp/info/b0c794d6d4034108a213fbe3f2cfa359 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/b0c794d6d4034108a213fbe3f2cfa359 2023-07-12 15:48:53,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/b0c794d6d4034108a213fbe3f2cfa359, entries=20, sequenceid=106, filesize=25.3 K 2023-07-12 15:48:53,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~20.53 KB/21020, heapSize ~22.27 KB/22800, currentSize=0 B/0 for 580433e5301d9299b394874c7507a2b3 in 428ms, sequenceid=106, compaction requested=false 2023-07-12 15:48:53,662 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/8cff5ddb1107434f8d5037e563ce23c1, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/94288f3ed91d4a5f974d48747746a94b, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/325501b040814c719d24c468443cf69b, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/fd14bfe0da6740d990bec812e4aa5706, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/9f9cab29b13f4f469eb3562502bebb2a, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/c5538768bcaa4271bc2f3d3c493ebedc] to archive 2023-07-12 15:48:53,663 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 15:48:53,665 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/8cff5ddb1107434f8d5037e563ce23c1 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/8cff5ddb1107434f8d5037e563ce23c1 2023-07-12 15:48:53,666 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/94288f3ed91d4a5f974d48747746a94b to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/94288f3ed91d4a5f974d48747746a94b 2023-07-12 15:48:53,668 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/325501b040814c719d24c468443cf69b to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/325501b040814c719d24c468443cf69b 2023-07-12 15:48:53,669 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/fd14bfe0da6740d990bec812e4aa5706 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/fd14bfe0da6740d990bec812e4aa5706 2023-07-12 15:48:53,670 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/9f9cab29b13f4f469eb3562502bebb2a to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/9f9cab29b13f4f469eb3562502bebb2a 2023-07-12 15:48:53,672 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/c5538768bcaa4271bc2f3d3c493ebedc to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/c5538768bcaa4271bc2f3d3c493ebedc 2023-07-12 15:48:53,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/recovered.edits/109.seqid, newMaxSeqId=109, maxSeqId=1 2023-07-12 15:48:53,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. 2023-07-12 15:48:53,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 580433e5301d9299b394874c7507a2b3: 2023-07-12 15:48:53,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:53,681 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=580433e5301d9299b394874c7507a2b3, regionState=CLOSED 2023-07-12 15:48:53,681 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689176933681"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689176933681"}]},"ts":"1689176933681"} 2023-07-12 15:48:53,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-12 15:48:53,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; CloseRegionProcedure 580433e5301d9299b394874c7507a2b3, server=jenkins-hbase5.apache.org,44531,1689176907599 in 615 msec 2023-07-12 15:48:53,687 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-12 15:48:53,687 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=580433e5301d9299b394874c7507a2b3, UNASSIGN in 622 msec 2023-07-12 15:48:53,700 INFO [PEWorker-4] assignment.SplitTableRegionProcedure(694): pid=12 splitting 2 storefiles, region=580433e5301d9299b394874c7507a2b3, threads=2 2023-07-12 15:48:53,703 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/adc82fa39c5941dd80abf17ba0ffbedb for region: 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:53,704 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/b0c794d6d4034108a213fbe3f2cfa359 for region: 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:53,727 DEBUG [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/b0c794d6d4034108a213fbe3f2cfa359, top=true 2023-07-12 15:48:53,743 INFO [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/.splits/6acc08707a793e4b75b87ea53367aca6/info/TestLogRolling-testLogRolling=580433e5301d9299b394874c7507a2b3-b0c794d6d4034108a213fbe3f2cfa359 for child: 6acc08707a793e4b75b87ea53367aca6, parent: 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:53,743 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/b0c794d6d4034108a213fbe3f2cfa359 for region: 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:53,760 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/adc82fa39c5941dd80abf17ba0ffbedb for region: 580433e5301d9299b394874c7507a2b3 2023-07-12 15:48:53,761 DEBUG [PEWorker-4] assignment.SplitTableRegionProcedure(755): pid=12 split storefiles for region 580433e5301d9299b394874c7507a2b3 Daughter A: 1 storefiles, Daughter B: 2 storefiles. 2023-07-12 15:48:53,797 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/10975ad2c23ad18425c7b83e83947278/recovered.edits/109.seqid, newMaxSeqId=109, maxSeqId=-1 2023-07-12 15:48:53,799 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/recovered.edits/109.seqid, newMaxSeqId=109, maxSeqId=-1 2023-07-12 15:48:53,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689176933801"},{"qualifier":"splitA","vlen":70,"tag":[],"timestamp":"1689176933801"},{"qualifier":"splitB","vlen":70,"tag":[],"timestamp":"1689176933801"}]},"ts":"1689176933801"} 2023-07-12 15:48:53,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689176933801"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689176933801"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689176933801"}]},"ts":"1689176933801"} 2023-07-12 15:48:53,802 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689176933801"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689176933801"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689176933801"}]},"ts":"1689176933801"} 2023-07-12 15:48:53,842 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44531] regionserver.HRegion(9158): Flush requested on 1588230740 2023-07-12 15:48:53,842 DEBUG [MemStoreFlusher.0] regionserver.FlushAllLargeStoresPolicy(69): Since none of the CFs were above the size, flushing all. 2023-07-12 15:48:53,842 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=4.82 KB heapSize=8.36 KB 2023-07-12 15:48:53,852 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=10975ad2c23ad18425c7b83e83947278, ASSIGN}, {pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=6acc08707a793e4b75b87ea53367aca6, ASSIGN}] 2023-07-12 15:48:53,853 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=10975ad2c23ad18425c7b83e83947278, ASSIGN 2023-07-12 15:48:53,854 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=6acc08707a793e4b75b87ea53367aca6, ASSIGN 2023-07-12 15:48:53,856 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=10975ad2c23ad18425c7b83e83947278, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase5.apache.org,44531,1689176907599; forceNewPlan=false, retain=false 2023-07-12 15:48:53,856 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=6acc08707a793e4b75b87ea53367aca6, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase5.apache.org,44531,1689176907599; forceNewPlan=false, retain=false 2023-07-12 15:48:53,861 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=4.61 KB at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/.tmp/info/c9eb060a1dc8442a9776cfa43bd28b54 2023-07-12 15:48:53,884 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=216 B at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/.tmp/table/ea1345e94a1b442593f5332fae658f45 2023-07-12 15:48:53,891 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/.tmp/info/c9eb060a1dc8442a9776cfa43bd28b54 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/info/c9eb060a1dc8442a9776cfa43bd28b54 2023-07-12 15:48:53,896 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/info/c9eb060a1dc8442a9776cfa43bd28b54, entries=29, sequenceid=17, filesize=8.6 K 2023-07-12 15:48:53,898 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/.tmp/table/ea1345e94a1b442593f5332fae658f45 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/table/ea1345e94a1b442593f5332fae658f45 2023-07-12 15:48:53,903 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/table/ea1345e94a1b442593f5332fae658f45, entries=4, sequenceid=17, filesize=4.8 K 2023-07-12 15:48:53,905 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~4.82 KB/4934, heapSize ~8.08 KB/8272, currentSize=0 B/0 for 1588230740 in 63ms, sequenceid=17, compaction requested=false 2023-07-12 15:48:53,905 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-07-12 15:48:54,007 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=10975ad2c23ad18425c7b83e83947278, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:54,007 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6acc08707a793e4b75b87ea53367aca6, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:54,007 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689176934007"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689176934007"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689176934007"}]},"ts":"1689176934007"} 2023-07-12 15:48:54,007 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689176934007"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689176934007"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689176934007"}]},"ts":"1689176934007"} 2023-07-12 15:48:54,009 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 10975ad2c23ad18425c7b83e83947278, server=jenkins-hbase5.apache.org,44531,1689176907599}] 2023-07-12 15:48:54,010 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=18, ppid=16, state=RUNNABLE; OpenRegionProcedure 6acc08707a793e4b75b87ea53367aca6, server=jenkins-hbase5.apache.org,44531,1689176907599}] 2023-07-12 15:48:54,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278. 2023-07-12 15:48:54,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 10975ad2c23ad18425c7b83e83947278, NAME => 'TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278.', STARTKEY => '', ENDKEY => 'row0064'} 2023-07-12 15:48:54,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling 10975ad2c23ad18425c7b83e83947278 2023-07-12 15:48:54,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:48:54,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 10975ad2c23ad18425c7b83e83947278 2023-07-12 15:48:54,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 10975ad2c23ad18425c7b83e83947278 2023-07-12 15:48:54,167 INFO [StoreOpener-10975ad2c23ad18425c7b83e83947278-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 10975ad2c23ad18425c7b83e83947278 2023-07-12 15:48:54,168 DEBUG [StoreOpener-10975ad2c23ad18425c7b83e83947278-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/10975ad2c23ad18425c7b83e83947278/info 2023-07-12 15:48:54,168 DEBUG [StoreOpener-10975ad2c23ad18425c7b83e83947278-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/10975ad2c23ad18425c7b83e83947278/info 2023-07-12 15:48:54,169 INFO [StoreOpener-10975ad2c23ad18425c7b83e83947278-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10975ad2c23ad18425c7b83e83947278 columnFamilyName info 2023-07-12 15:48:54,182 DEBUG [StoreOpener-10975ad2c23ad18425c7b83e83947278-1] regionserver.HStore(539): loaded hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/10975ad2c23ad18425c7b83e83947278/info/adc82fa39c5941dd80abf17ba0ffbedb.580433e5301d9299b394874c7507a2b3->hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/adc82fa39c5941dd80abf17ba0ffbedb-bottom 2023-07-12 15:48:54,182 INFO [StoreOpener-10975ad2c23ad18425c7b83e83947278-1] regionserver.HStore(310): Store=10975ad2c23ad18425c7b83e83947278/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:48:54,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/10975ad2c23ad18425c7b83e83947278 2023-07-12 15:48:54,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/10975ad2c23ad18425c7b83e83947278 2023-07-12 15:48:54,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 10975ad2c23ad18425c7b83e83947278 2023-07-12 15:48:54,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 10975ad2c23ad18425c7b83e83947278; next sequenceid=110; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=712248, jitterRate=-0.09433050453662872}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 15:48:54,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 10975ad2c23ad18425c7b83e83947278: 2023-07-12 15:48:54,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278., pid=17, masterSystemTime=1689176934161 2023-07-12 15:48:54,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:48:54,192 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-12 15:48:54,193 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278. 2023-07-12 15:48:54,193 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1912): 10975ad2c23ad18425c7b83e83947278/info is initiating minor compaction (all files) 2023-07-12 15:48:54,193 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 10975ad2c23ad18425c7b83e83947278/info in TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278. 2023-07-12 15:48:54,193 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/10975ad2c23ad18425c7b83e83947278/info/adc82fa39c5941dd80abf17ba0ffbedb.580433e5301d9299b394874c7507a2b3->hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/adc82fa39c5941dd80abf17ba0ffbedb-bottom] into tmpdir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/10975ad2c23ad18425c7b83e83947278/.tmp, totalSize=71.9 K 2023-07-12 15:48:54,194 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting adc82fa39c5941dd80abf17ba0ffbedb.580433e5301d9299b394874c7507a2b3, keycount=32, bloomtype=ROW, size=71.9 K, encoding=NONE, compression=NONE, seqNum=82, earliestPutTs=1689176918750 2023-07-12 15:48:54,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278. 2023-07-12 15:48:54,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278. 2023-07-12 15:48:54,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:48:54,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6acc08707a793e4b75b87ea53367aca6, NAME => 'TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.', STARTKEY => 'row0064', ENDKEY => ''} 2023-07-12 15:48:54,195 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=10975ad2c23ad18425c7b83e83947278, regionState=OPEN, openSeqNum=110, regionLocation=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:54,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:48:54,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:48:54,196 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689176934195"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689176934195"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689176934195"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689176934195"}]},"ts":"1689176934195"} 2023-07-12 15:48:54,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:48:54,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:48:54,197 INFO [StoreOpener-6acc08707a793e4b75b87ea53367aca6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:48:54,199 DEBUG [StoreOpener-6acc08707a793e4b75b87ea53367aca6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info 2023-07-12 15:48:54,200 DEBUG [StoreOpener-6acc08707a793e4b75b87ea53367aca6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info 2023-07-12 15:48:54,200 INFO [StoreOpener-6acc08707a793e4b75b87ea53367aca6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6acc08707a793e4b75b87ea53367aca6 columnFamilyName info 2023-07-12 15:48:54,201 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-07-12 15:48:54,201 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 10975ad2c23ad18425c7b83e83947278, server=jenkins-hbase5.apache.org,44531,1689176907599 in 189 msec 2023-07-12 15:48:54,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=10975ad2c23ad18425c7b83e83947278, ASSIGN in 349 msec 2023-07-12 15:48:54,206 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] throttle.PressureAwareThroughputController(145): 10975ad2c23ad18425c7b83e83947278#info#compaction#25 average throughput is 15.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 15:48:54,219 DEBUG [StoreOpener-6acc08707a793e4b75b87ea53367aca6-1] regionserver.HStore(539): loaded hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/TestLogRolling-testLogRolling=580433e5301d9299b394874c7507a2b3-b0c794d6d4034108a213fbe3f2cfa359 2023-07-12 15:48:54,232 DEBUG [StoreOpener-6acc08707a793e4b75b87ea53367aca6-1] regionserver.HStore(539): loaded hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/adc82fa39c5941dd80abf17ba0ffbedb.580433e5301d9299b394874c7507a2b3->hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/adc82fa39c5941dd80abf17ba0ffbedb-top 2023-07-12 15:48:54,232 INFO [StoreOpener-6acc08707a793e4b75b87ea53367aca6-1] regionserver.HStore(310): Store=6acc08707a793e4b75b87ea53367aca6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:48:54,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:48:54,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:48:54,239 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/10975ad2c23ad18425c7b83e83947278/.tmp/info/cd0c4fd84a0141b08c17b0bfca4c6374 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/10975ad2c23ad18425c7b83e83947278/info/cd0c4fd84a0141b08c17b0bfca4c6374 2023-07-12 15:48:54,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:48:54,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 6acc08707a793e4b75b87ea53367aca6; next sequenceid=110; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=839410, jitterRate=0.06736594438552856}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 15:48:54,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:48:54,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6., pid=18, masterSystemTime=1689176934161 2023-07-12 15:48:54,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:48:54,244 DEBUG [RS:0;jenkins-hbase5:44531-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 2 store files, 0 compacting, 2 eligible, 16 blocking 2023-07-12 15:48:54,245 INFO [RS:0;jenkins-hbase5:44531-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:48:54,245 DEBUG [RS:0;jenkins-hbase5:44531-longCompactions-0] regionserver.HStore(1912): 6acc08707a793e4b75b87ea53367aca6/info is initiating minor compaction (all files) 2023-07-12 15:48:54,245 INFO [RS:0;jenkins-hbase5:44531-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 6acc08707a793e4b75b87ea53367aca6/info in TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:48:54,246 INFO [RS:0;jenkins-hbase5:44531-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/adc82fa39c5941dd80abf17ba0ffbedb.580433e5301d9299b394874c7507a2b3->hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/adc82fa39c5941dd80abf17ba0ffbedb-top, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/TestLogRolling-testLogRolling=580433e5301d9299b394874c7507a2b3-b0c794d6d4034108a213fbe3f2cfa359] into tmpdir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp, totalSize=97.2 K 2023-07-12 15:48:54,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:48:54,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:48:54,247 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6acc08707a793e4b75b87ea53367aca6, regionState=OPEN, openSeqNum=110, regionLocation=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:48:54,248 DEBUG [RS:0;jenkins-hbase5:44531-longCompactions-0] compactions.Compactor(207): Compacting adc82fa39c5941dd80abf17ba0ffbedb.580433e5301d9299b394874c7507a2b3, keycount=32, bloomtype=ROW, size=71.9 K, encoding=NONE, compression=NONE, seqNum=83, earliestPutTs=1689176918750 2023-07-12 15:48:54,248 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689176934247"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689176934247"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689176934247"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689176934247"}]},"ts":"1689176934247"} 2023-07-12 15:48:54,249 DEBUG [RS:0;jenkins-hbase5:44531-longCompactions-0] compactions.Compactor(207): Compacting TestLogRolling-testLogRolling=580433e5301d9299b394874c7507a2b3-b0c794d6d4034108a213fbe3f2cfa359, keycount=20, bloomtype=ROW, size=25.3 K, encoding=NONE, compression=NONE, seqNum=106, earliestPutTs=1689176932932 2023-07-12 15:48:54,251 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 10975ad2c23ad18425c7b83e83947278/info of 10975ad2c23ad18425c7b83e83947278 into cd0c4fd84a0141b08c17b0bfca4c6374(size=69.7 K), total size for store is 69.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 15:48:54,252 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 10975ad2c23ad18425c7b83e83947278: 2023-07-12 15:48:54,252 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278., storeName=10975ad2c23ad18425c7b83e83947278/info, priority=15, startTime=1689176934192; duration=0sec 2023-07-12 15:48:54,252 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:48:54,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=16 2023-07-12 15:48:54,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=16, state=SUCCESS; OpenRegionProcedure 6acc08707a793e4b75b87ea53367aca6, server=jenkins-hbase5.apache.org,44531,1689176907599 in 241 msec 2023-07-12 15:48:54,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=12 2023-07-12 15:48:54,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=6acc08707a793e4b75b87ea53367aca6, ASSIGN in 402 msec 2023-07-12 15:48:54,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=580433e5301d9299b394874c7507a2b3, daughterA=10975ad2c23ad18425c7b83e83947278, daughterB=6acc08707a793e4b75b87ea53367aca6 in 1.2080 sec 2023-07-12 15:48:54,260 INFO [RS:0;jenkins-hbase5:44531-longCompactions-0] throttle.PressureAwareThroughputController(145): 6acc08707a793e4b75b87ea53367aca6#info#compaction#26 average throughput is 22.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 15:48:54,281 DEBUG [RS:0;jenkins-hbase5:44531-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/da97fe831ed34aebb7d1667765c9eb2e as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/da97fe831ed34aebb7d1667765c9eb2e 2023-07-12 15:48:54,288 INFO [RS:0;jenkins-hbase5:44531-longCompactions-0] regionserver.HStore(1652): Completed compaction of 2 (all) file(s) in 6acc08707a793e4b75b87ea53367aca6/info of 6acc08707a793e4b75b87ea53367aca6 into da97fe831ed34aebb7d1667765c9eb2e(size=27.5 K), total size for store is 27.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 15:48:54,288 DEBUG [RS:0;jenkins-hbase5:44531-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:48:54,288 INFO [RS:0;jenkins-hbase5:44531-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6., storeName=6acc08707a793e4b75b87ea53367aca6/info, priority=14, startTime=1689176934243; duration=0sec 2023-07-12 15:48:54,288 DEBUG [RS:0;jenkins-hbase5:44531-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:48:59,222 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-12 15:49:03,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.10.131:42592 deadline: 1689176953011, exception=org.apache.hadoop.hbase.NotServingRegionException: TestLogRolling-testLogRolling,,1689176908735.580433e5301d9299b394874c7507a2b3. is not online on jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:49:23,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:49:23,079 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 6acc08707a793e4b75b87ea53367aca6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-12 15:49:23,095 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=121 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/d383f66a3cff456e849df1600dee2bdd 2023-07-12 15:49:23,102 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/d383f66a3cff456e849df1600dee2bdd as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/d383f66a3cff456e849df1600dee2bdd 2023-07-12 15:49:23,107 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/d383f66a3cff456e849df1600dee2bdd, entries=8, sequenceid=121, filesize=13.0 K 2023-07-12 15:49:23,108 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=3.08 KB/3153 for 6acc08707a793e4b75b87ea53367aca6 in 29ms, sequenceid=121, compaction requested=false 2023-07-12 15:49:23,108 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:49:25,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:49:25,093 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 6acc08707a793e4b75b87ea53367aca6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-12 15:49:25,135 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=6acc08707a793e4b75b87ea53367aca6, server=jenkins-hbase5.apache.org,44531,1689176907599 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 15:49:25,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] ipc.CallRunner(144): callId: 139 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.10.131:42592 deadline: 1689176975135, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=6acc08707a793e4b75b87ea53367aca6, server=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:49:25,138 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/ba1771f208474f2494f24629748bef78 2023-07-12 15:49:25,146 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/ba1771f208474f2494f24629748bef78 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/ba1771f208474f2494f24629748bef78 2023-07-12 15:49:25,154 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/ba1771f208474f2494f24629748bef78, entries=8, sequenceid=132, filesize=13.0 K 2023-07-12 15:49:25,155 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 6acc08707a793e4b75b87ea53367aca6 in 62ms, sequenceid=132, compaction requested=true 2023-07-12 15:49:25,156 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:49:25,156 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:49:25,156 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 15:49:25,158 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 54746 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 15:49:25,158 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1912): 6acc08707a793e4b75b87ea53367aca6/info is initiating minor compaction (all files) 2023-07-12 15:49:25,158 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6acc08707a793e4b75b87ea53367aca6/info in TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:49:25,158 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/da97fe831ed34aebb7d1667765c9eb2e, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/d383f66a3cff456e849df1600dee2bdd, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/ba1771f208474f2494f24629748bef78] into tmpdir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp, totalSize=53.5 K 2023-07-12 15:49:25,159 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting da97fe831ed34aebb7d1667765c9eb2e, keycount=22, bloomtype=ROW, size=27.5 K, encoding=NONE, compression=NONE, seqNum=106, earliestPutTs=1689176930927 2023-07-12 15:49:25,160 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting d383f66a3cff456e849df1600dee2bdd, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=121, earliestPutTs=1689176963071 2023-07-12 15:49:25,160 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting ba1771f208474f2494f24629748bef78, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=132, earliestPutTs=1689176963079 2023-07-12 15:49:25,185 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6acc08707a793e4b75b87ea53367aca6#info#compaction#29 average throughput is 19.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 15:49:25,621 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/3594e4bfc892407bae5d5e6e5a571b06 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/3594e4bfc892407bae5d5e6e5a571b06 2023-07-12 15:49:25,630 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6acc08707a793e4b75b87ea53367aca6/info of 6acc08707a793e4b75b87ea53367aca6 into 3594e4bfc892407bae5d5e6e5a571b06(size=44.1 K), total size for store is 44.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 15:49:25,630 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:49:25,630 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6., storeName=6acc08707a793e4b75b87ea53367aca6/info, priority=13, startTime=1689176965156; duration=0sec 2023-07-12 15:49:25,630 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:49:35,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:49:35,166 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 6acc08707a793e4b75b87ea53367aca6 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-12 15:49:35,182 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=158 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/b03324f4c3b5414585514b1e6b92bf11 2023-07-12 15:49:35,189 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/b03324f4c3b5414585514b1e6b92bf11 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b03324f4c3b5414585514b1e6b92bf11 2023-07-12 15:49:35,194 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b03324f4c3b5414585514b1e6b92bf11, entries=22, sequenceid=158, filesize=27.4 K 2023-07-12 15:49:35,195 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=5.13 KB/5255 for 6acc08707a793e4b75b87ea53367aca6 in 29ms, sequenceid=158, compaction requested=false 2023-07-12 15:49:35,195 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:49:37,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:49:37,178 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 6acc08707a793e4b75b87ea53367aca6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-12 15:49:37,200 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=169 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/b4167b4ad7bd44148a19fc107b9e0f99 2023-07-12 15:49:37,207 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/b4167b4ad7bd44148a19fc107b9e0f99 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b4167b4ad7bd44148a19fc107b9e0f99 2023-07-12 15:49:37,214 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b4167b4ad7bd44148a19fc107b9e0f99, entries=8, sequenceid=169, filesize=13.0 K 2023-07-12 15:49:37,214 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 6acc08707a793e4b75b87ea53367aca6 in 36ms, sequenceid=169, compaction requested=true 2023-07-12 15:49:37,215 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:49:37,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:49:37,215 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:49:37,215 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 15:49:37,215 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 6acc08707a793e4b75b87ea53367aca6 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-12 15:49:37,216 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 86494 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 15:49:37,216 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1912): 6acc08707a793e4b75b87ea53367aca6/info is initiating minor compaction (all files) 2023-07-12 15:49:37,216 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6acc08707a793e4b75b87ea53367aca6/info in TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:49:37,217 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/3594e4bfc892407bae5d5e6e5a571b06, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b03324f4c3b5414585514b1e6b92bf11, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b4167b4ad7bd44148a19fc107b9e0f99] into tmpdir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp, totalSize=84.5 K 2023-07-12 15:49:37,217 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting 3594e4bfc892407bae5d5e6e5a571b06, keycount=38, bloomtype=ROW, size=44.1 K, encoding=NONE, compression=NONE, seqNum=132, earliestPutTs=1689176930927 2023-07-12 15:49:37,218 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting b03324f4c3b5414585514b1e6b92bf11, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=158, earliestPutTs=1689176965094 2023-07-12 15:49:37,218 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting b4167b4ad7bd44148a19fc107b9e0f99, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=169, earliestPutTs=1689176975167 2023-07-12 15:49:37,248 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=194 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/57b7942f0a854f4a8683050f17fc9da9 2023-07-12 15:49:37,259 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6acc08707a793e4b75b87ea53367aca6#info#compaction#33 average throughput is 13.63 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 15:49:37,260 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/57b7942f0a854f4a8683050f17fc9da9 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/57b7942f0a854f4a8683050f17fc9da9 2023-07-12 15:49:37,275 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/57b7942f0a854f4a8683050f17fc9da9, entries=22, sequenceid=194, filesize=27.4 K 2023-07-12 15:49:37,277 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=7.18 KB/7357 for 6acc08707a793e4b75b87ea53367aca6 in 62ms, sequenceid=194, compaction requested=false 2023-07-12 15:49:37,277 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:49:37,291 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/0834ba7bf6664a8e8249af28e1f168df as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/0834ba7bf6664a8e8249af28e1f168df 2023-07-12 15:49:37,298 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6acc08707a793e4b75b87ea53367aca6/info of 6acc08707a793e4b75b87ea53367aca6 into 0834ba7bf6664a8e8249af28e1f168df(size=75.2 K), total size for store is 102.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 15:49:37,298 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:49:37,298 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6., storeName=6acc08707a793e4b75b87ea53367aca6/info, priority=13, startTime=1689176977215; duration=0sec 2023-07-12 15:49:37,298 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:49:39,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:49:39,232 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 6acc08707a793e4b75b87ea53367aca6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-12 15:49:39,253 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=206 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/21145751af3641d5b7a5b04d8c851d85 2023-07-12 15:49:39,262 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/21145751af3641d5b7a5b04d8c851d85 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/21145751af3641d5b7a5b04d8c851d85 2023-07-12 15:49:39,267 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=6acc08707a793e4b75b87ea53367aca6, server=jenkins-hbase5.apache.org,44531,1689176907599 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 15:49:39,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] ipc.CallRunner(144): callId: 201 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.10.131:42592 deadline: 1689176989267, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=6acc08707a793e4b75b87ea53367aca6, server=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:49:39,269 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/21145751af3641d5b7a5b04d8c851d85, entries=8, sequenceid=206, filesize=13.0 K 2023-07-12 15:49:39,270 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 6acc08707a793e4b75b87ea53367aca6 in 38ms, sequenceid=206, compaction requested=true 2023-07-12 15:49:39,270 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:49:39,270 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:49:39,270 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 15:49:39,271 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 118327 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 15:49:39,272 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1912): 6acc08707a793e4b75b87ea53367aca6/info is initiating minor compaction (all files) 2023-07-12 15:49:39,272 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6acc08707a793e4b75b87ea53367aca6/info in TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:49:39,272 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/0834ba7bf6664a8e8249af28e1f168df, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/57b7942f0a854f4a8683050f17fc9da9, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/21145751af3641d5b7a5b04d8c851d85] into tmpdir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp, totalSize=115.6 K 2023-07-12 15:49:39,272 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting 0834ba7bf6664a8e8249af28e1f168df, keycount=68, bloomtype=ROW, size=75.2 K, encoding=NONE, compression=NONE, seqNum=169, earliestPutTs=1689176930927 2023-07-12 15:49:39,273 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting 57b7942f0a854f4a8683050f17fc9da9, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=194, earliestPutTs=1689176977179 2023-07-12 15:49:39,273 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting 21145751af3641d5b7a5b04d8c851d85, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=206, earliestPutTs=1689176977216 2023-07-12 15:49:39,290 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6acc08707a793e4b75b87ea53367aca6#info#compaction#35 average throughput is 24.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 15:49:39,309 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/be50fc3533ab4f8f8501af60bb6a4235 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/be50fc3533ab4f8f8501af60bb6a4235 2023-07-12 15:49:39,317 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6acc08707a793e4b75b87ea53367aca6/info of 6acc08707a793e4b75b87ea53367aca6 into be50fc3533ab4f8f8501af60bb6a4235(size=106.1 K), total size for store is 106.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 15:49:39,317 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:49:39,317 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6., storeName=6acc08707a793e4b75b87ea53367aca6/info, priority=13, startTime=1689176979270; duration=0sec 2023-07-12 15:49:39,317 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:49:49,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:49:49,295 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 6acc08707a793e4b75b87ea53367aca6 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-12 15:49:49,313 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=6acc08707a793e4b75b87ea53367aca6, server=jenkins-hbase5.apache.org,44531,1689176907599 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 15:49:49,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] ipc.CallRunner(144): callId: 211 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.10.131:42592 deadline: 1689176999313, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=6acc08707a793e4b75b87ea53367aca6, server=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:49:49,330 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=232 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/a1a30aeb96b64df8bbc89ee3d2323995 2023-07-12 15:49:49,343 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/a1a30aeb96b64df8bbc89ee3d2323995 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/a1a30aeb96b64df8bbc89ee3d2323995 2023-07-12 15:49:49,351 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/a1a30aeb96b64df8bbc89ee3d2323995, entries=22, sequenceid=232, filesize=27.4 K 2023-07-12 15:49:49,352 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=7.18 KB/7357 for 6acc08707a793e4b75b87ea53367aca6 in 57ms, sequenceid=232, compaction requested=false 2023-07-12 15:49:49,352 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:49:59,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:49:59,400 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 6acc08707a793e4b75b87ea53367aca6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-12 15:49:59,411 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=243 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/dfcc98c5ac7041e6b03767e1685c3ea6 2023-07-12 15:49:59,418 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/dfcc98c5ac7041e6b03767e1685c3ea6 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/dfcc98c5ac7041e6b03767e1685c3ea6 2023-07-12 15:49:59,422 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/dfcc98c5ac7041e6b03767e1685c3ea6, entries=8, sequenceid=243, filesize=13.0 K 2023-07-12 15:49:59,423 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=1.03 KB/1051 for 6acc08707a793e4b75b87ea53367aca6 in 23ms, sequenceid=243, compaction requested=true 2023-07-12 15:49:59,423 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:49:59,423 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:49:59,423 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 15:49:59,425 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 150027 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 15:49:59,425 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1912): 6acc08707a793e4b75b87ea53367aca6/info is initiating minor compaction (all files) 2023-07-12 15:49:59,425 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6acc08707a793e4b75b87ea53367aca6/info in TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:49:59,425 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/be50fc3533ab4f8f8501af60bb6a4235, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/a1a30aeb96b64df8bbc89ee3d2323995, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/dfcc98c5ac7041e6b03767e1685c3ea6] into tmpdir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp, totalSize=146.5 K 2023-07-12 15:49:59,425 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting be50fc3533ab4f8f8501af60bb6a4235, keycount=98, bloomtype=ROW, size=106.1 K, encoding=NONE, compression=NONE, seqNum=206, earliestPutTs=1689176930927 2023-07-12 15:49:59,426 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting a1a30aeb96b64df8bbc89ee3d2323995, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=232, earliestPutTs=1689176979233 2023-07-12 15:49:59,426 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting dfcc98c5ac7041e6b03767e1685c3ea6, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=243, earliestPutTs=1689176989297 2023-07-12 15:49:59,440 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6acc08707a793e4b75b87ea53367aca6#info#compaction#38 average throughput is 64.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 15:49:59,855 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/df7bf25b04b741ef91764f6af3d57489 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/df7bf25b04b741ef91764f6af3d57489 2023-07-12 15:49:59,860 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6acc08707a793e4b75b87ea53367aca6/info of 6acc08707a793e4b75b87ea53367aca6 into df7bf25b04b741ef91764f6af3d57489(size=137.3 K), total size for store is 137.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 15:49:59,860 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:49:59,860 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6., storeName=6acc08707a793e4b75b87ea53367aca6/info, priority=13, startTime=1689176999423; duration=0sec 2023-07-12 15:49:59,860 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:50:01,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:50:01,411 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 6acc08707a793e4b75b87ea53367aca6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-12 15:50:01,424 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=255 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/b8a2b98eb3294cc999da9fcdd2284e1c 2023-07-12 15:50:01,430 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/b8a2b98eb3294cc999da9fcdd2284e1c as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b8a2b98eb3294cc999da9fcdd2284e1c 2023-07-12 15:50:01,437 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=6acc08707a793e4b75b87ea53367aca6, server=jenkins-hbase5.apache.org,44531,1689176907599 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 15:50:01,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.10.131:42592 deadline: 1689177011437, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=6acc08707a793e4b75b87ea53367aca6, server=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:50:01,438 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b8a2b98eb3294cc999da9fcdd2284e1c, entries=8, sequenceid=255, filesize=13.0 K 2023-07-12 15:50:01,438 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 6acc08707a793e4b75b87ea53367aca6 in 27ms, sequenceid=255, compaction requested=false 2023-07-12 15:50:01,438 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:50:11,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:50:11,519 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 6acc08707a793e4b75b87ea53367aca6 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-12 15:50:11,535 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=280 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/6b02862202114e1e899a31bfa8e4aad9 2023-07-12 15:50:11,542 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/6b02862202114e1e899a31bfa8e4aad9 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/6b02862202114e1e899a31bfa8e4aad9 2023-07-12 15:50:11,547 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/6b02862202114e1e899a31bfa8e4aad9, entries=22, sequenceid=280, filesize=27.4 K 2023-07-12 15:50:11,548 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=3.08 KB/3153 for 6acc08707a793e4b75b87ea53367aca6 in 29ms, sequenceid=280, compaction requested=true 2023-07-12 15:50:11,548 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:50:11,548 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:50:11,548 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 15:50:11,549 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181945 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 15:50:11,550 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1912): 6acc08707a793e4b75b87ea53367aca6/info is initiating minor compaction (all files) 2023-07-12 15:50:11,550 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6acc08707a793e4b75b87ea53367aca6/info in TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:50:11,550 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/df7bf25b04b741ef91764f6af3d57489, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b8a2b98eb3294cc999da9fcdd2284e1c, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/6b02862202114e1e899a31bfa8e4aad9] into tmpdir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp, totalSize=177.7 K 2023-07-12 15:50:11,550 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting df7bf25b04b741ef91764f6af3d57489, keycount=128, bloomtype=ROW, size=137.3 K, encoding=NONE, compression=NONE, seqNum=243, earliestPutTs=1689176930927 2023-07-12 15:50:11,551 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting b8a2b98eb3294cc999da9fcdd2284e1c, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=255, earliestPutTs=1689176999401 2023-07-12 15:50:11,551 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting 6b02862202114e1e899a31bfa8e4aad9, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=280, earliestPutTs=1689177001412 2023-07-12 15:50:11,565 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6acc08707a793e4b75b87ea53367aca6#info#compaction#41 average throughput is 39.59 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 15:50:11,581 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/2759e112c56a4a2590942b99d9c8758a as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/2759e112c56a4a2590942b99d9c8758a 2023-07-12 15:50:11,587 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6acc08707a793e4b75b87ea53367aca6/info of 6acc08707a793e4b75b87ea53367aca6 into 2759e112c56a4a2590942b99d9c8758a(size=168.3 K), total size for store is 168.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 15:50:11,588 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:50:11,588 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6., storeName=6acc08707a793e4b75b87ea53367aca6/info, priority=13, startTime=1689177011548; duration=0sec 2023-07-12 15:50:11,588 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:50:13,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:50:13,531 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 6acc08707a793e4b75b87ea53367aca6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-12 15:50:13,547 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=292 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/b6d5185cb4634165a2b571c68faec978 2023-07-12 15:50:13,554 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/b6d5185cb4634165a2b571c68faec978 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b6d5185cb4634165a2b571c68faec978 2023-07-12 15:50:13,556 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=6acc08707a793e4b75b87ea53367aca6, server=jenkins-hbase5.apache.org,44531,1689176907599 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 15:50:13,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] ipc.CallRunner(144): callId: 275 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.10.131:42592 deadline: 1689177023556, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=6acc08707a793e4b75b87ea53367aca6, server=jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:50:13,560 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b6d5185cb4634165a2b571c68faec978, entries=8, sequenceid=292, filesize=13.0 K 2023-07-12 15:50:13,561 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 6acc08707a793e4b75b87ea53367aca6 in 30ms, sequenceid=292, compaction requested=false 2023-07-12 15:50:13,561 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:50:23,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44531] regionserver.HRegion(9158): Flush requested on 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:50:23,599 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 6acc08707a793e4b75b87ea53367aca6 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-12 15:50:23,614 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=317 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/bf2009cac2844cf5b611f704a0cd24b2 2023-07-12 15:50:23,627 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/bf2009cac2844cf5b611f704a0cd24b2 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/bf2009cac2844cf5b611f704a0cd24b2 2023-07-12 15:50:23,633 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/bf2009cac2844cf5b611f704a0cd24b2, entries=22, sequenceid=317, filesize=27.4 K 2023-07-12 15:50:23,634 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=5.13 KB/5255 for 6acc08707a793e4b75b87ea53367aca6 in 35ms, sequenceid=317, compaction requested=true 2023-07-12 15:50:23,634 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:50:23,634 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:50:23,634 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-12 15:50:23,635 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 213675 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-12 15:50:23,636 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1912): 6acc08707a793e4b75b87ea53367aca6/info is initiating minor compaction (all files) 2023-07-12 15:50:23,636 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6acc08707a793e4b75b87ea53367aca6/info in TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:50:23,636 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/2759e112c56a4a2590942b99d9c8758a, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b6d5185cb4634165a2b571c68faec978, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/bf2009cac2844cf5b611f704a0cd24b2] into tmpdir=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp, totalSize=208.7 K 2023-07-12 15:50:23,636 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting 2759e112c56a4a2590942b99d9c8758a, keycount=158, bloomtype=ROW, size=168.3 K, encoding=NONE, compression=NONE, seqNum=280, earliestPutTs=1689176930927 2023-07-12 15:50:23,637 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting b6d5185cb4634165a2b571c68faec978, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=292, earliestPutTs=1689177011520 2023-07-12 15:50:23,637 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] compactions.Compactor(207): Compacting bf2009cac2844cf5b611f704a0cd24b2, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=317, earliestPutTs=1689177013532 2023-07-12 15:50:23,649 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6acc08707a793e4b75b87ea53367aca6#info#compaction#44 average throughput is 62.81 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-12 15:50:23,669 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/e632e5c294ce4b78a4258ff7633e7006 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/e632e5c294ce4b78a4258ff7633e7006 2023-07-12 15:50:23,676 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6acc08707a793e4b75b87ea53367aca6/info of 6acc08707a793e4b75b87ea53367aca6 into e632e5c294ce4b78a4258ff7633e7006(size=199.3 K), total size for store is 199.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-12 15:50:23,676 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:50:23,676 INFO [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6., storeName=6acc08707a793e4b75b87ea53367aca6/info, priority=13, startTime=1689177023634; duration=0sec 2023-07-12 15:50:23,676 DEBUG [RS:0;jenkins-hbase5:44531-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-12 15:50:25,608 INFO [Listener at localhost/37417] wal.AbstractTestLogRolling(188): after writing there are 0 log files 2023-07-12 15:50:25,626 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42341,DS-af97e704-7f66-44a9-94cc-53977aa95f8c,DISK] 2023-07-12 15:50:25,626 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39425,DS-14b66fe8-8e0c-4059-8f4c-808d864a480c,DISK] 2023-07-12 15:50:25,630 INFO [Listener at localhost/37417] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599/jenkins-hbase5.apache.org%2C44531%2C1689176907599.1689176908004 with entries=309, filesize=300.61 KB; new WAL /user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599/jenkins-hbase5.apache.org%2C44531%2C1689176907599.1689177025609 2023-07-12 15:50:25,631 DEBUG [Listener at localhost/37417] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42341,DS-af97e704-7f66-44a9-94cc-53977aa95f8c,DISK], DatanodeInfoWithStorage[127.0.0.1:39425,DS-14b66fe8-8e0c-4059-8f4c-808d864a480c,DISK]] 2023-07-12 15:50:25,631 DEBUG [Listener at localhost/37417] wal.AbstractFSWAL(716): hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599/jenkins-hbase5.apache.org%2C44531%2C1689176907599.1689176908004 is not closed yet, will try archiving it next time 2023-07-12 15:50:25,633 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599/jenkins-hbase5.apache.org%2C44531%2C1689176907599.1689176908004 not finished, retry = 0 2023-07-12 15:50:25,636 DEBUG [Listener at localhost/37417] regionserver.HRegion(2446): Flush status journal for 10975ad2c23ad18425c7b83e83947278: 2023-07-12 15:50:25,636 INFO [Listener at localhost/37417] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.26 KB heapSize=4.19 KB 2023-07-12 15:50:25,646 INFO [Listener at localhost/37417] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.26 KB at sequenceid=24 (bloomFilter=false), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/.tmp/info/155ed9ef15d245c29f2b4ffa793666ca 2023-07-12 15:50:25,652 DEBUG [Listener at localhost/37417] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/.tmp/info/155ed9ef15d245c29f2b4ffa793666ca as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/info/155ed9ef15d245c29f2b4ffa793666ca 2023-07-12 15:50:25,657 INFO [Listener at localhost/37417] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/info/155ed9ef15d245c29f2b4ffa793666ca, entries=16, sequenceid=24, filesize=7.0 K 2023-07-12 15:50:25,658 INFO [Listener at localhost/37417] regionserver.HRegion(2948): Finished flush of dataSize ~2.26 KB/2312, heapSize ~3.67 KB/3760, currentSize=0 B/0 for 1588230740 in 22ms, sequenceid=24, compaction requested=false 2023-07-12 15:50:25,658 DEBUG [Listener at localhost/37417] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-07-12 15:50:25,658 INFO [Listener at localhost/37417] regionserver.HRegion(2745): Flushing 6acc08707a793e4b75b87ea53367aca6 1/1 column families, dataSize=5.13 KB heapSize=5.76 KB 2023-07-12 15:50:25,671 INFO [Listener at localhost/37417] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=5.13 KB at sequenceid=326 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/73523d3f260b495ba5f43e8fa1cdd204 2023-07-12 15:50:25,677 DEBUG [Listener at localhost/37417] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/.tmp/info/73523d3f260b495ba5f43e8fa1cdd204 as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/73523d3f260b495ba5f43e8fa1cdd204 2023-07-12 15:50:25,681 INFO [Listener at localhost/37417] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/73523d3f260b495ba5f43e8fa1cdd204, entries=5, sequenceid=326, filesize=9.9 K 2023-07-12 15:50:25,682 INFO [Listener at localhost/37417] regionserver.HRegion(2948): Finished flush of dataSize ~5.13 KB/5255, heapSize ~5.74 KB/5880, currentSize=0 B/0 for 6acc08707a793e4b75b87ea53367aca6 in 24ms, sequenceid=326, compaction requested=false 2023-07-12 15:50:25,682 DEBUG [Listener at localhost/37417] regionserver.HRegion(2446): Flush status journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:50:25,683 INFO [Listener at localhost/37417] regionserver.HRegion(2745): Flushing ecf9cf3b4dd87dee1be11b036411ba1d 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 15:50:25,694 INFO [Listener at localhost/37417] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/namespace/ecf9cf3b4dd87dee1be11b036411ba1d/.tmp/info/5957c0a96f9f4bb6969c2b7d4a9e0dba 2023-07-12 15:50:25,700 DEBUG [Listener at localhost/37417] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/namespace/ecf9cf3b4dd87dee1be11b036411ba1d/.tmp/info/5957c0a96f9f4bb6969c2b7d4a9e0dba as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/namespace/ecf9cf3b4dd87dee1be11b036411ba1d/info/5957c0a96f9f4bb6969c2b7d4a9e0dba 2023-07-12 15:50:25,705 INFO [Listener at localhost/37417] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/namespace/ecf9cf3b4dd87dee1be11b036411ba1d/info/5957c0a96f9f4bb6969c2b7d4a9e0dba, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 15:50:25,705 INFO [Listener at localhost/37417] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ecf9cf3b4dd87dee1be11b036411ba1d in 22ms, sequenceid=6, compaction requested=false 2023-07-12 15:50:25,706 DEBUG [Listener at localhost/37417] regionserver.HRegion(2446): Flush status journal for ecf9cf3b4dd87dee1be11b036411ba1d: 2023-07-12 15:50:25,721 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39425,DS-14b66fe8-8e0c-4059-8f4c-808d864a480c,DISK] 2023-07-12 15:50:25,721 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42341,DS-af97e704-7f66-44a9-94cc-53977aa95f8c,DISK] 2023-07-12 15:50:25,724 INFO [Listener at localhost/37417] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599/jenkins-hbase5.apache.org%2C44531%2C1689176907599.1689177025609 with entries=4, filesize=1.22 KB; new WAL /user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599/jenkins-hbase5.apache.org%2C44531%2C1689176907599.1689177025706 2023-07-12 15:50:25,724 DEBUG [Listener at localhost/37417] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39425,DS-14b66fe8-8e0c-4059-8f4c-808d864a480c,DISK], DatanodeInfoWithStorage[127.0.0.1:42341,DS-af97e704-7f66-44a9-94cc-53977aa95f8c,DISK]] 2023-07-12 15:50:25,725 DEBUG [Listener at localhost/37417] wal.AbstractFSWAL(716): hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599/jenkins-hbase5.apache.org%2C44531%2C1689176907599.1689176908004 is not closed yet, will try archiving it next time 2023-07-12 15:50:25,725 DEBUG [Listener at localhost/37417] wal.AbstractFSWAL(716): hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599/jenkins-hbase5.apache.org%2C44531%2C1689176907599.1689177025609 is not closed yet, will try archiving it next time 2023-07-12 15:50:25,726 INFO [Listener at localhost/37417] hbase.Waiter(180): Waiting up to [5,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 15:50:25,727 DEBUG [Close-WAL-Writer-1] wal.AbstractFSWAL(716): hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599/jenkins-hbase5.apache.org%2C44531%2C1689176907599.1689176908004 is not closed yet, will try archiving it next time 2023-07-12 15:50:25,727 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599/jenkins-hbase5.apache.org%2C44531%2C1689176907599.1689177025609 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/oldWALs/jenkins-hbase5.apache.org%2C44531%2C1689176907599.1689177025609 2023-07-12 15:50:25,734 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/WALs/jenkins-hbase5.apache.org,44531,1689176907599/jenkins-hbase5.apache.org%2C44531%2C1689176907599.1689176908004 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/oldWALs/jenkins-hbase5.apache.org%2C44531%2C1689176907599.1689176908004 2023-07-12 15:50:25,826 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 15:50:25,826 INFO [Listener at localhost/37417] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 15:50:25,826 DEBUG [Listener at localhost/37417] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b1d42c4 to 127.0.0.1:65082 2023-07-12 15:50:25,826 DEBUG [Listener at localhost/37417] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:50:25,826 DEBUG [Listener at localhost/37417] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 15:50:25,826 DEBUG [Listener at localhost/37417] util.JVMClusterUtil(257): Found active master hash=334349016, stopped=false 2023-07-12 15:50:25,827 INFO [Listener at localhost/37417] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase5.apache.org,33705,1689176907556 2023-07-12 15:50:25,828 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 15:50:25,828 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): regionserver:44531-0x101c5d4e96c0001, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 15:50:25,828 INFO [Listener at localhost/37417] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 15:50:25,828 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:50:25,828 DEBUG [Listener at localhost/37417] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19a11e29 to 127.0.0.1:65082 2023-07-12 15:50:25,829 DEBUG [Listener at localhost/37417] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:50:25,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:50:25,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44531-0x101c5d4e96c0001, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:50:25,829 INFO [Listener at localhost/37417] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,44531,1689176907599' ***** 2023-07-12 15:50:25,829 INFO [Listener at localhost/37417] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 15:50:25,830 INFO [RS:0;jenkins-hbase5:44531] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 15:50:25,830 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 15:50:25,830 INFO [RS:0;jenkins-hbase5:44531] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 15:50:25,830 INFO [RS:0;jenkins-hbase5:44531] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 15:50:25,830 INFO [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(3305): Received CLOSE for 10975ad2c23ad18425c7b83e83947278 2023-07-12 15:50:25,830 INFO [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(3305): Received CLOSE for 6acc08707a793e4b75b87ea53367aca6 2023-07-12 15:50:25,830 INFO [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(3305): Received CLOSE for ecf9cf3b4dd87dee1be11b036411ba1d 2023-07-12 15:50:25,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 10975ad2c23ad18425c7b83e83947278, disabling compactions & flushes 2023-07-12 15:50:25,830 INFO [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:50:25,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278. 2023-07-12 15:50:25,830 DEBUG [RS:0;jenkins-hbase5:44531] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28d696de to 127.0.0.1:65082 2023-07-12 15:50:25,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278. 2023-07-12 15:50:25,830 DEBUG [RS:0;jenkins-hbase5:44531] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:50:25,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278. after waiting 0 ms 2023-07-12 15:50:25,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278. 2023-07-12 15:50:25,831 INFO [RS:0;jenkins-hbase5:44531] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 15:50:25,831 INFO [RS:0;jenkins-hbase5:44531] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 15:50:25,831 INFO [RS:0;jenkins-hbase5:44531] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 15:50:25,831 INFO [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 15:50:25,831 INFO [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(1474): Waiting on 4 regions to close 2023-07-12 15:50:25,832 DEBUG [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(1478): Online Regions={10975ad2c23ad18425c7b83e83947278=TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278., 1588230740=hbase:meta,,1.1588230740, 6acc08707a793e4b75b87ea53367aca6=TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6., ecf9cf3b4dd87dee1be11b036411ba1d=hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d.} 2023-07-12 15:50:25,832 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 15:50:25,832 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/10975ad2c23ad18425c7b83e83947278/info/adc82fa39c5941dd80abf17ba0ffbedb.580433e5301d9299b394874c7507a2b3->hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/adc82fa39c5941dd80abf17ba0ffbedb-bottom] to archive 2023-07-12 15:50:25,832 DEBUG [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(1504): Waiting on 10975ad2c23ad18425c7b83e83947278, 1588230740, 6acc08707a793e4b75b87ea53367aca6, ecf9cf3b4dd87dee1be11b036411ba1d 2023-07-12 15:50:25,832 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 15:50:25,833 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 15:50:25,833 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 15:50:25,833 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 15:50:25,836 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 15:50:25,839 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/10975ad2c23ad18425c7b83e83947278/info/adc82fa39c5941dd80abf17ba0ffbedb.580433e5301d9299b394874c7507a2b3 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/10975ad2c23ad18425c7b83e83947278/info/adc82fa39c5941dd80abf17ba0ffbedb.580433e5301d9299b394874c7507a2b3 2023-07-12 15:50:25,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/meta/1588230740/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-07-12 15:50:25,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 15:50:25,843 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 15:50:25,843 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 15:50:25,843 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 15:50:25,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/10975ad2c23ad18425c7b83e83947278/recovered.edits/114.seqid, newMaxSeqId=114, maxSeqId=109 2023-07-12 15:50:25,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278. 2023-07-12 15:50:25,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 10975ad2c23ad18425c7b83e83947278: 2023-07-12 15:50:25,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,,1689176933048.10975ad2c23ad18425c7b83e83947278. 2023-07-12 15:50:25,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 6acc08707a793e4b75b87ea53367aca6, disabling compactions & flushes 2023-07-12 15:50:25,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:50:25,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:50:25,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. after waiting 0 ms 2023-07-12 15:50:25,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:50:25,859 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/adc82fa39c5941dd80abf17ba0ffbedb.580433e5301d9299b394874c7507a2b3->hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/580433e5301d9299b394874c7507a2b3/info/adc82fa39c5941dd80abf17ba0ffbedb-top, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/da97fe831ed34aebb7d1667765c9eb2e, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/TestLogRolling-testLogRolling=580433e5301d9299b394874c7507a2b3-b0c794d6d4034108a213fbe3f2cfa359, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/d383f66a3cff456e849df1600dee2bdd, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/3594e4bfc892407bae5d5e6e5a571b06, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/ba1771f208474f2494f24629748bef78, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b03324f4c3b5414585514b1e6b92bf11, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/0834ba7bf6664a8e8249af28e1f168df, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b4167b4ad7bd44148a19fc107b9e0f99, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/57b7942f0a854f4a8683050f17fc9da9, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/be50fc3533ab4f8f8501af60bb6a4235, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/21145751af3641d5b7a5b04d8c851d85, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/a1a30aeb96b64df8bbc89ee3d2323995, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/df7bf25b04b741ef91764f6af3d57489, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/dfcc98c5ac7041e6b03767e1685c3ea6, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b8a2b98eb3294cc999da9fcdd2284e1c, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/2759e112c56a4a2590942b99d9c8758a, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/6b02862202114e1e899a31bfa8e4aad9, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b6d5185cb4634165a2b571c68faec978, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/bf2009cac2844cf5b611f704a0cd24b2] to archive 2023-07-12 15:50:25,859 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-12 15:50:25,861 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/adc82fa39c5941dd80abf17ba0ffbedb.580433e5301d9299b394874c7507a2b3 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/adc82fa39c5941dd80abf17ba0ffbedb.580433e5301d9299b394874c7507a2b3 2023-07-12 15:50:25,862 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/da97fe831ed34aebb7d1667765c9eb2e to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/da97fe831ed34aebb7d1667765c9eb2e 2023-07-12 15:50:25,864 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/TestLogRolling-testLogRolling=580433e5301d9299b394874c7507a2b3-b0c794d6d4034108a213fbe3f2cfa359 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/TestLogRolling-testLogRolling=580433e5301d9299b394874c7507a2b3-b0c794d6d4034108a213fbe3f2cfa359 2023-07-12 15:50:25,865 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/d383f66a3cff456e849df1600dee2bdd to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/d383f66a3cff456e849df1600dee2bdd 2023-07-12 15:50:25,867 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/3594e4bfc892407bae5d5e6e5a571b06 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/3594e4bfc892407bae5d5e6e5a571b06 2023-07-12 15:50:25,868 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/ba1771f208474f2494f24629748bef78 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/ba1771f208474f2494f24629748bef78 2023-07-12 15:50:25,869 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b03324f4c3b5414585514b1e6b92bf11 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b03324f4c3b5414585514b1e6b92bf11 2023-07-12 15:50:25,871 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/0834ba7bf6664a8e8249af28e1f168df to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/0834ba7bf6664a8e8249af28e1f168df 2023-07-12 15:50:25,872 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b4167b4ad7bd44148a19fc107b9e0f99 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b4167b4ad7bd44148a19fc107b9e0f99 2023-07-12 15:50:25,873 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/57b7942f0a854f4a8683050f17fc9da9 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/57b7942f0a854f4a8683050f17fc9da9 2023-07-12 15:50:25,875 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/be50fc3533ab4f8f8501af60bb6a4235 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/be50fc3533ab4f8f8501af60bb6a4235 2023-07-12 15:50:25,876 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/21145751af3641d5b7a5b04d8c851d85 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/21145751af3641d5b7a5b04d8c851d85 2023-07-12 15:50:25,876 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 15:50:25,879 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/a1a30aeb96b64df8bbc89ee3d2323995 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/a1a30aeb96b64df8bbc89ee3d2323995 2023-07-12 15:50:25,881 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/df7bf25b04b741ef91764f6af3d57489 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/df7bf25b04b741ef91764f6af3d57489 2023-07-12 15:50:25,882 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/dfcc98c5ac7041e6b03767e1685c3ea6 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/dfcc98c5ac7041e6b03767e1685c3ea6 2023-07-12 15:50:25,883 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b8a2b98eb3294cc999da9fcdd2284e1c to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b8a2b98eb3294cc999da9fcdd2284e1c 2023-07-12 15:50:25,885 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/2759e112c56a4a2590942b99d9c8758a to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/2759e112c56a4a2590942b99d9c8758a 2023-07-12 15:50:25,886 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/6b02862202114e1e899a31bfa8e4aad9 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/6b02862202114e1e899a31bfa8e4aad9 2023-07-12 15:50:25,887 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b6d5185cb4634165a2b571c68faec978 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/b6d5185cb4634165a2b571c68faec978 2023-07-12 15:50:25,888 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/bf2009cac2844cf5b611f704a0cd24b2 to hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/archive/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/info/bf2009cac2844cf5b611f704a0cd24b2 2023-07-12 15:50:25,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/default/TestLogRolling-testLogRolling/6acc08707a793e4b75b87ea53367aca6/recovered.edits/329.seqid, newMaxSeqId=329, maxSeqId=109 2023-07-12 15:50:25,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:50:25,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 6acc08707a793e4b75b87ea53367aca6: 2023-07-12 15:50:25,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,row0064,1689176933048.6acc08707a793e4b75b87ea53367aca6. 2023-07-12 15:50:25,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing ecf9cf3b4dd87dee1be11b036411ba1d, disabling compactions & flushes 2023-07-12 15:50:25,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d. 2023-07-12 15:50:25,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d. 2023-07-12 15:50:25,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d. after waiting 0 ms 2023-07-12 15:50:25,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d. 2023-07-12 15:50:25,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/data/hbase/namespace/ecf9cf3b4dd87dee1be11b036411ba1d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 15:50:25,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d. 2023-07-12 15:50:25,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for ecf9cf3b4dd87dee1be11b036411ba1d: 2023-07-12 15:50:25,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689176908246.ecf9cf3b4dd87dee1be11b036411ba1d. 2023-07-12 15:50:25,903 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 15:50:25,904 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 15:50:26,032 INFO [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,44531,1689176907599; all regions closed. 2023-07-12 15:50:26,039 DEBUG [RS:0;jenkins-hbase5:44531] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/oldWALs 2023-07-12 15:50:26,039 INFO [RS:0;jenkins-hbase5:44531] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C44531%2C1689176907599.meta:.meta(num 1689176908188) 2023-07-12 15:50:26,043 DEBUG [RS:0;jenkins-hbase5:44531] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/oldWALs 2023-07-12 15:50:26,044 INFO [RS:0;jenkins-hbase5:44531] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C44531%2C1689176907599:(num 1689177025706) 2023-07-12 15:50:26,044 DEBUG [RS:0;jenkins-hbase5:44531] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:50:26,044 INFO [RS:0;jenkins-hbase5:44531] regionserver.LeaseManager(133): Closed leases 2023-07-12 15:50:26,044 INFO [RS:0;jenkins-hbase5:44531] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 15:50:26,044 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 15:50:26,045 INFO [RS:0;jenkins-hbase5:44531] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:44531 2023-07-12 15:50:26,047 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): regionserver:44531-0x101c5d4e96c0001, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,44531,1689176907599 2023-07-12 15:50:26,047 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 15:50:26,047 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): regionserver:44531-0x101c5d4e96c0001, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 15:50:26,049 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,44531,1689176907599] 2023-07-12 15:50:26,049 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,44531,1689176907599; numProcessing=1 2023-07-12 15:50:26,051 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,44531,1689176907599 already deleted, retry=false 2023-07-12 15:50:26,051 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,44531,1689176907599 expired; onlineServers=0 2023-07-12 15:50:26,051 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,33705,1689176907556' ***** 2023-07-12 15:50:26,051 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 15:50:26,052 DEBUG [M:0;jenkins-hbase5:33705] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17d2547d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 15:50:26,052 INFO [M:0;jenkins-hbase5:33705] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,33705,1689176907556 2023-07-12 15:50:26,052 INFO [M:0;jenkins-hbase5:33705] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,33705,1689176907556; all regions closed. 2023-07-12 15:50:26,052 DEBUG [M:0;jenkins-hbase5:33705] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:50:26,052 DEBUG [M:0;jenkins-hbase5:33705] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 15:50:26,052 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 15:50:26,052 DEBUG [M:0;jenkins-hbase5:33705] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 15:50:26,052 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689176907793] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689176907793,5,FailOnTimeoutGroup] 2023-07-12 15:50:26,052 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689176907793] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689176907793,5,FailOnTimeoutGroup] 2023-07-12 15:50:26,053 INFO [M:0;jenkins-hbase5:33705] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 15:50:26,053 INFO [M:0;jenkins-hbase5:33705] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 15:50:26,054 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 15:50:26,054 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:50:26,054 INFO [M:0;jenkins-hbase5:33705] hbase.ChoreService(369): Chore service for: master/jenkins-hbase5:0 had [] on shutdown 2023-07-12 15:50:26,054 DEBUG [M:0;jenkins-hbase5:33705] master.HMaster(1512): Stopping service threads 2023-07-12 15:50:26,054 INFO [M:0;jenkins-hbase5:33705] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 15:50:26,054 ERROR [M:0;jenkins-hbase5:33705] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 15:50:26,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 15:50:26,054 INFO [M:0;jenkins-hbase5:33705] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 15:50:26,054 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 15:50:26,055 DEBUG [M:0;jenkins-hbase5:33705] zookeeper.ZKUtil(398): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 15:50:26,055 WARN [M:0;jenkins-hbase5:33705] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 15:50:26,055 INFO [M:0;jenkins-hbase5:33705] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 15:50:26,055 INFO [M:0;jenkins-hbase5:33705] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 15:50:26,055 DEBUG [M:0;jenkins-hbase5:33705] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 15:50:26,055 INFO [M:0;jenkins-hbase5:33705] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:50:26,056 DEBUG [M:0;jenkins-hbase5:33705] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:50:26,056 DEBUG [M:0;jenkins-hbase5:33705] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 15:50:26,056 DEBUG [M:0;jenkins-hbase5:33705] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:50:26,056 INFO [M:0;jenkins-hbase5:33705] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=64.71 KB heapSize=78.42 KB 2023-07-12 15:50:26,068 INFO [M:0;jenkins-hbase5:33705] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=64.71 KB at sequenceid=160 (bloomFilter=true), to=hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/235e5c8f485e4f5699c8684fe328745f 2023-07-12 15:50:26,073 INFO [M:0;jenkins-hbase5:33705] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 235e5c8f485e4f5699c8684fe328745f 2023-07-12 15:50:26,074 DEBUG [M:0;jenkins-hbase5:33705] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/235e5c8f485e4f5699c8684fe328745f as hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/235e5c8f485e4f5699c8684fe328745f 2023-07-12 15:50:26,080 INFO [M:0;jenkins-hbase5:33705] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 235e5c8f485e4f5699c8684fe328745f 2023-07-12 15:50:26,080 INFO [M:0;jenkins-hbase5:33705] regionserver.HStore(1080): Added hdfs://localhost:40381/user/jenkins/test-data/86c7a0e6-e23f-00be-fefc-b567f8d6e466/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/235e5c8f485e4f5699c8684fe328745f, entries=18, sequenceid=160, filesize=6.9 K 2023-07-12 15:50:26,081 INFO [M:0;jenkins-hbase5:33705] regionserver.HRegion(2948): Finished flush of dataSize ~64.71 KB/66268, heapSize ~78.41 KB/80288, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=160, compaction requested=false 2023-07-12 15:50:26,082 INFO [M:0;jenkins-hbase5:33705] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:50:26,082 DEBUG [M:0;jenkins-hbase5:33705] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 15:50:26,084 INFO [M:0;jenkins-hbase5:33705] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 15:50:26,084 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 15:50:26,085 INFO [M:0;jenkins-hbase5:33705] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:33705 2023-07-12 15:50:26,086 DEBUG [M:0;jenkins-hbase5:33705] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase5.apache.org,33705,1689176907556 already deleted, retry=false 2023-07-12 15:50:26,150 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): regionserver:44531-0x101c5d4e96c0001, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:50:26,150 INFO [RS:0;jenkins-hbase5:44531] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,44531,1689176907599; zookeeper connection closed. 2023-07-12 15:50:26,150 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): regionserver:44531-0x101c5d4e96c0001, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:50:26,151 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2f3d0a72] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2f3d0a72 2023-07-12 15:50:26,151 INFO [Listener at localhost/37417] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-12 15:50:26,250 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:50:26,250 INFO [M:0;jenkins-hbase5:33705] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,33705,1689176907556; zookeeper connection closed. 2023-07-12 15:50:26,250 DEBUG [Listener at localhost/37417-EventThread] zookeeper.ZKWatcher(600): master:33705-0x101c5d4e96c0000, quorum=127.0.0.1:65082, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:50:26,251 WARN [Listener at localhost/37417] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 15:50:26,269 INFO [Listener at localhost/37417] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:50:26,377 WARN [BP-1001825922-172.31.10.131-1689176906961 heartbeating to localhost/127.0.0.1:40381] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 15:50:26,377 WARN [BP-1001825922-172.31.10.131-1689176906961 heartbeating to localhost/127.0.0.1:40381] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1001825922-172.31.10.131-1689176906961 (Datanode Uuid 972917cc-2723-4c7a-a857-562376940e54) service to localhost/127.0.0.1:40381 2023-07-12 15:50:26,378 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/cluster_1e77dd3a-96b1-d5b3-8229-2c34cc449cae/dfs/data/data3/current/BP-1001825922-172.31.10.131-1689176906961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:50:26,379 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/cluster_1e77dd3a-96b1-d5b3-8229-2c34cc449cae/dfs/data/data4/current/BP-1001825922-172.31.10.131-1689176906961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:50:26,380 WARN [Listener at localhost/37417] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 15:50:26,390 INFO [Listener at localhost/37417] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:50:26,496 WARN [BP-1001825922-172.31.10.131-1689176906961 heartbeating to localhost/127.0.0.1:40381] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 15:50:26,496 WARN [BP-1001825922-172.31.10.131-1689176906961 heartbeating to localhost/127.0.0.1:40381] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1001825922-172.31.10.131-1689176906961 (Datanode Uuid 34cdf8ff-ea7a-46da-92d4-0683002ad106) service to localhost/127.0.0.1:40381 2023-07-12 15:50:26,497 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/cluster_1e77dd3a-96b1-d5b3-8229-2c34cc449cae/dfs/data/data1/current/BP-1001825922-172.31.10.131-1689176906961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:50:26,498 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/cluster_1e77dd3a-96b1-d5b3-8229-2c34cc449cae/dfs/data/data2/current/BP-1001825922-172.31.10.131-1689176906961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:50:26,521 INFO [Listener at localhost/37417] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:50:26,638 INFO [Listener at localhost/37417] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 15:50:26,670 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-12 15:50:26,680 INFO [Listener at localhost/37417] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=75 (was 64) - Thread LEAK? -, OpenFileDescriptor=467 (was 431) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=254 (was 149) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 162) - ProcessCount LEAK? -, AvailableMemoryMB=7199 (was 7620) 2023-07-12 15:50:26,688 INFO [Listener at localhost/37417] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=76, OpenFileDescriptor=467, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=168, AvailableMemoryMB=7199 2023-07-12 15:50:26,688 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 15:50:26,688 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/hadoop.log.dir so I do NOT create it in target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0 2023-07-12 15:50:26,688 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a58a8762-fb42-8c4c-5ec1-5b06e1fd9828/hadoop.tmp.dir so I do NOT create it in target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0 2023-07-12 15:50:26,689 INFO [Listener at localhost/37417] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/cluster_c366e1cf-3707-37ae-18a9-9a4811d70cbb, deleteOnExit=true 2023-07-12 15:50:26,689 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 15:50:26,689 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/test.cache.data in system properties and HBase conf 2023-07-12 15:50:26,689 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 15:50:26,689 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/hadoop.log.dir in system properties and HBase conf 2023-07-12 15:50:26,689 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 15:50:26,689 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 15:50:26,689 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 15:50:26,689 DEBUG [Listener at localhost/37417] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 15:50:26,690 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 15:50:26,690 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 15:50:26,690 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 15:50:26,690 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 15:50:26,690 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 15:50:26,690 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 15:50:26,690 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 15:50:26,690 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 15:50:26,690 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 15:50:26,690 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/nfs.dump.dir in system properties and HBase conf 2023-07-12 15:50:26,691 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/java.io.tmpdir in system properties and HBase conf 2023-07-12 15:50:26,691 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 15:50:26,691 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 15:50:26,691 INFO [Listener at localhost/37417] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 15:50:26,695 WARN [Listener at localhost/37417] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 15:50:26,695 WARN [Listener at localhost/37417] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 15:50:26,737 WARN [Listener at localhost/37417] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:50:26,740 INFO [Listener at localhost/37417] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:50:26,744 INFO [Listener at localhost/37417] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/java.io.tmpdir/Jetty_localhost_43455_hdfs____.kj4voh/webapp 2023-07-12 15:50:26,836 INFO [Listener at localhost/37417] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43455 2023-07-12 15:50:26,841 WARN [Listener at localhost/37417] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 15:50:26,841 WARN [Listener at localhost/37417] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 15:50:26,881 WARN [Listener at localhost/45917] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:50:26,891 WARN [Listener at localhost/45917] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 15:50:26,893 WARN [Listener at localhost/45917] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:50:26,894 INFO [Listener at localhost/45917] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:50:26,901 INFO [Listener at localhost/45917] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/java.io.tmpdir/Jetty_localhost_40585_datanode____.odozs3/webapp 2023-07-12 15:50:26,998 INFO [Listener at localhost/45917] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40585 2023-07-12 15:50:27,005 WARN [Listener at localhost/37365] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:50:27,015 WARN [Listener at localhost/37365] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 15:50:27,017 WARN [Listener at localhost/37365] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 15:50:27,018 INFO [Listener at localhost/37365] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 15:50:27,022 INFO [Listener at localhost/37365] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/java.io.tmpdir/Jetty_localhost_44115_datanode____.sbo5j8/webapp 2023-07-12 15:50:27,094 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe79e7b04d97d90c1: Processing first storage report for DS-3589ca35-f549-46d4-b6a9-99ef506bb2c3 from datanode 100fe648-f40c-44e2-bea6-4da036022604 2023-07-12 15:50:27,094 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe79e7b04d97d90c1: from storage DS-3589ca35-f549-46d4-b6a9-99ef506bb2c3 node DatanodeRegistration(127.0.0.1:36653, datanodeUuid=100fe648-f40c-44e2-bea6-4da036022604, infoPort=43331, infoSecurePort=0, ipcPort=37365, storageInfo=lv=-57;cid=testClusterID;nsid=1756379093;c=1689177026698), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:50:27,094 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe79e7b04d97d90c1: Processing first storage report for DS-bc198a99-0240-4fc6-887f-626ffe7c0f6b from datanode 100fe648-f40c-44e2-bea6-4da036022604 2023-07-12 15:50:27,094 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe79e7b04d97d90c1: from storage DS-bc198a99-0240-4fc6-887f-626ffe7c0f6b node DatanodeRegistration(127.0.0.1:36653, datanodeUuid=100fe648-f40c-44e2-bea6-4da036022604, infoPort=43331, infoSecurePort=0, ipcPort=37365, storageInfo=lv=-57;cid=testClusterID;nsid=1756379093;c=1689177026698), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:50:27,119 INFO [Listener at localhost/37365] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44115 2023-07-12 15:50:27,125 WARN [Listener at localhost/46273] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 15:50:27,212 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x790933ed92b58b11: Processing first storage report for DS-2af13a30-d868-4172-8f70-0a3c536e5bc9 from datanode de693c04-b85b-4f13-bf6a-332fd369e5c1 2023-07-12 15:50:27,212 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x790933ed92b58b11: from storage DS-2af13a30-d868-4172-8f70-0a3c536e5bc9 node DatanodeRegistration(127.0.0.1:43449, datanodeUuid=de693c04-b85b-4f13-bf6a-332fd369e5c1, infoPort=37109, infoSecurePort=0, ipcPort=46273, storageInfo=lv=-57;cid=testClusterID;nsid=1756379093;c=1689177026698), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:50:27,212 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x790933ed92b58b11: Processing first storage report for DS-b15c9513-34ae-4df2-bca6-303a4b7062e8 from datanode de693c04-b85b-4f13-bf6a-332fd369e5c1 2023-07-12 15:50:27,212 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x790933ed92b58b11: from storage DS-b15c9513-34ae-4df2-bca6-303a4b7062e8 node DatanodeRegistration(127.0.0.1:43449, datanodeUuid=de693c04-b85b-4f13-bf6a-332fd369e5c1, infoPort=37109, infoSecurePort=0, ipcPort=46273, storageInfo=lv=-57;cid=testClusterID;nsid=1756379093;c=1689177026698), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 15:50:27,231 DEBUG [Listener at localhost/46273] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0 2023-07-12 15:50:27,233 INFO [Listener at localhost/46273] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/cluster_c366e1cf-3707-37ae-18a9-9a4811d70cbb/zookeeper_0, clientPort=61817, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/cluster_c366e1cf-3707-37ae-18a9-9a4811d70cbb/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/cluster_c366e1cf-3707-37ae-18a9-9a4811d70cbb/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 15:50:27,235 INFO [Listener at localhost/46273] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61817 2023-07-12 15:50:27,235 INFO [Listener at localhost/46273] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:50:27,236 INFO [Listener at localhost/46273] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:50:27,249 INFO [Listener at localhost/46273] util.FSUtils(471): Created version file at hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1 with version=8 2023-07-12 15:50:27,249 INFO [Listener at localhost/46273] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:35925/user/jenkins/test-data/d339b649-e24b-a072-e2c0-6dbd32febbee/hbase-staging 2023-07-12 15:50:27,251 INFO [Listener at localhost/46273] client.ConnectionUtils(127): master/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 15:50:27,251 INFO [Listener at localhost/46273] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:50:27,251 INFO [Listener at localhost/46273] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 15:50:27,251 INFO [Listener at localhost/46273] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 15:50:27,251 INFO [Listener at localhost/46273] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:50:27,251 INFO [Listener at localhost/46273] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 15:50:27,252 INFO [Listener at localhost/46273] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 15:50:27,253 INFO [Listener at localhost/46273] ipc.NettyRpcServer(120): Bind to /172.31.10.131:33533 2023-07-12 15:50:27,253 INFO [Listener at localhost/46273] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:50:27,254 INFO [Listener at localhost/46273] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:50:27,255 INFO [Listener at localhost/46273] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33533 connecting to ZooKeeper ensemble=127.0.0.1:61817 2023-07-12 15:50:27,263 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:335330x0, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 15:50:27,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33533-0x101c5d6bcfd0000 connected 2023-07-12 15:50:27,276 DEBUG [Listener at localhost/46273] zookeeper.ZKUtil(164): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 15:50:27,276 DEBUG [Listener at localhost/46273] zookeeper.ZKUtil(164): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:50:27,276 DEBUG [Listener at localhost/46273] zookeeper.ZKUtil(164): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 15:50:27,277 DEBUG [Listener at localhost/46273] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33533 2023-07-12 15:50:27,277 DEBUG [Listener at localhost/46273] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33533 2023-07-12 15:50:27,277 DEBUG [Listener at localhost/46273] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33533 2023-07-12 15:50:27,277 DEBUG [Listener at localhost/46273] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33533 2023-07-12 15:50:27,278 DEBUG [Listener at localhost/46273] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33533 2023-07-12 15:50:27,278 INFO [Listener at localhost/46273] master.HMaster(444): hbase.rootdir=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1, hbase.cluster.distributed=false 2023-07-12 15:50:27,292 INFO [Listener at localhost/46273] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 15:50:27,293 INFO [Listener at localhost/46273] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:50:27,293 INFO [Listener at localhost/46273] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 15:50:27,293 INFO [Listener at localhost/46273] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 15:50:27,293 INFO [Listener at localhost/46273] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 15:50:27,293 INFO [Listener at localhost/46273] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 15:50:27,293 INFO [Listener at localhost/46273] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 15:50:27,295 INFO [Listener at localhost/46273] ipc.NettyRpcServer(120): Bind to /172.31.10.131:35447 2023-07-12 15:50:27,296 INFO [Listener at localhost/46273] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 15:50:27,296 DEBUG [Listener at localhost/46273] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 15:50:27,297 INFO [Listener at localhost/46273] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:50:27,298 INFO [Listener at localhost/46273] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:50:27,299 INFO [Listener at localhost/46273] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35447 connecting to ZooKeeper ensemble=127.0.0.1:61817 2023-07-12 15:50:27,303 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): regionserver:354470x0, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 15:50:27,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35447-0x101c5d6bcfd0001 connected 2023-07-12 15:50:27,305 DEBUG [Listener at localhost/46273] zookeeper.ZKUtil(164): regionserver:35447-0x101c5d6bcfd0001, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 15:50:27,305 DEBUG [Listener at localhost/46273] zookeeper.ZKUtil(164): regionserver:35447-0x101c5d6bcfd0001, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:50:27,306 DEBUG [Listener at localhost/46273] zookeeper.ZKUtil(164): regionserver:35447-0x101c5d6bcfd0001, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 15:50:27,307 DEBUG [Listener at localhost/46273] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35447 2023-07-12 15:50:27,307 DEBUG [Listener at localhost/46273] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35447 2023-07-12 15:50:27,307 DEBUG [Listener at localhost/46273] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35447 2023-07-12 15:50:27,307 DEBUG [Listener at localhost/46273] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35447 2023-07-12 15:50:27,308 DEBUG [Listener at localhost/46273] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35447 2023-07-12 15:50:27,311 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase5.apache.org,33533,1689177027251 2023-07-12 15:50:27,313 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 15:50:27,313 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase5.apache.org,33533,1689177027251 2023-07-12 15:50:27,314 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): regionserver:35447-0x101c5d6bcfd0001, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 15:50:27,314 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 15:50:27,315 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:50:27,315 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 15:50:27,316 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase5.apache.org,33533,1689177027251 from backup master directory 2023-07-12 15:50:27,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 15:50:27,317 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase5.apache.org,33533,1689177027251 2023-07-12 15:50:27,317 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 15:50:27,317 WARN [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 15:50:27,317 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase5.apache.org,33533,1689177027251 2023-07-12 15:50:27,330 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/hbase.id with ID: cdbd1395-78c0-407b-8895-9ceba72bc9fc 2023-07-12 15:50:27,340 INFO [master/jenkins-hbase5:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:50:27,344 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:50:27,353 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4e49cb05 to 127.0.0.1:61817 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 15:50:27,356 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17da3e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 15:50:27,357 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 15:50:27,357 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 15:50:27,357 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 15:50:27,358 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/MasterData/data/master/store-tmp 2023-07-12 15:50:27,366 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:50:27,366 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 15:50:27,366 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:50:27,366 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:50:27,366 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 15:50:27,366 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:50:27,366 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:50:27,366 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 15:50:27,367 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/MasterData/WALs/jenkins-hbase5.apache.org,33533,1689177027251 2023-07-12 15:50:27,369 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C33533%2C1689177027251, suffix=, logDir=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/MasterData/WALs/jenkins-hbase5.apache.org,33533,1689177027251, archiveDir=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/MasterData/oldWALs, maxLogs=10 2023-07-12 15:50:27,384 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36653,DS-3589ca35-f549-46d4-b6a9-99ef506bb2c3,DISK] 2023-07-12 15:50:27,384 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43449,DS-2af13a30-d868-4172-8f70-0a3c536e5bc9,DISK] 2023-07-12 15:50:27,386 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/MasterData/WALs/jenkins-hbase5.apache.org,33533,1689177027251/jenkins-hbase5.apache.org%2C33533%2C1689177027251.1689177027369 2023-07-12 15:50:27,386 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36653,DS-3589ca35-f549-46d4-b6a9-99ef506bb2c3,DISK], DatanodeInfoWithStorage[127.0.0.1:43449,DS-2af13a30-d868-4172-8f70-0a3c536e5bc9,DISK]] 2023-07-12 15:50:27,386 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 15:50:27,386 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:50:27,386 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:50:27,386 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:50:27,388 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:50:27,389 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 15:50:27,390 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 15:50:27,390 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:50:27,391 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:50:27,391 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:50:27,394 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 15:50:27,395 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 15:50:27,396 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=712278, jitterRate=-0.09429287910461426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 15:50:27,396 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 15:50:27,396 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 15:50:27,397 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 15:50:27,397 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 15:50:27,397 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 15:50:27,397 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 15:50:27,398 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-07-12 15:50:27,398 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 15:50:27,399 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 15:50:27,399 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 15:50:27,409 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 15:50:27,410 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 15:50:27,410 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 15:50:27,410 INFO [master/jenkins-hbase5:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 15:50:27,410 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 15:50:27,412 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:50:27,413 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 15:50:27,413 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 15:50:27,414 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 15:50:27,415 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 15:50:27,415 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): regionserver:35447-0x101c5d6bcfd0001, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 15:50:27,415 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:50:27,415 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase5.apache.org,33533,1689177027251, sessionid=0x101c5d6bcfd0000, setting cluster-up flag (Was=false) 2023-07-12 15:50:27,419 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:50:27,424 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 15:50:27,425 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,33533,1689177027251 2023-07-12 15:50:27,428 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:50:27,433 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 15:50:27,433 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,33533,1689177027251 2023-07-12 15:50:27,434 WARN [master/jenkins-hbase5:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/.hbase-snapshot/.tmp 2023-07-12 15:50:27,435 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 15:50:27,436 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:50:27,436 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:50:27,436 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:50:27,436 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 15:50:27,436 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase5:0, corePoolSize=10, maxPoolSize=10 2023-07-12 15:50:27,436 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:50:27,436 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 15:50:27,436 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:50:27,437 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689177057437 2023-07-12 15:50:27,437 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 15:50:27,437 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 15:50:27,438 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 15:50:27,438 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 15:50:27,438 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 15:50:27,438 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 15:50:27,438 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 15:50:27,438 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 15:50:27,438 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 15:50:27,438 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 15:50:27,438 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 15:50:27,439 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 15:50:27,439 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 15:50:27,439 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 15:50:27,439 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689177027439,5,FailOnTimeoutGroup] 2023-07-12 15:50:27,439 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 15:50:27,439 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689177027439,5,FailOnTimeoutGroup] 2023-07-12 15:50:27,440 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 15:50:27,440 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 15:50:27,440 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 15:50:27,440 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 15:50:27,449 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 15:50:27,450 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 15:50:27,450 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1 2023-07-12 15:50:27,461 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:50:27,462 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 15:50:27,464 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/info 2023-07-12 15:50:27,464 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 15:50:27,464 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:50:27,465 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 15:50:27,466 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/rep_barrier 2023-07-12 15:50:27,466 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 15:50:27,467 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:50:27,467 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 15:50:27,468 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/table 2023-07-12 15:50:27,468 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 15:50:27,469 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:50:27,469 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740 2023-07-12 15:50:27,470 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740 2023-07-12 15:50:27,472 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-12 15:50:27,473 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 15:50:27,476 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 15:50:27,476 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=781055, jitterRate=-0.006837904453277588}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-12 15:50:27,476 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 15:50:27,476 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 15:50:27,476 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 15:50:27,476 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 15:50:27,476 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 15:50:27,477 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 15:50:27,477 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 15:50:27,477 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 15:50:27,478 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 15:50:27,478 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 15:50:27,478 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 15:50:27,479 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 15:50:27,481 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 15:50:27,510 INFO [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(951): ClusterId : cdbd1395-78c0-407b-8895-9ceba72bc9fc 2023-07-12 15:50:27,510 DEBUG [RS:0;jenkins-hbase5:35447] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 15:50:27,512 DEBUG [RS:0;jenkins-hbase5:35447] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 15:50:27,512 DEBUG [RS:0;jenkins-hbase5:35447] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 15:50:27,514 DEBUG [RS:0;jenkins-hbase5:35447] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 15:50:27,515 DEBUG [RS:0;jenkins-hbase5:35447] zookeeper.ReadOnlyZKClient(139): Connect 0x65529ca6 to 127.0.0.1:61817 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 15:50:27,520 DEBUG [RS:0;jenkins-hbase5:35447] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b957e7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 15:50:27,520 DEBUG [RS:0;jenkins-hbase5:35447] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6faaf7d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 15:50:27,529 DEBUG [RS:0;jenkins-hbase5:35447] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase5:35447 2023-07-12 15:50:27,529 INFO [RS:0;jenkins-hbase5:35447] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 15:50:27,529 INFO [RS:0;jenkins-hbase5:35447] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 15:50:27,529 DEBUG [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 15:50:27,529 INFO [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,33533,1689177027251 with isa=jenkins-hbase5.apache.org/172.31.10.131:35447, startcode=1689177027292 2023-07-12 15:50:27,530 DEBUG [RS:0;jenkins-hbase5:35447] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 15:50:27,532 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:59339, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 15:50:27,533 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33533] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,35447,1689177027292 2023-07-12 15:50:27,533 DEBUG [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1 2023-07-12 15:50:27,533 DEBUG [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45917 2023-07-12 15:50:27,533 DEBUG [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 15:50:27,534 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 15:50:27,535 DEBUG [RS:0;jenkins-hbase5:35447] zookeeper.ZKUtil(162): regionserver:35447-0x101c5d6bcfd0001, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,35447,1689177027292 2023-07-12 15:50:27,535 WARN [RS:0;jenkins-hbase5:35447] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 15:50:27,535 INFO [RS:0;jenkins-hbase5:35447] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 15:50:27,535 DEBUG [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/WALs/jenkins-hbase5.apache.org,35447,1689177027292 2023-07-12 15:50:27,536 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,35447,1689177027292] 2023-07-12 15:50:27,539 DEBUG [RS:0;jenkins-hbase5:35447] zookeeper.ZKUtil(162): regionserver:35447-0x101c5d6bcfd0001, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,35447,1689177027292 2023-07-12 15:50:27,540 DEBUG [RS:0;jenkins-hbase5:35447] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 15:50:27,540 INFO [RS:0;jenkins-hbase5:35447] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 15:50:27,541 INFO [RS:0;jenkins-hbase5:35447] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 15:50:27,542 INFO [RS:0;jenkins-hbase5:35447] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 15:50:27,542 INFO [RS:0;jenkins-hbase5:35447] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 15:50:27,542 INFO [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 15:50:27,543 INFO [RS:0;jenkins-hbase5:35447] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 15:50:27,543 DEBUG [RS:0;jenkins-hbase5:35447] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:50:27,543 DEBUG [RS:0;jenkins-hbase5:35447] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:50:27,543 DEBUG [RS:0;jenkins-hbase5:35447] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:50:27,543 DEBUG [RS:0;jenkins-hbase5:35447] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:50:27,544 DEBUG [RS:0;jenkins-hbase5:35447] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:50:27,544 DEBUG [RS:0;jenkins-hbase5:35447] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 15:50:27,544 DEBUG [RS:0;jenkins-hbase5:35447] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:50:27,544 DEBUG [RS:0;jenkins-hbase5:35447] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:50:27,544 DEBUG [RS:0;jenkins-hbase5:35447] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:50:27,544 DEBUG [RS:0;jenkins-hbase5:35447] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 15:50:27,544 INFO [RS:0;jenkins-hbase5:35447] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 15:50:27,544 INFO [RS:0;jenkins-hbase5:35447] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 15:50:27,545 INFO [RS:0;jenkins-hbase5:35447] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 15:50:27,556 INFO [RS:0;jenkins-hbase5:35447] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 15:50:27,556 INFO [RS:0;jenkins-hbase5:35447] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,35447,1689177027292-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 15:50:27,567 INFO [RS:0;jenkins-hbase5:35447] regionserver.Replication(203): jenkins-hbase5.apache.org,35447,1689177027292 started 2023-07-12 15:50:27,567 INFO [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,35447,1689177027292, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:35447, sessionid=0x101c5d6bcfd0001 2023-07-12 15:50:27,567 DEBUG [RS:0;jenkins-hbase5:35447] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 15:50:27,567 DEBUG [RS:0;jenkins-hbase5:35447] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,35447,1689177027292 2023-07-12 15:50:27,567 DEBUG [RS:0;jenkins-hbase5:35447] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,35447,1689177027292' 2023-07-12 15:50:27,567 DEBUG [RS:0;jenkins-hbase5:35447] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 15:50:27,568 DEBUG [RS:0;jenkins-hbase5:35447] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 15:50:27,568 DEBUG [RS:0;jenkins-hbase5:35447] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 15:50:27,568 DEBUG [RS:0;jenkins-hbase5:35447] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 15:50:27,568 DEBUG [RS:0;jenkins-hbase5:35447] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,35447,1689177027292 2023-07-12 15:50:27,568 DEBUG [RS:0;jenkins-hbase5:35447] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,35447,1689177027292' 2023-07-12 15:50:27,568 DEBUG [RS:0;jenkins-hbase5:35447] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 15:50:27,569 DEBUG [RS:0;jenkins-hbase5:35447] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 15:50:27,569 DEBUG [RS:0;jenkins-hbase5:35447] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 15:50:27,569 INFO [RS:0;jenkins-hbase5:35447] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 15:50:27,569 INFO [RS:0;jenkins-hbase5:35447] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 15:50:27,631 DEBUG [jenkins-hbase5:33533] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-12 15:50:27,632 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,35447,1689177027292, state=OPENING 2023-07-12 15:50:27,633 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 15:50:27,634 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:50:27,635 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 15:50:27,635 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,35447,1689177027292}] 2023-07-12 15:50:27,671 INFO [RS:0;jenkins-hbase5:35447] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C35447%2C1689177027292, suffix=, logDir=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/WALs/jenkins-hbase5.apache.org,35447,1689177027292, archiveDir=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/oldWALs, maxLogs=32 2023-07-12 15:50:27,687 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36653,DS-3589ca35-f549-46d4-b6a9-99ef506bb2c3,DISK] 2023-07-12 15:50:27,687 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43449,DS-2af13a30-d868-4172-8f70-0a3c536e5bc9,DISK] 2023-07-12 15:50:27,689 INFO [RS:0;jenkins-hbase5:35447] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/WALs/jenkins-hbase5.apache.org,35447,1689177027292/jenkins-hbase5.apache.org%2C35447%2C1689177027292.1689177027672 2023-07-12 15:50:27,690 DEBUG [RS:0;jenkins-hbase5:35447] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36653,DS-3589ca35-f549-46d4-b6a9-99ef506bb2c3,DISK], DatanodeInfoWithStorage[127.0.0.1:43449,DS-2af13a30-d868-4172-8f70-0a3c536e5bc9,DISK]] 2023-07-12 15:50:27,789 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,35447,1689177027292 2023-07-12 15:50:27,789 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 15:50:27,791 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:49136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 15:50:27,795 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 15:50:27,795 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 15:50:27,797 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C35447%2C1689177027292.meta, suffix=.meta, logDir=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/WALs/jenkins-hbase5.apache.org,35447,1689177027292, archiveDir=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/oldWALs, maxLogs=32 2023-07-12 15:50:27,812 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36653,DS-3589ca35-f549-46d4-b6a9-99ef506bb2c3,DISK] 2023-07-12 15:50:27,813 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43449,DS-2af13a30-d868-4172-8f70-0a3c536e5bc9,DISK] 2023-07-12 15:50:27,816 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/WALs/jenkins-hbase5.apache.org,35447,1689177027292/jenkins-hbase5.apache.org%2C35447%2C1689177027292.meta.1689177027797.meta 2023-07-12 15:50:27,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36653,DS-3589ca35-f549-46d4-b6a9-99ef506bb2c3,DISK], DatanodeInfoWithStorage[127.0.0.1:43449,DS-2af13a30-d868-4172-8f70-0a3c536e5bc9,DISK]] 2023-07-12 15:50:27,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 15:50:27,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 15:50:27,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 15:50:27,818 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 15:50:27,818 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 15:50:27,818 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:50:27,818 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 15:50:27,818 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 15:50:27,819 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 15:50:27,820 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/info 2023-07-12 15:50:27,820 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/info 2023-07-12 15:50:27,820 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 15:50:27,821 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:50:27,821 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 15:50:27,822 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/rep_barrier 2023-07-12 15:50:27,822 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/rep_barrier 2023-07-12 15:50:27,822 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 15:50:27,823 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:50:27,823 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 15:50:27,824 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/table 2023-07-12 15:50:27,824 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/table 2023-07-12 15:50:27,824 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 15:50:27,825 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:50:27,825 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740 2023-07-12 15:50:27,827 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740 2023-07-12 15:50:27,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-12 15:50:27,830 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 15:50:27,831 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=772614, jitterRate=-0.017571717500686646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-12 15:50:27,831 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 15:50:27,831 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689177027789 2023-07-12 15:50:27,835 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 15:50:27,836 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 15:50:27,836 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,35447,1689177027292, state=OPEN 2023-07-12 15:50:27,839 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 15:50:27,839 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 15:50:27,840 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 15:50:27,840 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,35447,1689177027292 in 204 msec 2023-07-12 15:50:27,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 15:50:27,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 362 msec 2023-07-12 15:50:27,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 407 msec 2023-07-12 15:50:27,843 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689177027843, completionTime=-1 2023-07-12 15:50:27,844 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-12 15:50:27,844 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 15:50:27,846 DEBUG [hconnection-0x31ea275d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 15:50:27,848 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:49148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 15:50:27,849 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-12 15:50:27,849 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689177087849 2023-07-12 15:50:27,849 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689177147849 2023-07-12 15:50:27,849 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-07-12 15:50:27,855 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,33533,1689177027251-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 15:50:27,855 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,33533,1689177027251-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 15:50:27,855 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,33533,1689177027251-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 15:50:27,855 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase5:33533, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 15:50:27,855 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 15:50:27,855 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 15:50:27,855 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 15:50:27,856 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 15:50:27,856 DEBUG [master/jenkins-hbase5:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 15:50:27,857 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 15:50:27,858 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 15:50:27,859 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/.tmp/data/hbase/namespace/c23b25fe2a9c74c9fd87bb9dd733b6e8 2023-07-12 15:50:27,860 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/.tmp/data/hbase/namespace/c23b25fe2a9c74c9fd87bb9dd733b6e8 empty. 2023-07-12 15:50:27,860 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/.tmp/data/hbase/namespace/c23b25fe2a9c74c9fd87bb9dd733b6e8 2023-07-12 15:50:27,860 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 15:50:27,871 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 15:50:27,873 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c23b25fe2a9c74c9fd87bb9dd733b6e8, NAME => 'hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/.tmp 2023-07-12 15:50:27,882 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:50:27,882 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c23b25fe2a9c74c9fd87bb9dd733b6e8, disabling compactions & flushes 2023-07-12 15:50:27,882 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8. 2023-07-12 15:50:27,882 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8. 2023-07-12 15:50:27,882 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8. after waiting 0 ms 2023-07-12 15:50:27,882 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8. 2023-07-12 15:50:27,882 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8. 2023-07-12 15:50:27,882 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c23b25fe2a9c74c9fd87bb9dd733b6e8: 2023-07-12 15:50:27,885 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 15:50:27,886 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689177027886"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689177027886"}]},"ts":"1689177027886"} 2023-07-12 15:50:27,887 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 15:50:27,888 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 15:50:27,888 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689177027888"}]},"ts":"1689177027888"} 2023-07-12 15:50:27,889 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 15:50:27,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c23b25fe2a9c74c9fd87bb9dd733b6e8, ASSIGN}] 2023-07-12 15:50:27,897 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c23b25fe2a9c74c9fd87bb9dd733b6e8, ASSIGN 2023-07-12 15:50:27,898 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c23b25fe2a9c74c9fd87bb9dd733b6e8, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,35447,1689177027292; forceNewPlan=false, retain=false 2023-07-12 15:50:28,049 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c23b25fe2a9c74c9fd87bb9dd733b6e8, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,35447,1689177027292 2023-07-12 15:50:28,049 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689177028049"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689177028049"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689177028049"}]},"ts":"1689177028049"} 2023-07-12 15:50:28,051 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c23b25fe2a9c74c9fd87bb9dd733b6e8, server=jenkins-hbase5.apache.org,35447,1689177027292}] 2023-07-12 15:50:28,206 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8. 2023-07-12 15:50:28,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c23b25fe2a9c74c9fd87bb9dd733b6e8, NAME => 'hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8.', STARTKEY => '', ENDKEY => ''} 2023-07-12 15:50:28,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c23b25fe2a9c74c9fd87bb9dd733b6e8 2023-07-12 15:50:28,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 15:50:28,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for c23b25fe2a9c74c9fd87bb9dd733b6e8 2023-07-12 15:50:28,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for c23b25fe2a9c74c9fd87bb9dd733b6e8 2023-07-12 15:50:28,208 INFO [StoreOpener-c23b25fe2a9c74c9fd87bb9dd733b6e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c23b25fe2a9c74c9fd87bb9dd733b6e8 2023-07-12 15:50:28,209 DEBUG [StoreOpener-c23b25fe2a9c74c9fd87bb9dd733b6e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/namespace/c23b25fe2a9c74c9fd87bb9dd733b6e8/info 2023-07-12 15:50:28,209 DEBUG [StoreOpener-c23b25fe2a9c74c9fd87bb9dd733b6e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/namespace/c23b25fe2a9c74c9fd87bb9dd733b6e8/info 2023-07-12 15:50:28,209 INFO [StoreOpener-c23b25fe2a9c74c9fd87bb9dd733b6e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c23b25fe2a9c74c9fd87bb9dd733b6e8 columnFamilyName info 2023-07-12 15:50:28,210 INFO [StoreOpener-c23b25fe2a9c74c9fd87bb9dd733b6e8-1] regionserver.HStore(310): Store=c23b25fe2a9c74c9fd87bb9dd733b6e8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 15:50:28,211 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/namespace/c23b25fe2a9c74c9fd87bb9dd733b6e8 2023-07-12 15:50:28,211 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/namespace/c23b25fe2a9c74c9fd87bb9dd733b6e8 2023-07-12 15:50:28,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for c23b25fe2a9c74c9fd87bb9dd733b6e8 2023-07-12 15:50:28,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/namespace/c23b25fe2a9c74c9fd87bb9dd733b6e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 15:50:28,216 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened c23b25fe2a9c74c9fd87bb9dd733b6e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=706867, jitterRate=-0.10117296874523163}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 15:50:28,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for c23b25fe2a9c74c9fd87bb9dd733b6e8: 2023-07-12 15:50:28,266 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8., pid=6, masterSystemTime=1689177028202 2023-07-12 15:50:28,269 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8. 2023-07-12 15:50:28,269 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8. 2023-07-12 15:50:28,270 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c23b25fe2a9c74c9fd87bb9dd733b6e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,35447,1689177027292 2023-07-12 15:50:28,270 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689177028270"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689177028270"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689177028270"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689177028270"}]},"ts":"1689177028270"} 2023-07-12 15:50:28,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 15:50:28,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c23b25fe2a9c74c9fd87bb9dd733b6e8, server=jenkins-hbase5.apache.org,35447,1689177027292 in 220 msec 2023-07-12 15:50:28,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 15:50:28,275 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c23b25fe2a9c74c9fd87bb9dd733b6e8, ASSIGN in 378 msec 2023-07-12 15:50:28,275 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 15:50:28,276 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689177028276"}]},"ts":"1689177028276"} 2023-07-12 15:50:28,277 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 15:50:28,279 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 15:50:28,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 424 msec 2023-07-12 15:50:28,365 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 15:50:28,367 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 15:50:28,367 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:50:28,371 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 15:50:28,378 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 15:50:28,381 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-07-12 15:50:28,382 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 15:50:28,391 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 15:50:28,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-07-12 15:50:28,407 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 15:50:28,409 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 15:50:28,409 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.092sec 2023-07-12 15:50:28,409 INFO [master/jenkins-hbase5:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 15:50:28,409 INFO [master/jenkins-hbase5:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 15:50:28,409 INFO [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 15:50:28,409 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,33533,1689177027251-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 15:50:28,409 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,33533,1689177027251-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 15:50:28,410 DEBUG [Listener at localhost/46273] zookeeper.ReadOnlyZKClient(139): Connect 0x4f3ed0c0 to 127.0.0.1:61817 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 15:50:28,411 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 15:50:28,417 DEBUG [Listener at localhost/46273] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24b64cda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 15:50:28,419 DEBUG [hconnection-0x2fe8bb08-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 15:50:28,420 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:49162, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 15:50:28,422 INFO [Listener at localhost/46273] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase5.apache.org,33533,1689177027251 2023-07-12 15:50:28,422 INFO [Listener at localhost/46273] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 15:50:28,425 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-12 15:50:28,425 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:50:28,425 INFO [Listener at localhost/46273] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-12 15:50:28,425 INFO [Listener at localhost/46273] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 15:50:28,428 INFO [Listener at localhost/46273] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=test.com%2C8080%2C1, suffix=, logDir=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/WALs/test.com,8080,1, archiveDir=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/oldWALs, maxLogs=32 2023-07-12 15:50:28,443 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43449,DS-2af13a30-d868-4172-8f70-0a3c536e5bc9,DISK] 2023-07-12 15:50:28,443 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36653,DS-3589ca35-f549-46d4-b6a9-99ef506bb2c3,DISK] 2023-07-12 15:50:28,445 INFO [Listener at localhost/46273] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/WALs/test.com,8080,1/test.com%2C8080%2C1.1689177028428 2023-07-12 15:50:28,445 DEBUG [Listener at localhost/46273] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43449,DS-2af13a30-d868-4172-8f70-0a3c536e5bc9,DISK], DatanodeInfoWithStorage[127.0.0.1:36653,DS-3589ca35-f549-46d4-b6a9-99ef506bb2c3,DISK]] 2023-07-12 15:50:28,459 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36653,DS-3589ca35-f549-46d4-b6a9-99ef506bb2c3,DISK] 2023-07-12 15:50:28,460 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43449,DS-2af13a30-d868-4172-8f70-0a3c536e5bc9,DISK] 2023-07-12 15:50:28,461 INFO [Listener at localhost/46273] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/WALs/test.com,8080,1/test.com%2C8080%2C1.1689177028428 with entries=0, filesize=83 B; new WAL /user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/WALs/test.com,8080,1/test.com%2C8080%2C1.1689177028445 2023-07-12 15:50:28,461 DEBUG [Listener at localhost/46273] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36653,DS-3589ca35-f549-46d4-b6a9-99ef506bb2c3,DISK], DatanodeInfoWithStorage[127.0.0.1:43449,DS-2af13a30-d868-4172-8f70-0a3c536e5bc9,DISK]] 2023-07-12 15:50:28,461 DEBUG [Listener at localhost/46273] wal.AbstractFSWAL(716): hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/WALs/test.com,8080,1/test.com%2C8080%2C1.1689177028428 is not closed yet, will try archiving it next time 2023-07-12 15:50:28,467 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/WALs/test.com,8080,1/test.com%2C8080%2C1.1689177028428 to hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/oldWALs/test.com%2C8080%2C1.1689177028428 2023-07-12 15:50:28,470 DEBUG [Listener at localhost/46273] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/oldWALs 2023-07-12 15:50:28,470 INFO [Listener at localhost/46273] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL test.com%2C8080%2C1:(num 1689177028445) 2023-07-12 15:50:28,470 INFO [Listener at localhost/46273] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 15:50:28,470 DEBUG [Listener at localhost/46273] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f3ed0c0 to 127.0.0.1:61817 2023-07-12 15:50:28,470 DEBUG [Listener at localhost/46273] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:50:28,471 DEBUG [Listener at localhost/46273] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 15:50:28,471 DEBUG [Listener at localhost/46273] util.JVMClusterUtil(257): Found active master hash=1488729287, stopped=false 2023-07-12 15:50:28,471 INFO [Listener at localhost/46273] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase5.apache.org,33533,1689177027251 2023-07-12 15:50:28,473 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): regionserver:35447-0x101c5d6bcfd0001, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 15:50:28,474 INFO [Listener at localhost/46273] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 15:50:28,473 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 15:50:28,474 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:50:28,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35447-0x101c5d6bcfd0001, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:50:28,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 15:50:28,475 DEBUG [Listener at localhost/46273] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e49cb05 to 127.0.0.1:61817 2023-07-12 15:50:28,475 DEBUG [Listener at localhost/46273] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:50:28,475 INFO [Listener at localhost/46273] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,35447,1689177027292' ***** 2023-07-12 15:50:28,475 INFO [Listener at localhost/46273] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 15:50:28,483 INFO [RS:0;jenkins-hbase5:35447] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 15:50:28,483 INFO [RS:0;jenkins-hbase5:35447] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 15:50:28,483 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 15:50:28,483 INFO [RS:0;jenkins-hbase5:35447] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 15:50:28,484 INFO [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(3305): Received CLOSE for c23b25fe2a9c74c9fd87bb9dd733b6e8 2023-07-12 15:50:28,484 INFO [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,35447,1689177027292 2023-07-12 15:50:28,484 DEBUG [RS:0;jenkins-hbase5:35447] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65529ca6 to 127.0.0.1:61817 2023-07-12 15:50:28,484 DEBUG [RS:0;jenkins-hbase5:35447] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:50:28,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing c23b25fe2a9c74c9fd87bb9dd733b6e8, disabling compactions & flushes 2023-07-12 15:50:28,485 INFO [RS:0;jenkins-hbase5:35447] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 15:50:28,485 INFO [RS:0;jenkins-hbase5:35447] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 15:50:28,485 INFO [RS:0;jenkins-hbase5:35447] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 15:50:28,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8. 2023-07-12 15:50:28,485 INFO [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 15:50:28,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8. 2023-07-12 15:50:28,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8. after waiting 0 ms 2023-07-12 15:50:28,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8. 2023-07-12 15:50:28,485 INFO [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-12 15:50:28,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing c23b25fe2a9c74c9fd87bb9dd733b6e8 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 15:50:28,486 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 15:50:28,485 DEBUG [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, c23b25fe2a9c74c9fd87bb9dd733b6e8=hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8.} 2023-07-12 15:50:28,486 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 15:50:28,486 DEBUG [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(1504): Waiting on 1588230740, c23b25fe2a9c74c9fd87bb9dd733b6e8 2023-07-12 15:50:28,486 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 15:50:28,486 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 15:50:28,486 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 15:50:28,486 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=1.26 KB heapSize=2.89 KB 2023-07-12 15:50:28,505 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.17 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/.tmp/info/a18b6a4b7fd64fe38adbc2929334c042 2023-07-12 15:50:28,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/namespace/c23b25fe2a9c74c9fd87bb9dd733b6e8/.tmp/info/d463084c21834e668945fffd19c3eebb 2023-07-12 15:50:28,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/namespace/c23b25fe2a9c74c9fd87bb9dd733b6e8/.tmp/info/d463084c21834e668945fffd19c3eebb as hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/namespace/c23b25fe2a9c74c9fd87bb9dd733b6e8/info/d463084c21834e668945fffd19c3eebb 2023-07-12 15:50:28,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/namespace/c23b25fe2a9c74c9fd87bb9dd733b6e8/info/d463084c21834e668945fffd19c3eebb, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 15:50:28,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c23b25fe2a9c74c9fd87bb9dd733b6e8 in 46ms, sequenceid=6, compaction requested=false 2023-07-12 15:50:28,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 15:50:28,534 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=94 B at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/.tmp/table/06a9adde419e4eca98a8cb6b6e1ce418 2023-07-12 15:50:28,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/namespace/c23b25fe2a9c74c9fd87bb9dd733b6e8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 15:50:28,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8. 2023-07-12 15:50:28,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for c23b25fe2a9c74c9fd87bb9dd733b6e8: 2023-07-12 15:50:28,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689177027855.c23b25fe2a9c74c9fd87bb9dd733b6e8. 2023-07-12 15:50:28,539 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/.tmp/info/a18b6a4b7fd64fe38adbc2929334c042 as hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/info/a18b6a4b7fd64fe38adbc2929334c042 2023-07-12 15:50:28,544 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/info/a18b6a4b7fd64fe38adbc2929334c042, entries=10, sequenceid=9, filesize=5.9 K 2023-07-12 15:50:28,545 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 15:50:28,545 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 15:50:28,545 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/.tmp/table/06a9adde419e4eca98a8cb6b6e1ce418 as hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/table/06a9adde419e4eca98a8cb6b6e1ce418 2023-07-12 15:50:28,550 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/table/06a9adde419e4eca98a8cb6b6e1ce418, entries=2, sequenceid=9, filesize=4.7 K 2023-07-12 15:50:28,551 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.26 KB/1290, heapSize ~2.61 KB/2672, currentSize=0 B/0 for 1588230740 in 65ms, sequenceid=9, compaction requested=false 2023-07-12 15:50:28,551 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 15:50:28,558 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/data/hbase/meta/1588230740/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-07-12 15:50:28,558 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 15:50:28,559 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 15:50:28,559 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 15:50:28,559 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 15:50:28,686 INFO [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,35447,1689177027292; all regions closed. 2023-07-12 15:50:28,691 DEBUG [RS:0;jenkins-hbase5:35447] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/oldWALs 2023-07-12 15:50:28,691 INFO [RS:0;jenkins-hbase5:35447] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C35447%2C1689177027292.meta:.meta(num 1689177027797) 2023-07-12 15:50:28,696 DEBUG [RS:0;jenkins-hbase5:35447] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/oldWALs 2023-07-12 15:50:28,696 INFO [RS:0;jenkins-hbase5:35447] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C35447%2C1689177027292:(num 1689177027672) 2023-07-12 15:50:28,696 DEBUG [RS:0;jenkins-hbase5:35447] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:50:28,696 INFO [RS:0;jenkins-hbase5:35447] regionserver.LeaseManager(133): Closed leases 2023-07-12 15:50:28,696 INFO [RS:0;jenkins-hbase5:35447] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 15:50:28,696 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 15:50:28,697 INFO [RS:0;jenkins-hbase5:35447] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:35447 2023-07-12 15:50:28,699 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): regionserver:35447-0x101c5d6bcfd0001, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,35447,1689177027292 2023-07-12 15:50:28,699 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 15:50:28,699 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): regionserver:35447-0x101c5d6bcfd0001, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 15:50:28,702 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,35447,1689177027292] 2023-07-12 15:50:28,702 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,35447,1689177027292; numProcessing=1 2023-07-12 15:50:28,703 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,35447,1689177027292 already deleted, retry=false 2023-07-12 15:50:28,703 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,35447,1689177027292 expired; onlineServers=0 2023-07-12 15:50:28,703 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,33533,1689177027251' ***** 2023-07-12 15:50:28,703 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 15:50:28,704 DEBUG [M:0;jenkins-hbase5:33533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c83bb08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 15:50:28,704 INFO [M:0;jenkins-hbase5:33533] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,33533,1689177027251 2023-07-12 15:50:28,704 INFO [M:0;jenkins-hbase5:33533] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,33533,1689177027251; all regions closed. 2023-07-12 15:50:28,704 DEBUG [M:0;jenkins-hbase5:33533] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 15:50:28,704 DEBUG [M:0;jenkins-hbase5:33533] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 15:50:28,704 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 15:50:28,704 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689177027439] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689177027439,5,FailOnTimeoutGroup] 2023-07-12 15:50:28,704 DEBUG [M:0;jenkins-hbase5:33533] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 15:50:28,704 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689177027439] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689177027439,5,FailOnTimeoutGroup] 2023-07-12 15:50:28,705 INFO [M:0;jenkins-hbase5:33533] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 15:50:28,705 INFO [M:0;jenkins-hbase5:33533] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 15:50:28,705 INFO [M:0;jenkins-hbase5:33533] hbase.ChoreService(369): Chore service for: master/jenkins-hbase5:0 had [] on shutdown 2023-07-12 15:50:28,705 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 15:50:28,705 DEBUG [M:0;jenkins-hbase5:33533] master.HMaster(1512): Stopping service threads 2023-07-12 15:50:28,705 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 15:50:28,705 INFO [M:0;jenkins-hbase5:33533] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 15:50:28,705 ERROR [M:0;jenkins-hbase5:33533] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-7,5,PEWorkerGroup] 2023-07-12 15:50:28,706 INFO [M:0;jenkins-hbase5:33533] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 15:50:28,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 15:50:28,706 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 15:50:28,706 DEBUG [M:0;jenkins-hbase5:33533] zookeeper.ZKUtil(398): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 15:50:28,706 WARN [M:0;jenkins-hbase5:33533] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 15:50:28,706 INFO [M:0;jenkins-hbase5:33533] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 15:50:28,706 INFO [M:0;jenkins-hbase5:33533] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 15:50:28,707 DEBUG [M:0;jenkins-hbase5:33533] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 15:50:28,707 INFO [M:0;jenkins-hbase5:33533] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:50:28,707 DEBUG [M:0;jenkins-hbase5:33533] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:50:28,707 DEBUG [M:0;jenkins-hbase5:33533] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 15:50:28,707 DEBUG [M:0;jenkins-hbase5:33533] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:50:28,707 INFO [M:0;jenkins-hbase5:33533] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=24.07 KB heapSize=29.55 KB 2023-07-12 15:50:28,717 INFO [M:0;jenkins-hbase5:33533] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24.07 KB at sequenceid=66 (bloomFilter=true), to=hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5039afcd4b504f65a458671ab4f0fcc4 2023-07-12 15:50:28,722 DEBUG [M:0;jenkins-hbase5:33533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5039afcd4b504f65a458671ab4f0fcc4 as hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5039afcd4b504f65a458671ab4f0fcc4 2023-07-12 15:50:28,726 INFO [M:0;jenkins-hbase5:33533] regionserver.HStore(1080): Added hdfs://localhost:45917/user/jenkins/test-data/ec2936ab-cb63-df65-77bc-9beac69da5c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5039afcd4b504f65a458671ab4f0fcc4, entries=8, sequenceid=66, filesize=6.3 K 2023-07-12 15:50:28,726 INFO [M:0;jenkins-hbase5:33533] regionserver.HRegion(2948): Finished flush of dataSize ~24.07 KB/24646, heapSize ~29.54 KB/30248, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=66, compaction requested=false 2023-07-12 15:50:28,728 INFO [M:0;jenkins-hbase5:33533] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 15:50:28,728 DEBUG [M:0;jenkins-hbase5:33533] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 15:50:28,731 INFO [M:0;jenkins-hbase5:33533] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 15:50:28,731 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 15:50:28,732 INFO [M:0;jenkins-hbase5:33533] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:33533 2023-07-12 15:50:28,734 DEBUG [M:0;jenkins-hbase5:33533] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase5.apache.org,33533,1689177027251 already deleted, retry=false 2023-07-12 15:50:28,874 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:50:28,874 INFO [M:0;jenkins-hbase5:33533] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,33533,1689177027251; zookeeper connection closed. 2023-07-12 15:50:28,874 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): master:33533-0x101c5d6bcfd0000, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:50:28,974 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): regionserver:35447-0x101c5d6bcfd0001, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:50:28,974 INFO [RS:0;jenkins-hbase5:35447] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,35447,1689177027292; zookeeper connection closed. 2023-07-12 15:50:28,974 DEBUG [Listener at localhost/46273-EventThread] zookeeper.ZKWatcher(600): regionserver:35447-0x101c5d6bcfd0001, quorum=127.0.0.1:61817, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 15:50:28,976 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@cbf9d68] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@cbf9d68 2023-07-12 15:50:28,976 INFO [Listener at localhost/46273] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-12 15:50:28,976 WARN [Listener at localhost/46273] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 15:50:28,980 INFO [Listener at localhost/46273] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:50:29,083 WARN [BP-38657776-172.31.10.131-1689177026698 heartbeating to localhost/127.0.0.1:45917] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 15:50:29,083 WARN [BP-38657776-172.31.10.131-1689177026698 heartbeating to localhost/127.0.0.1:45917] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-38657776-172.31.10.131-1689177026698 (Datanode Uuid de693c04-b85b-4f13-bf6a-332fd369e5c1) service to localhost/127.0.0.1:45917 2023-07-12 15:50:29,084 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/cluster_c366e1cf-3707-37ae-18a9-9a4811d70cbb/dfs/data/data3/current/BP-38657776-172.31.10.131-1689177026698] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:50:29,084 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/cluster_c366e1cf-3707-37ae-18a9-9a4811d70cbb/dfs/data/data4/current/BP-38657776-172.31.10.131-1689177026698] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:50:29,085 WARN [Listener at localhost/46273] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 15:50:29,089 INFO [Listener at localhost/46273] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:50:29,193 WARN [BP-38657776-172.31.10.131-1689177026698 heartbeating to localhost/127.0.0.1:45917] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 15:50:29,193 WARN [BP-38657776-172.31.10.131-1689177026698 heartbeating to localhost/127.0.0.1:45917] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-38657776-172.31.10.131-1689177026698 (Datanode Uuid 100fe648-f40c-44e2-bea6-4da036022604) service to localhost/127.0.0.1:45917 2023-07-12 15:50:29,194 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/cluster_c366e1cf-3707-37ae-18a9-9a4811d70cbb/dfs/data/data1/current/BP-38657776-172.31.10.131-1689177026698] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:50:29,194 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a27be850-fd80-eb04-4de8-6c50c21ec7b0/cluster_c366e1cf-3707-37ae-18a9-9a4811d70cbb/dfs/data/data2/current/BP-38657776-172.31.10.131-1689177026698] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 15:50:29,206 INFO [Listener at localhost/46273] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 15:50:29,318 INFO [Listener at localhost/46273] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 15:50:29,330 INFO [Listener at localhost/46273] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-12 15:50:29,340 INFO [Listener at localhost/46273] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=101 (was 76) - Thread LEAK? -, OpenFileDescriptor=494 (was 467) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=243 (was 254), ProcessCount=168 (was 168), AvailableMemoryMB=7111 (was 7199)