2023-08-11 04:58:08,251 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c 2023-08-11 04:58:08,265 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRolling timeout: 13 mins 2023-08-11 04:58:08,298 INFO [Time-limited test] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=155, ProcessCount=171, AvailableMemoryMB=3857 2023-08-11 04:58:08,305 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-11 04:58:08,305 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6, deleteOnExit=true 2023-08-11 04:58:08,305 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-11 04:58:08,306 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/test.cache.data in system properties and HBase conf 2023-08-11 04:58:08,306 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/hadoop.tmp.dir in system properties and HBase conf 2023-08-11 04:58:08,307 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/hadoop.log.dir in system properties and HBase conf 2023-08-11 04:58:08,307 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-11 04:58:08,308 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-11 04:58:08,308 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-11 04:58:08,415 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-08-11 04:58:08,807 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-11 04:58:08,811 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-11 04:58:08,811 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-11 04:58:08,811 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-11 04:58:08,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 04:58:08,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-11 04:58:08,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-11 04:58:08,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 04:58:08,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 04:58:08,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-11 04:58:08,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/nfs.dump.dir in system properties and HBase conf 2023-08-11 04:58:08,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/java.io.tmpdir in system properties and HBase conf 2023-08-11 04:58:08,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 04:58:08,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-11 04:58:08,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-11 04:58:09,273 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 04:58:09,277 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 04:58:09,552 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-08-11 04:58:09,699 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-08-11 04:58:09,713 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 04:58:09,746 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 04:58:09,777 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/java.io.tmpdir/Jetty_localhost_42111_hdfs____.e1b2ir/webapp 2023-08-11 04:58:09,913 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42111 2023-08-11 04:58:09,930 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 04:58:09,931 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 04:58:10,431 WARN [Listener at localhost/44477] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 04:58:10,499 WARN [Listener at localhost/44477] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 04:58:10,522 WARN [Listener at localhost/44477] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 04:58:10,530 INFO [Listener at localhost/44477] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 04:58:10,538 INFO [Listener at localhost/44477] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/java.io.tmpdir/Jetty_localhost_35393_datanode____4k9ob6/webapp 2023-08-11 04:58:10,635 INFO [Listener at localhost/44477] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35393 2023-08-11 04:58:10,931 WARN [Listener at localhost/35627] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 04:58:10,940 WARN [Listener at localhost/35627] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 04:58:10,946 WARN [Listener at localhost/35627] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 04:58:10,948 INFO [Listener at localhost/35627] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 04:58:10,953 INFO [Listener at localhost/35627] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/java.io.tmpdir/Jetty_localhost_37505_datanode____w1yb5p/webapp 2023-08-11 04:58:11,056 INFO [Listener at localhost/35627] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37505 2023-08-11 04:58:11,066 WARN [Listener at localhost/35373] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 04:58:11,375 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf77f2b95d7b567b3: Processing first storage report for DS-def6050f-4460-4eb9-825b-6eab5a5058ae from datanode 99bdefbb-b4e1-4adc-b539-94618afaeb4d 2023-08-11 04:58:11,376 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf77f2b95d7b567b3: from storage DS-def6050f-4460-4eb9-825b-6eab5a5058ae node DatanodeRegistration(127.0.0.1:42957, datanodeUuid=99bdefbb-b4e1-4adc-b539-94618afaeb4d, infoPort=46847, infoSecurePort=0, ipcPort=35373, storageInfo=lv=-57;cid=testClusterID;nsid=1994267679;c=1691729889350), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-11 04:58:11,376 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1078bf49d3b37328: Processing first storage report for DS-6b5c55ca-1c75-4b8f-b8ae-d04a11e18b63 from datanode 637f416b-844a-4ee5-8d7d-d4ca4477246a 2023-08-11 04:58:11,376 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1078bf49d3b37328: from storage DS-6b5c55ca-1c75-4b8f-b8ae-d04a11e18b63 node DatanodeRegistration(127.0.0.1:42169, datanodeUuid=637f416b-844a-4ee5-8d7d-d4ca4477246a, infoPort=33257, infoSecurePort=0, ipcPort=35627, storageInfo=lv=-57;cid=testClusterID;nsid=1994267679;c=1691729889350), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-11 04:58:11,377 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf77f2b95d7b567b3: Processing first storage report for DS-3bb53c54-a0f1-41ef-be12-b19347b13803 from datanode 99bdefbb-b4e1-4adc-b539-94618afaeb4d 2023-08-11 04:58:11,377 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf77f2b95d7b567b3: from storage DS-3bb53c54-a0f1-41ef-be12-b19347b13803 node DatanodeRegistration(127.0.0.1:42957, datanodeUuid=99bdefbb-b4e1-4adc-b539-94618afaeb4d, infoPort=46847, infoSecurePort=0, ipcPort=35373, storageInfo=lv=-57;cid=testClusterID;nsid=1994267679;c=1691729889350), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 04:58:11,377 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1078bf49d3b37328: Processing first storage report for DS-b7856275-b4a3-4dfb-9879-fc42d6c915dd from datanode 637f416b-844a-4ee5-8d7d-d4ca4477246a 2023-08-11 04:58:11,377 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1078bf49d3b37328: from storage DS-b7856275-b4a3-4dfb-9879-fc42d6c915dd node DatanodeRegistration(127.0.0.1:42169, datanodeUuid=637f416b-844a-4ee5-8d7d-d4ca4477246a, infoPort=33257, infoSecurePort=0, ipcPort=35627, storageInfo=lv=-57;cid=testClusterID;nsid=1994267679;c=1691729889350), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 04:58:11,445 DEBUG [Listener at localhost/35373] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c 2023-08-11 04:58:11,507 INFO [Listener at localhost/35373] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6/zookeeper_0, clientPort=52221, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-11 04:58:11,523 INFO [Listener at localhost/35373] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52221 2023-08-11 04:58:11,530 INFO [Listener at localhost/35373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:11,532 INFO [Listener at localhost/35373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:12,195 INFO [Listener at localhost/35373] util.FSUtils(471): Created version file at hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256 with version=8 2023-08-11 04:58:12,195 INFO [Listener at localhost/35373] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/hbase-staging 2023-08-11 04:58:12,511 INFO [Listener at localhost/35373] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-08-11 04:58:13,015 INFO [Listener at localhost/35373] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 04:58:13,048 INFO [Listener at localhost/35373] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 04:58:13,048 INFO [Listener at localhost/35373] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 04:58:13,049 INFO [Listener at localhost/35373] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 04:58:13,049 INFO [Listener at localhost/35373] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 04:58:13,049 INFO [Listener at localhost/35373] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 04:58:13,190 INFO [Listener at localhost/35373] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 04:58:13,269 DEBUG [Listener at localhost/35373] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-08-11 04:58:13,364 INFO [Listener at localhost/35373] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38633 2023-08-11 04:58:13,374 INFO [Listener at localhost/35373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:13,376 INFO [Listener at localhost/35373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:13,396 INFO [Listener at localhost/35373] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38633 connecting to ZooKeeper ensemble=127.0.0.1:52221 2023-08-11 04:58:13,440 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:386330x0, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 04:58:13,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38633-0x101f26413a70000 connected 2023-08-11 04:58:13,469 DEBUG [Listener at localhost/35373] zookeeper.ZKUtil(164): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 04:58:13,470 DEBUG [Listener at localhost/35373] zookeeper.ZKUtil(164): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 04:58:13,473 DEBUG [Listener at localhost/35373] zookeeper.ZKUtil(164): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 04:58:13,482 DEBUG [Listener at localhost/35373] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38633 2023-08-11 04:58:13,483 DEBUG [Listener at localhost/35373] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38633 2023-08-11 04:58:13,483 DEBUG [Listener at localhost/35373] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38633 2023-08-11 04:58:13,484 DEBUG [Listener at localhost/35373] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38633 2023-08-11 04:58:13,484 DEBUG [Listener at localhost/35373] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38633 2023-08-11 04:58:13,490 INFO [Listener at localhost/35373] master.HMaster(444): hbase.rootdir=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256, hbase.cluster.distributed=false 2023-08-11 04:58:13,555 INFO [Listener at localhost/35373] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 04:58:13,556 INFO [Listener at localhost/35373] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 04:58:13,556 INFO [Listener at localhost/35373] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 04:58:13,556 INFO [Listener at localhost/35373] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 04:58:13,556 INFO [Listener at localhost/35373] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 04:58:13,556 INFO [Listener at localhost/35373] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 04:58:13,561 INFO [Listener at localhost/35373] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 04:58:13,563 INFO [Listener at localhost/35373] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35925 2023-08-11 04:58:13,566 INFO [Listener at localhost/35373] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-11 04:58:13,572 DEBUG [Listener at localhost/35373] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-11 04:58:13,573 INFO [Listener at localhost/35373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:13,575 INFO [Listener at localhost/35373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:13,576 INFO [Listener at localhost/35373] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35925 connecting to ZooKeeper ensemble=127.0.0.1:52221 2023-08-11 04:58:13,580 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): regionserver:359250x0, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 04:58:13,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35925-0x101f26413a70001 connected 2023-08-11 04:58:13,581 DEBUG [Listener at localhost/35373] zookeeper.ZKUtil(164): regionserver:35925-0x101f26413a70001, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 04:58:13,582 DEBUG [Listener at localhost/35373] zookeeper.ZKUtil(164): regionserver:35925-0x101f26413a70001, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 04:58:13,583 DEBUG [Listener at localhost/35373] zookeeper.ZKUtil(164): regionserver:35925-0x101f26413a70001, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 04:58:13,583 DEBUG [Listener at localhost/35373] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35925 2023-08-11 04:58:13,584 DEBUG [Listener at localhost/35373] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35925 2023-08-11 04:58:13,584 DEBUG [Listener at localhost/35373] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35925 2023-08-11 04:58:13,585 DEBUG [Listener at localhost/35373] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35925 2023-08-11 04:58:13,585 DEBUG [Listener at localhost/35373] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35925 2023-08-11 04:58:13,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38633,1691729892345 2023-08-11 04:58:13,596 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 04:58:13,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38633,1691729892345 2023-08-11 04:58:13,616 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): regionserver:35925-0x101f26413a70001, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 04:58:13,616 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 04:58:13,617 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:13,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 04:58:13,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38633,1691729892345 from backup master directory 2023-08-11 04:58:13,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 04:58:13,621 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38633,1691729892345 2023-08-11 04:58:13,621 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 04:58:13,622 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 04:58:13,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38633,1691729892345 2023-08-11 04:58:13,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-08-11 04:58:13,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-08-11 04:58:13,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/hbase.id with ID: f606a2cf-4c31-4ffc-bdf5-fbaa7ba4844b 2023-08-11 04:58:13,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:13,767 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:13,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x52431596 to 127.0.0.1:52221 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 04:58:13,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b1cc008, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 04:58:13,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-11 04:58:13,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-11 04:58:13,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 04:58:13,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/data/master/store-tmp 2023-08-11 04:58:13,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:13,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 04:58:13,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:58:13,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:58:13,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 04:58:13,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:58:13,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:58:13,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 04:58:13,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/WALs/jenkins-hbase4.apache.org,38633,1691729892345 2023-08-11 04:58:13,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38633%2C1691729892345, suffix=, logDir=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/WALs/jenkins-hbase4.apache.org,38633,1691729892345, archiveDir=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/oldWALs, maxLogs=10 2023-08-11 04:58:14,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-08-11 04:58:14,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-08-11 04:58:14,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:53) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:190) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:116) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:719) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:128) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:881) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:574) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.init(AbstractFSWAL.java:515) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:160) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:295) at org.apache.hadoop.hbase.master.region.MasterRegion.createWAL(MasterRegion.java:200) at org.apache.hadoop.hbase.master.region.MasterRegion.bootstrap(MasterRegion.java:220) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:348) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:14,034 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:417) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:14,036 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42957,DS-def6050f-4460-4eb9-825b-6eab5a5058ae,DISK] 2023-08-11 04:58:14,036 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42169,DS-6b5c55ca-1c75-4b8f-b8ae-d04a11e18b63,DISK] 2023-08-11 04:58:14,043 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:14,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/WALs/jenkins-hbase4.apache.org,38633,1691729892345/jenkins-hbase4.apache.org%2C38633%2C1691729892345.1691729893979 2023-08-11 04:58:14,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42169,DS-6b5c55ca-1c75-4b8f-b8ae-d04a11e18b63,DISK], DatanodeInfoWithStorage[127.0.0.1:42957,DS-def6050f-4460-4eb9-825b-6eab5a5058ae,DISK]] 2023-08-11 04:58:14,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-11 04:58:14,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:14,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:58:14,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:58:14,167 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:58:14,174 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-11 04:58:14,204 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-11 04:58:14,218 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:14,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:58:14,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:58:14,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:58:14,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 04:58:14,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=737744, jitterRate=-0.061910420656204224}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 04:58:14,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 04:58:14,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-11 04:58:14,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-11 04:58:14,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-11 04:58:14,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-11 04:58:14,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-08-11 04:58:14,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 33 msec 2023-08-11 04:58:14,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-11 04:58:14,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-11 04:58:14,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-11 04:58:14,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-11 04:58:14,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-11 04:58:14,368 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-11 04:58:14,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-11 04:58:14,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-11 04:58:14,380 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:14,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-11 04:58:14,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-11 04:58:14,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-11 04:58:14,397 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 04:58:14,397 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): regionserver:35925-0x101f26413a70001, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 04:58:14,397 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:14,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38633,1691729892345, sessionid=0x101f26413a70000, setting cluster-up flag (Was=false) 2023-08-11 04:58:14,414 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:14,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-11 04:58:14,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38633,1691729892345 2023-08-11 04:58:14,426 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:14,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-11 04:58:14,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38633,1691729892345 2023-08-11 04:58:14,437 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/.hbase-snapshot/.tmp 2023-08-11 04:58:14,489 INFO [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(951): ClusterId : f606a2cf-4c31-4ffc-bdf5-fbaa7ba4844b 2023-08-11 04:58:14,494 DEBUG [RS:0;jenkins-hbase4:35925] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-11 04:58:14,499 DEBUG [RS:0;jenkins-hbase4:35925] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-11 04:58:14,499 DEBUG [RS:0;jenkins-hbase4:35925] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-11 04:58:14,502 DEBUG [RS:0;jenkins-hbase4:35925] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-11 04:58:14,503 DEBUG [RS:0;jenkins-hbase4:35925] zookeeper.ReadOnlyZKClient(139): Connect 0x1db5f065 to 127.0.0.1:52221 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 04:58:14,507 DEBUG [RS:0;jenkins-hbase4:35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13721da3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 04:58:14,508 DEBUG [RS:0;jenkins-hbase4:35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@174d9b15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 04:58:14,539 DEBUG [RS:0;jenkins-hbase4:35925] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35925 2023-08-11 04:58:14,542 INFO [RS:0;jenkins-hbase4:35925] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-11 04:58:14,543 INFO [RS:0;jenkins-hbase4:35925] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-11 04:58:14,543 DEBUG [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(1022): About to register with Master. 2023-08-11 04:58:14,545 INFO [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38633,1691729892345 with isa=jenkins-hbase4.apache.org/172.31.14.131:35925, startcode=1691729893554 2023-08-11 04:58:14,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-11 04:58:14,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 04:58:14,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 04:58:14,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 04:58:14,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 04:58:14,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-11 04:58:14,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:14,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 04:58:14,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:14,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1691729924561 2023-08-11 04:58:14,561 DEBUG [RS:0;jenkins-hbase4:35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-11 04:58:14,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-11 04:58:14,567 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 04:58:14,567 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-11 04:58:14,572 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 04:58:14,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-11 04:58:14,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-11 04:58:14,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-11 04:58:14,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-11 04:58:14,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-11 04:58:14,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:14,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-11 04:58:14,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-11 04:58:14,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-11 04:58:14,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-11 04:58:14,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-11 04:58:14,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691729894597,5,FailOnTimeoutGroup] 2023-08-11 04:58:14,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691729894599,5,FailOnTimeoutGroup] 2023-08-11 04:58:14,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:14,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-11 04:58:14,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:14,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:14,614 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 04:58:14,616 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 04:58:14,616 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256 2023-08-11 04:58:14,631 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52145, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-08-11 04:58:14,636 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:14,643 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 04:58:14,646 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/info 2023-08-11 04:58:14,647 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38633] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35925,1691729893554 2023-08-11 04:58:14,647 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 04:58:14,648 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:14,648 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 04:58:14,651 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/rep_barrier 2023-08-11 04:58:14,652 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 04:58:14,653 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:14,653 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 04:58:14,655 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/table 2023-08-11 04:58:14,656 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 04:58:14,656 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:14,658 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740 2023-08-11 04:58:14,659 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740 2023-08-11 04:58:14,663 DEBUG [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256 2023-08-11 04:58:14,663 DEBUG [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44477 2023-08-11 04:58:14,663 DEBUG [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-11 04:58:14,663 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 04:58:14,666 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 04:58:14,670 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 04:58:14,670 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 04:58:14,671 DEBUG [RS:0;jenkins-hbase4:35925] zookeeper.ZKUtil(162): regionserver:35925-0x101f26413a70001, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35925,1691729893554 2023-08-11 04:58:14,671 WARN [RS:0;jenkins-hbase4:35925] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 04:58:14,671 INFO [RS:0;jenkins-hbase4:35925] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 04:58:14,672 DEBUG [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554 2023-08-11 04:58:14,672 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=733652, jitterRate=-0.06711328029632568}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 04:58:14,672 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 04:58:14,672 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 04:58:14,672 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 04:58:14,672 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 04:58:14,672 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 04:58:14,672 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35925,1691729893554] 2023-08-11 04:58:14,673 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 04:58:14,674 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 04:58:14,675 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 04:58:14,680 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 04:58:14,680 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-11 04:58:14,681 DEBUG [RS:0;jenkins-hbase4:35925] zookeeper.ZKUtil(162): regionserver:35925-0x101f26413a70001, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35925,1691729893554 2023-08-11 04:58:14,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-11 04:58:14,694 DEBUG [RS:0;jenkins-hbase4:35925] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-11 04:58:14,704 INFO [RS:0;jenkins-hbase4:35925] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-11 04:58:14,707 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-11 04:58:14,709 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-11 04:58:14,724 INFO [RS:0;jenkins-hbase4:35925] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-11 04:58:14,727 INFO [RS:0;jenkins-hbase4:35925] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-11 04:58:14,727 INFO [RS:0;jenkins-hbase4:35925] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:14,728 INFO [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-11 04:58:14,735 INFO [RS:0;jenkins-hbase4:35925] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:14,735 DEBUG [RS:0;jenkins-hbase4:35925] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:14,735 DEBUG [RS:0;jenkins-hbase4:35925] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:14,735 DEBUG [RS:0;jenkins-hbase4:35925] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:14,736 DEBUG [RS:0;jenkins-hbase4:35925] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:14,736 DEBUG [RS:0;jenkins-hbase4:35925] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:14,736 DEBUG [RS:0;jenkins-hbase4:35925] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 04:58:14,736 DEBUG [RS:0;jenkins-hbase4:35925] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:14,736 DEBUG [RS:0;jenkins-hbase4:35925] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:14,736 DEBUG [RS:0;jenkins-hbase4:35925] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:14,736 DEBUG [RS:0;jenkins-hbase4:35925] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:14,737 INFO [RS:0;jenkins-hbase4:35925] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:14,737 INFO [RS:0;jenkins-hbase4:35925] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:14,737 INFO [RS:0;jenkins-hbase4:35925] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:14,752 INFO [RS:0;jenkins-hbase4:35925] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-11 04:58:14,755 INFO [RS:0;jenkins-hbase4:35925] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35925,1691729893554-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:14,769 INFO [RS:0;jenkins-hbase4:35925] regionserver.Replication(203): jenkins-hbase4.apache.org,35925,1691729893554 started 2023-08-11 04:58:14,769 INFO [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35925,1691729893554, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35925, sessionid=0x101f26413a70001 2023-08-11 04:58:14,770 DEBUG [RS:0;jenkins-hbase4:35925] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-11 04:58:14,770 DEBUG [RS:0;jenkins-hbase4:35925] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35925,1691729893554 2023-08-11 04:58:14,770 DEBUG [RS:0;jenkins-hbase4:35925] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35925,1691729893554' 2023-08-11 04:58:14,770 DEBUG [RS:0;jenkins-hbase4:35925] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 04:58:14,770 DEBUG [RS:0;jenkins-hbase4:35925] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 04:58:14,771 DEBUG [RS:0;jenkins-hbase4:35925] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-11 04:58:14,771 DEBUG [RS:0;jenkins-hbase4:35925] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-11 04:58:14,771 DEBUG [RS:0;jenkins-hbase4:35925] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35925,1691729893554 2023-08-11 04:58:14,771 DEBUG [RS:0;jenkins-hbase4:35925] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35925,1691729893554' 2023-08-11 04:58:14,771 DEBUG [RS:0;jenkins-hbase4:35925] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-11 04:58:14,772 DEBUG [RS:0;jenkins-hbase4:35925] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-11 04:58:14,772 DEBUG [RS:0;jenkins-hbase4:35925] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-11 04:58:14,772 INFO [RS:0;jenkins-hbase4:35925] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-11 04:58:14,772 INFO [RS:0;jenkins-hbase4:35925] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-11 04:58:14,861 DEBUG [jenkins-hbase4:38633] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-11 04:58:14,863 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35925,1691729893554, state=OPENING 2023-08-11 04:58:14,870 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-11 04:58:14,872 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:14,873 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 04:58:14,877 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35925,1691729893554}] 2023-08-11 04:58:14,883 INFO [RS:0;jenkins-hbase4:35925] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35925%2C1691729893554, suffix=, logDir=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554, archiveDir=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/oldWALs, maxLogs=32 2023-08-11 04:58:14,902 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42169,DS-6b5c55ca-1c75-4b8f-b8ae-d04a11e18b63,DISK] 2023-08-11 04:58:14,902 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42957,DS-def6050f-4460-4eb9-825b-6eab5a5058ae,DISK] 2023-08-11 04:58:14,906 INFO [RS:0;jenkins-hbase4:35925] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.1691729894885 2023-08-11 04:58:14,907 DEBUG [RS:0;jenkins-hbase4:35925] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42169,DS-6b5c55ca-1c75-4b8f-b8ae-d04a11e18b63,DISK], DatanodeInfoWithStorage[127.0.0.1:42957,DS-def6050f-4460-4eb9-825b-6eab5a5058ae,DISK]] 2023-08-11 04:58:15,061 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35925,1691729893554 2023-08-11 04:58:15,063 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-11 04:58:15,066 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-11 04:58:15,078 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-11 04:58:15,078 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 04:58:15,082 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35925%2C1691729893554.meta, suffix=.meta, logDir=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554, archiveDir=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/oldWALs, maxLogs=32 2023-08-11 04:58:15,098 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42957,DS-def6050f-4460-4eb9-825b-6eab5a5058ae,DISK] 2023-08-11 04:58:15,098 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42169,DS-6b5c55ca-1c75-4b8f-b8ae-d04a11e18b63,DISK] 2023-08-11 04:58:15,101 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.meta.1691729895083.meta 2023-08-11 04:58:15,102 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42957,DS-def6050f-4460-4eb9-825b-6eab5a5058ae,DISK], DatanodeInfoWithStorage[127.0.0.1:42169,DS-6b5c55ca-1c75-4b8f-b8ae-d04a11e18b63,DISK]] 2023-08-11 04:58:15,102 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-11 04:58:15,103 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-11 04:58:15,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-11 04:58:15,124 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-11 04:58:15,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-11 04:58:15,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:15,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-11 04:58:15,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-11 04:58:15,133 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 04:58:15,135 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/info 2023-08-11 04:58:15,135 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/info 2023-08-11 04:58:15,135 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 04:58:15,136 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:15,137 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 04:58:15,138 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/rep_barrier 2023-08-11 04:58:15,138 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/rep_barrier 2023-08-11 04:58:15,139 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 04:58:15,140 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:15,140 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 04:58:15,141 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/table 2023-08-11 04:58:15,141 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/table 2023-08-11 04:58:15,142 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 04:58:15,142 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:15,144 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740 2023-08-11 04:58:15,147 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740 2023-08-11 04:58:15,150 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 04:58:15,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 04:58:15,153 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=735955, jitterRate=-0.06418600678443909}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 04:58:15,153 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 04:58:15,162 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1691729895053 2023-08-11 04:58:15,179 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-11 04:58:15,179 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-11 04:58:15,180 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35925,1691729893554, state=OPEN 2023-08-11 04:58:15,182 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-11 04:58:15,183 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 04:58:15,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-11 04:58:15,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35925,1691729893554 in 306 msec 2023-08-11 04:58:15,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-11 04:58:15,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 497 msec 2023-08-11 04:58:15,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 714 msec 2023-08-11 04:58:15,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1691729895196, completionTime=-1 2023-08-11 04:58:15,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-11 04:58:15,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-11 04:58:15,258 DEBUG [hconnection-0x76d101b3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 04:58:15,261 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 04:58:15,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-11 04:58:15,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1691729955277 2023-08-11 04:58:15,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1691730015277 2023-08-11 04:58:15,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 80 msec 2023-08-11 04:58:15,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38633,1691729892345-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:15,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38633,1691729892345-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:15,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38633,1691729892345-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:15,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38633, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:15,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:15,309 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-11 04:58:15,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-11 04:58:15,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 04:58:15,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-11 04:58:15,329 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-11 04:58:15,332 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-11 04:58:15,354 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/.tmp/data/hbase/namespace/8d8739d27093b529da1bf26bd116c50b 2023-08-11 04:58:15,356 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/.tmp/data/hbase/namespace/8d8739d27093b529da1bf26bd116c50b empty. 2023-08-11 04:58:15,357 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/.tmp/data/hbase/namespace/8d8739d27093b529da1bf26bd116c50b 2023-08-11 04:58:15,357 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-11 04:58:15,383 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-11 04:58:15,386 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8d8739d27093b529da1bf26bd116c50b, NAME => 'hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/.tmp 2023-08-11 04:58:15,400 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:15,400 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 8d8739d27093b529da1bf26bd116c50b, disabling compactions & flushes 2023-08-11 04:58:15,400 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b. 2023-08-11 04:58:15,400 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b. 2023-08-11 04:58:15,401 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b. after waiting 0 ms 2023-08-11 04:58:15,401 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b. 2023-08-11 04:58:15,401 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b. 2023-08-11 04:58:15,401 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 8d8739d27093b529da1bf26bd116c50b: 2023-08-11 04:58:15,405 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-11 04:58:15,420 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691729895408"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691729895408"}]},"ts":"1691729895408"} 2023-08-11 04:58:15,445 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-11 04:58:15,446 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-11 04:58:15,452 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691729895447"}]},"ts":"1691729895447"} 2023-08-11 04:58:15,458 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-11 04:58:15,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8d8739d27093b529da1bf26bd116c50b, ASSIGN}] 2023-08-11 04:58:15,470 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8d8739d27093b529da1bf26bd116c50b, ASSIGN 2023-08-11 04:58:15,471 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8d8739d27093b529da1bf26bd116c50b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35925,1691729893554; forceNewPlan=false, retain=false 2023-08-11 04:58:15,622 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8d8739d27093b529da1bf26bd116c50b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35925,1691729893554 2023-08-11 04:58:15,623 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691729895622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691729895622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691729895622"}]},"ts":"1691729895622"} 2023-08-11 04:58:15,627 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8d8739d27093b529da1bf26bd116c50b, server=jenkins-hbase4.apache.org,35925,1691729893554}] 2023-08-11 04:58:15,788 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b. 2023-08-11 04:58:15,789 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8d8739d27093b529da1bf26bd116c50b, NAME => 'hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b.', STARTKEY => '', ENDKEY => ''} 2023-08-11 04:58:15,790 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8d8739d27093b529da1bf26bd116c50b 2023-08-11 04:58:15,791 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:15,791 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8d8739d27093b529da1bf26bd116c50b 2023-08-11 04:58:15,791 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8d8739d27093b529da1bf26bd116c50b 2023-08-11 04:58:15,793 INFO [StoreOpener-8d8739d27093b529da1bf26bd116c50b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8d8739d27093b529da1bf26bd116c50b 2023-08-11 04:58:15,795 DEBUG [StoreOpener-8d8739d27093b529da1bf26bd116c50b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/namespace/8d8739d27093b529da1bf26bd116c50b/info 2023-08-11 04:58:15,795 DEBUG [StoreOpener-8d8739d27093b529da1bf26bd116c50b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/namespace/8d8739d27093b529da1bf26bd116c50b/info 2023-08-11 04:58:15,796 INFO [StoreOpener-8d8739d27093b529da1bf26bd116c50b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d8739d27093b529da1bf26bd116c50b columnFamilyName info 2023-08-11 04:58:15,796 INFO [StoreOpener-8d8739d27093b529da1bf26bd116c50b-1] regionserver.HStore(310): Store=8d8739d27093b529da1bf26bd116c50b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:15,798 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/namespace/8d8739d27093b529da1bf26bd116c50b 2023-08-11 04:58:15,799 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/namespace/8d8739d27093b529da1bf26bd116c50b 2023-08-11 04:58:15,803 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8d8739d27093b529da1bf26bd116c50b 2023-08-11 04:58:15,806 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/namespace/8d8739d27093b529da1bf26bd116c50b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 04:58:15,807 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8d8739d27093b529da1bf26bd116c50b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=717523, jitterRate=-0.0876234769821167}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 04:58:15,807 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8d8739d27093b529da1bf26bd116c50b: 2023-08-11 04:58:15,809 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b., pid=6, masterSystemTime=1691729895780 2023-08-11 04:58:15,813 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b. 2023-08-11 04:58:15,813 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b. 2023-08-11 04:58:15,814 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8d8739d27093b529da1bf26bd116c50b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35925,1691729893554 2023-08-11 04:58:15,815 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691729895814"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691729895814"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691729895814"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691729895814"}]},"ts":"1691729895814"} 2023-08-11 04:58:15,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-11 04:58:15,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8d8739d27093b529da1bf26bd116c50b, server=jenkins-hbase4.apache.org,35925,1691729893554 in 191 msec 2023-08-11 04:58:15,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-11 04:58:15,826 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8d8739d27093b529da1bf26bd116c50b, ASSIGN in 355 msec 2023-08-11 04:58:15,827 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-11 04:58:15,827 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691729895827"}]},"ts":"1691729895827"} 2023-08-11 04:58:15,830 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-11 04:58:15,833 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-11 04:58:15,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-11 04:58:15,835 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-11 04:58:15,835 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:15,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 515 msec 2023-08-11 04:58:15,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-11 04:58:15,884 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 04:58:15,890 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-08-11 04:58:15,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-11 04:58:15,914 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 04:58:15,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-08-11 04:58:15,930 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-11 04:58:15,932 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-11 04:58:15,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.310sec 2023-08-11 04:58:15,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-11 04:58:15,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-11 04:58:15,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-11 04:58:15,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38633,1691729892345-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-11 04:58:15,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38633,1691729892345-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-11 04:58:15,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-11 04:58:15,995 DEBUG [Listener at localhost/35373] zookeeper.ReadOnlyZKClient(139): Connect 0x741e3453 to 127.0.0.1:52221 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 04:58:15,999 DEBUG [Listener at localhost/35373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32038b2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 04:58:16,033 DEBUG [hconnection-0x7910072a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 04:58:16,044 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 04:58:16,054 INFO [Listener at localhost/35373] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38633,1691729892345 2023-08-11 04:58:16,054 INFO [Listener at localhost/35373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:16,062 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-11 04:58:16,062 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:16,063 INFO [Listener at localhost/35373] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-11 04:58:16,080 WARN [Listener at localhost/35373] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 04:58:16,083 WARN [Listener at localhost/35373] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 04:58:16,085 INFO [Listener at localhost/35373] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 04:58:16,089 INFO [Listener at localhost/35373] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/java.io.tmpdir/Jetty_localhost_36903_datanode____7vaa00/webapp 2023-08-11 04:58:16,183 INFO [Listener at localhost/35373] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36903 2023-08-11 04:58:16,191 WARN [Listener at localhost/34717] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 04:58:16,215 WARN [Listener at localhost/34717] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 04:58:16,218 WARN [Listener at localhost/34717] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 04:58:16,219 INFO [Listener at localhost/34717] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 04:58:16,224 INFO [Listener at localhost/34717] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/java.io.tmpdir/Jetty_localhost_43221_datanode____g3l4vt/webapp 2023-08-11 04:58:16,315 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb35cc25507d802d5: Processing first storage report for DS-c11391ae-1e76-481b-bad7-cbf6493528f2 from datanode 34fd3e10-af88-45aa-af3c-78eeddacb634 2023-08-11 04:58:16,315 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb35cc25507d802d5: from storage DS-c11391ae-1e76-481b-bad7-cbf6493528f2 node DatanodeRegistration(127.0.0.1:40359, datanodeUuid=34fd3e10-af88-45aa-af3c-78eeddacb634, infoPort=38187, infoSecurePort=0, ipcPort=34717, storageInfo=lv=-57;cid=testClusterID;nsid=1994267679;c=1691729889350), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 04:58:16,315 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb35cc25507d802d5: Processing first storage report for DS-20ae3449-25dd-4321-be3e-4d90ecc31943 from datanode 34fd3e10-af88-45aa-af3c-78eeddacb634 2023-08-11 04:58:16,315 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb35cc25507d802d5: from storage DS-20ae3449-25dd-4321-be3e-4d90ecc31943 node DatanodeRegistration(127.0.0.1:40359, datanodeUuid=34fd3e10-af88-45aa-af3c-78eeddacb634, infoPort=38187, infoSecurePort=0, ipcPort=34717, storageInfo=lv=-57;cid=testClusterID;nsid=1994267679;c=1691729889350), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 04:58:16,335 INFO [Listener at localhost/34717] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43221 2023-08-11 04:58:16,345 WARN [Listener at localhost/38443] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 04:58:16,364 WARN [Listener at localhost/38443] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 04:58:16,367 WARN [Listener at localhost/38443] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 04:58:16,368 INFO [Listener at localhost/38443] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 04:58:16,372 INFO [Listener at localhost/38443] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/java.io.tmpdir/Jetty_localhost_34749_datanode____.gmw4v2/webapp 2023-08-11 04:58:16,462 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x489eee8405c7b280: Processing first storage report for DS-870a2eb7-1433-43f0-ac17-087c99726c37 from datanode b1bf77b8-9358-4f76-96ad-1314095f3190 2023-08-11 04:58:16,462 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x489eee8405c7b280: from storage DS-870a2eb7-1433-43f0-ac17-087c99726c37 node DatanodeRegistration(127.0.0.1:46217, datanodeUuid=b1bf77b8-9358-4f76-96ad-1314095f3190, infoPort=35043, infoSecurePort=0, ipcPort=38443, storageInfo=lv=-57;cid=testClusterID;nsid=1994267679;c=1691729889350), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 04:58:16,462 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x489eee8405c7b280: Processing first storage report for DS-e9000971-2aaf-4a7d-a2ad-32add77d4c43 from datanode b1bf77b8-9358-4f76-96ad-1314095f3190 2023-08-11 04:58:16,462 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x489eee8405c7b280: from storage DS-e9000971-2aaf-4a7d-a2ad-32add77d4c43 node DatanodeRegistration(127.0.0.1:46217, datanodeUuid=b1bf77b8-9358-4f76-96ad-1314095f3190, infoPort=35043, infoSecurePort=0, ipcPort=38443, storageInfo=lv=-57;cid=testClusterID;nsid=1994267679;c=1691729889350), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 04:58:16,490 INFO [Listener at localhost/38443] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34749 2023-08-11 04:58:16,502 WARN [Listener at localhost/45901] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 04:58:16,592 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x12029d171033fb22: Processing first storage report for DS-f3795438-8554-43b0-988a-6a467402083a from datanode 6703ded0-05f8-4c85-9bff-e39c6c38ae76 2023-08-11 04:58:16,593 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x12029d171033fb22: from storage DS-f3795438-8554-43b0-988a-6a467402083a node DatanodeRegistration(127.0.0.1:37375, datanodeUuid=6703ded0-05f8-4c85-9bff-e39c6c38ae76, infoPort=33833, infoSecurePort=0, ipcPort=45901, storageInfo=lv=-57;cid=testClusterID;nsid=1994267679;c=1691729889350), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-11 04:58:16,593 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x12029d171033fb22: Processing first storage report for DS-1fa0eea2-6204-46a1-862d-05cbb9efb4b9 from datanode 6703ded0-05f8-4c85-9bff-e39c6c38ae76 2023-08-11 04:58:16,593 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x12029d171033fb22: from storage DS-1fa0eea2-6204-46a1-862d-05cbb9efb4b9 node DatanodeRegistration(127.0.0.1:37375, datanodeUuid=6703ded0-05f8-4c85-9bff-e39c6c38ae76, infoPort=33833, infoSecurePort=0, ipcPort=45901, storageInfo=lv=-57;cid=testClusterID;nsid=1994267679;c=1691729889350), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 04:58:16,621 DEBUG [Listener at localhost/45901] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-11 04:58:16,624 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-11 04:58:16,633 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38633] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-11 04:58:16,633 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38633] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-11 04:58:16,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38633] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-11 04:58:16,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38633] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath 2023-08-11 04:58:16,641 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_PRE_OPERATION 2023-08-11 04:58:16,643 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-11 04:58:16,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38633] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRollOnDatanodeDeath" procId is: 9 2023-08-11 04:58:16,646 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/7d3bc7ac49f7cff74e5caee430bfe50b 2023-08-11 04:58:16,648 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/7d3bc7ac49f7cff74e5caee430bfe50b empty. 2023-08-11 04:58:16,650 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/7d3bc7ac49f7cff74e5caee430bfe50b 2023-08-11 04:58:16,650 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRollOnDatanodeDeath regions 2023-08-11 04:58:16,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38633] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-11 04:58:16,669 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/.tabledesc/.tableinfo.0000000001 2023-08-11 04:58:16,671 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7d3bc7ac49f7cff74e5caee430bfe50b, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/.tmp 2023-08-11 04:58:16,688 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:16,688 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1604): Closing 7d3bc7ac49f7cff74e5caee430bfe50b, disabling compactions & flushes 2023-08-11 04:58:16,688 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b. 2023-08-11 04:58:16,688 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b. 2023-08-11 04:58:16,688 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b. after waiting 0 ms 2023-08-11 04:58:16,688 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b. 2023-08-11 04:58:16,688 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b. 2023-08-11 04:58:16,688 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1558): Region close journal for 7d3bc7ac49f7cff74e5caee430bfe50b: 2023-08-11 04:58:16,692 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ADD_TO_META 2023-08-11 04:58:16,694 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1691729896693"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691729896693"}]},"ts":"1691729896693"} 2023-08-11 04:58:16,696 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-11 04:58:16,698 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-11 04:58:16,698 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691729896698"}]},"ts":"1691729896698"} 2023-08-11 04:58:16,700 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLING in hbase:meta 2023-08-11 04:58:16,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=7d3bc7ac49f7cff74e5caee430bfe50b, ASSIGN}] 2023-08-11 04:58:16,706 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=7d3bc7ac49f7cff74e5caee430bfe50b, ASSIGN 2023-08-11 04:58:16,708 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=7d3bc7ac49f7cff74e5caee430bfe50b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35925,1691729893554; forceNewPlan=false, retain=false 2023-08-11 04:58:16,860 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7d3bc7ac49f7cff74e5caee430bfe50b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35925,1691729893554 2023-08-11 04:58:16,860 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1691729896860"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691729896860"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691729896860"}]},"ts":"1691729896860"} 2023-08-11 04:58:16,863 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 7d3bc7ac49f7cff74e5caee430bfe50b, server=jenkins-hbase4.apache.org,35925,1691729893554}] 2023-08-11 04:58:17,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b. 2023-08-11 04:58:17,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7d3bc7ac49f7cff74e5caee430bfe50b, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b.', STARTKEY => '', ENDKEY => ''} 2023-08-11 04:58:17,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRollOnDatanodeDeath 7d3bc7ac49f7cff74e5caee430bfe50b 2023-08-11 04:58:17,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:17,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7d3bc7ac49f7cff74e5caee430bfe50b 2023-08-11 04:58:17,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7d3bc7ac49f7cff74e5caee430bfe50b 2023-08-11 04:58:17,025 INFO [StoreOpener-7d3bc7ac49f7cff74e5caee430bfe50b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7d3bc7ac49f7cff74e5caee430bfe50b 2023-08-11 04:58:17,027 DEBUG [StoreOpener-7d3bc7ac49f7cff74e5caee430bfe50b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/default/TestLogRolling-testLogRollOnDatanodeDeath/7d3bc7ac49f7cff74e5caee430bfe50b/info 2023-08-11 04:58:17,028 DEBUG [StoreOpener-7d3bc7ac49f7cff74e5caee430bfe50b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/default/TestLogRolling-testLogRollOnDatanodeDeath/7d3bc7ac49f7cff74e5caee430bfe50b/info 2023-08-11 04:58:17,028 INFO [StoreOpener-7d3bc7ac49f7cff74e5caee430bfe50b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d3bc7ac49f7cff74e5caee430bfe50b columnFamilyName info 2023-08-11 04:58:17,029 INFO [StoreOpener-7d3bc7ac49f7cff74e5caee430bfe50b-1] regionserver.HStore(310): Store=7d3bc7ac49f7cff74e5caee430bfe50b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:17,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/default/TestLogRolling-testLogRollOnDatanodeDeath/7d3bc7ac49f7cff74e5caee430bfe50b 2023-08-11 04:58:17,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/default/TestLogRolling-testLogRollOnDatanodeDeath/7d3bc7ac49f7cff74e5caee430bfe50b 2023-08-11 04:58:17,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7d3bc7ac49f7cff74e5caee430bfe50b 2023-08-11 04:58:17,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/default/TestLogRolling-testLogRollOnDatanodeDeath/7d3bc7ac49f7cff74e5caee430bfe50b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 04:58:17,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7d3bc7ac49f7cff74e5caee430bfe50b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=733925, jitterRate=-0.06676679849624634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 04:58:17,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7d3bc7ac49f7cff74e5caee430bfe50b: 2023-08-11 04:58:17,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b., pid=11, masterSystemTime=1691729897016 2023-08-11 04:58:17,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b. 2023-08-11 04:58:17,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b. 2023-08-11 04:58:17,044 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7d3bc7ac49f7cff74e5caee430bfe50b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35925,1691729893554 2023-08-11 04:58:17,044 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1691729897044"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691729897044"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691729897044"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691729897044"}]},"ts":"1691729897044"} 2023-08-11 04:58:17,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-11 04:58:17,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 7d3bc7ac49f7cff74e5caee430bfe50b, server=jenkins-hbase4.apache.org,35925,1691729893554 in 184 msec 2023-08-11 04:58:17,053 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-11 04:58:17,054 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=7d3bc7ac49f7cff74e5caee430bfe50b, ASSIGN in 345 msec 2023-08-11 04:58:17,055 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-11 04:58:17,055 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691729897055"}]},"ts":"1691729897055"} 2023-08-11 04:58:17,057 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLED in hbase:meta 2023-08-11 04:58:17,060 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_POST_OPERATION 2023-08-11 04:58:17,062 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath in 423 msec 2023-08-11 04:58:20,642 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-11 04:58:20,728 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-11 04:58:20,729 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-11 04:58:20,730 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRollOnDatanodeDeath' 2023-08-11 04:58:22,507 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-11 04:58:22,507 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-08-11 04:58:26,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38633] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-11 04:58:26,662 INFO [Listener at localhost/45901] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRollOnDatanodeDeath, procId: 9 completed 2023-08-11 04:58:26,662 DEBUG [Listener at localhost/45901] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestLogRolling-testLogRollOnDatanodeDeath get assigned. Timeout = 60000ms 2023-08-11 04:58:26,664 INFO [Listener at localhost/45901] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-08-11 04:58:26,667 INFO [Listener at localhost/45901] hbase.HBaseTestingUtility(3484): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned to meta. Checking AM states. 2023-08-11 04:58:26,668 INFO [Listener at localhost/45901] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-08-11 04:58:26,668 INFO [Listener at localhost/45901] hbase.HBaseTestingUtility(3504): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned. 2023-08-11 04:58:26,680 DEBUG [Listener at localhost/45901] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRollOnDatanodeDeath 2023-08-11 04:58:26,681 DEBUG [Listener at localhost/45901] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b. 2023-08-11 04:58:26,681 WARN [Listener at localhost/45901] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 04:58:26,685 INFO [Listener at localhost/45901] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 04:58:26,690 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_1448282778_17 at /127.0.0.1:60882 [Receiving block BP-576763742-172.31.14.131-1691729889350:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:42957:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:60882 dst: /127.0.0.1:42957 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:26,690 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_1196171669_17 at /127.0.0.1:60846 [Receiving block BP-576763742-172.31.14.131-1691729889350:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:42957:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:60846 dst: /127.0.0.1:42957 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:26,690 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_1448282778_17 at /127.0.0.1:60888 [Receiving block BP-576763742-172.31.14.131-1691729889350:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:42957:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:60888 dst: /127.0.0.1:42957 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:26,787 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_1448282778_17 at /127.0.0.1:43728 [Receiving block BP-576763742-172.31.14.131-1691729889350:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:42169:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:43728 dst: /127.0.0.1:42169 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:26,787 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_1196171669_17 at /127.0.0.1:43704 [Receiving block BP-576763742-172.31.14.131-1691729889350:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:42169:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:43704 dst: /127.0.0.1:42169 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:26,787 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_1448282778_17 at /127.0.0.1:43744 [Receiving block BP-576763742-172.31.14.131-1691729889350:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:42169:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:43744 dst: /127.0.0.1:42169 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:26,788 WARN [BP-576763742-172.31.14.131-1691729889350 heartbeating to localhost/127.0.0.1:44477] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 04:58:26,789 WARN [BP-576763742-172.31.14.131-1691729889350 heartbeating to localhost/127.0.0.1:44477] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-576763742-172.31.14.131-1691729889350 (Datanode Uuid 637f416b-844a-4ee5-8d7d-d4ca4477246a) service to localhost/127.0.0.1:44477 2023-08-11 04:58:26,791 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6/dfs/data/data1/current/BP-576763742-172.31.14.131-1691729889350] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:58:26,791 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6/dfs/data/data2/current/BP-576763742-172.31.14.131-1691729889350] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:58:26,798 WARN [Listener at localhost/45901] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 04:58:26,801 WARN [Listener at localhost/45901] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 04:58:26,802 INFO [Listener at localhost/45901] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 04:58:26,807 INFO [Listener at localhost/45901] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/java.io.tmpdir/Jetty_localhost_40135_datanode____.b9tttu/webapp 2023-08-11 04:58:26,901 INFO [Listener at localhost/45901] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40135 2023-08-11 04:58:26,912 WARN [Listener at localhost/38145] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 04:58:26,918 WARN [AsyncFSWAL-0-hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256-prefix:jenkins-hbase4.apache.org,35925,1691729893554] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:26,920 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase4.apache.org%2C35925%2C1691729893554:(num 1691729894885) roll requested 2023-08-11 04:58:26,937 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46217,DS-870a2eb7-1433-43f0-ac17-087c99726c37,DISK] 2023-08-11 04:58:26,937 WARN [regionserver/jenkins-hbase4:0.logRoller] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(571): create fan-out dfs output /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.1691729906920 failed, retry = 0 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: /127.0.0.1:42169 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:27,016 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5680c899fba7e0be: Processing first storage report for DS-6b5c55ca-1c75-4b8f-b8ae-d04a11e18b63 from datanode 637f416b-844a-4ee5-8d7d-d4ca4477246a 2023-08-11 04:58:27,017 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5680c899fba7e0be: from storage DS-6b5c55ca-1c75-4b8f-b8ae-d04a11e18b63 node DatanodeRegistration(127.0.0.1:44907, datanodeUuid=637f416b-844a-4ee5-8d7d-d4ca4477246a, infoPort=46407, infoSecurePort=0, ipcPort=38145, storageInfo=lv=-57;cid=testClusterID;nsid=1994267679;c=1691729889350), blocks: 6, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-11 04:58:27,017 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5680c899fba7e0be: Processing first storage report for DS-b7856275-b4a3-4dfb-9879-fc42d6c915dd from datanode 637f416b-844a-4ee5-8d7d-d4ca4477246a 2023-08-11 04:58:27,017 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5680c899fba7e0be: from storage DS-b7856275-b4a3-4dfb-9879-fc42d6c915dd node DatanodeRegistration(127.0.0.1:44907, datanodeUuid=637f416b-844a-4ee5-8d7d-d4ca4477246a, infoPort=46407, infoSecurePort=0, ipcPort=38145, storageInfo=lv=-57;cid=testClusterID;nsid=1994267679;c=1691729889350), blocks: 7, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 04:58:27,040 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_1448282778_17 at /127.0.0.1:55246 [Receiving block BP-576763742-172.31.14.131-1691729889350:blk_1073741838_1014]] datanode.DataXceiver(323): 127.0.0.1:46217:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:55246 dst: /127.0.0.1:46217 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:27,046 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46217,DS-870a2eb7-1433-43f0-ac17-087c99726c37,DISK] 2023-08-11 04:58:27,046 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44907,DS-6b5c55ca-1c75-4b8f-b8ae-d04a11e18b63,DISK] 2023-08-11 04:58:27,051 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.1691729894885 with entries=6, filesize=3.19 KB; new WAL /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.1691729906920 2023-08-11 04:58:27,052 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46217,DS-870a2eb7-1433-43f0-ac17-087c99726c37,DISK], DatanodeInfoWithStorage[127.0.0.1:44907,DS-6b5c55ca-1c75-4b8f-b8ae-d04a11e18b63,DISK]] 2023-08-11 04:58:27,052 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.1691729894885 is not closed yet, will try archiving it next time 2023-08-11 04:58:27,054 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-11 04:58:27,054 INFO [Listener at localhost/38145] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-11 04:58:27,055 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:27,055 DEBUG [Listener at localhost/38145] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x741e3453 to 127.0.0.1:52221 2023-08-11 04:58:27,055 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:27,055 DEBUG [Listener at localhost/38145] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 04:58:27,056 DEBUG [Listener at localhost/38145] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-11 04:58:27,056 DEBUG [Listener at localhost/38145] util.JVMClusterUtil(257): Found active master hash=944090757, stopped=false 2023-08-11 04:58:27,056 INFO [Listener at localhost/38145] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38633,1691729892345 2023-08-11 04:58:27,058 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.1691729894885 2023-08-11 04:58:27,060 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): regionserver:35925-0x101f26413a70001, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 04:58:27,060 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 04:58:27,060 INFO [Listener at localhost/38145] procedure2.ProcedureExecutor(629): Stopping 2023-08-11 04:58:27,060 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:27,060 DEBUG [Listener at localhost/38145] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52431596 to 127.0.0.1:52221 2023-08-11 04:58:27,061 DEBUG [Listener at localhost/38145] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 04:58:27,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35925-0x101f26413a70001, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 04:58:27,061 INFO [Listener at localhost/38145] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35925,1691729893554' ***** 2023-08-11 04:58:27,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 04:58:27,061 INFO [Listener at localhost/38145] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-11 04:58:27,061 INFO [RS:0;jenkins-hbase4:35925] regionserver.HeapMemoryManager(220): Stopping 2023-08-11 04:58:27,062 INFO [RS:0;jenkins-hbase4:35925] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-11 04:58:27,062 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-11 04:58:27,062 INFO [RS:0;jenkins-hbase4:35925] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-11 04:58:27,063 INFO [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(3305): Received CLOSE for 7d3bc7ac49f7cff74e5caee430bfe50b 2023-08-11 04:58:27,063 WARN [IPC Server handler 1 on default port 44477] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.1691729894885 has not been closed. Lease recovery is in progress. RecoveryId = 1016 for block blk_1073741832_1008 2023-08-11 04:58:27,063 INFO [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(3305): Received CLOSE for 8d8739d27093b529da1bf26bd116c50b 2023-08-11 04:58:27,064 INFO [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35925,1691729893554 2023-08-11 04:58:27,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7d3bc7ac49f7cff74e5caee430bfe50b, disabling compactions & flushes 2023-08-11 04:58:27,064 DEBUG [RS:0;jenkins-hbase4:35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1db5f065 to 127.0.0.1:52221 2023-08-11 04:58:27,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b. 2023-08-11 04:58:27,065 DEBUG [RS:0;jenkins-hbase4:35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 04:58:27,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b. 2023-08-11 04:58:27,065 INFO [RS:0;jenkins-hbase4:35925] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-11 04:58:27,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b. after waiting 0 ms 2023-08-11 04:58:27,065 INFO [RS:0;jenkins-hbase4:35925] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-11 04:58:27,065 INFO [RS:0;jenkins-hbase4:35925] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-11 04:58:27,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b. 2023-08-11 04:58:27,065 INFO [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-11 04:58:27,065 INFO [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-08-11 04:58:27,066 DEBUG [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(1478): Online Regions={7d3bc7ac49f7cff74e5caee430bfe50b=TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b., 1588230740=hbase:meta,,1.1588230740, 8d8739d27093b529da1bf26bd116c50b=hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b.} 2023-08-11 04:58:27,066 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 04:58:27,066 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 04:58:27,066 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 04:58:27,066 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 04:58:27,066 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 04:58:27,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7d3bc7ac49f7cff74e5caee430bfe50b 1/1 column families, dataSize=2.05 KB heapSize=2.45 KB 2023-08-11 04:58:27,067 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.92 KB heapSize=5.45 KB 2023-08-11 04:58:27,067 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.1691729894885 after 9ms 2023-08-11 04:58:27,068 DEBUG [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(1504): Waiting on 1588230740, 7d3bc7ac49f7cff74e5caee430bfe50b, 8d8739d27093b529da1bf26bd116c50b 2023-08-11 04:58:27,076 WARN [AsyncFSWAL-0-hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256-prefix:jenkins-hbase4.apache.org,35925,1691729893554.meta] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:27,077 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase4.apache.org%2C35925%2C1691729893554.meta:.meta(num 1691729895083) roll requested 2023-08-11 04:58:27,094 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46217,DS-870a2eb7-1433-43f0-ac17-087c99726c37,DISK] 2023-08-11 04:58:27,094 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40359,DS-c11391ae-1e76-481b-bad7-cbf6493528f2,DISK] 2023-08-11 04:58:27,099 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.meta.1691729895083.meta with entries=12, filesize=3.87 KB; new WAL /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.meta.1691729907077.meta 2023-08-11 04:58:27,099 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46217,DS-870a2eb7-1433-43f0-ac17-087c99726c37,DISK], DatanodeInfoWithStorage[127.0.0.1:40359,DS-c11391ae-1e76-481b-bad7-cbf6493528f2,DISK]] 2023-08-11 04:58:27,099 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.meta.1691729895083.meta is not closed yet, will try archiving it next time 2023-08-11 04:58:27,099 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:27,100 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:27,101 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.meta.1691729895083.meta 2023-08-11 04:58:27,102 WARN [IPC Server handler 4 on default port 44477] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.meta.1691729895083.meta has not been closed. Lease recovery is in progress. RecoveryId = 1018 for block blk_1073741833_1009 2023-08-11 04:58:27,102 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.meta.1691729895083.meta after 1ms 2023-08-11 04:58:27,178 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.69 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/.tmp/info/dce27cfee99e42bcb9877918a552df29 2023-08-11 04:58:27,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.05 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/default/TestLogRolling-testLogRollOnDatanodeDeath/7d3bc7ac49f7cff74e5caee430bfe50b/.tmp/info/8bc6e962a24a4e3db6eb1ccf34197755 2023-08-11 04:58:27,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/default/TestLogRolling-testLogRollOnDatanodeDeath/7d3bc7ac49f7cff74e5caee430bfe50b/.tmp/info/8bc6e962a24a4e3db6eb1ccf34197755 as hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/default/TestLogRolling-testLogRollOnDatanodeDeath/7d3bc7ac49f7cff74e5caee430bfe50b/info/8bc6e962a24a4e3db6eb1ccf34197755 2023-08-11 04:58:27,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/default/TestLogRolling-testLogRollOnDatanodeDeath/7d3bc7ac49f7cff74e5caee430bfe50b/info/8bc6e962a24a4e3db6eb1ccf34197755, entries=2, sequenceid=6, filesize=6.8 K 2023-08-11 04:58:27,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.05 KB/2102, heapSize ~2.44 KB/2496, currentSize=0 B/0 for 7d3bc7ac49f7cff74e5caee430bfe50b in 180ms, sequenceid=6, compaction requested=false 2023-08-11 04:58:27,249 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=240 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/.tmp/table/944d6580c2944a36854dc4d5eb86e72c 2023-08-11 04:58:27,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/default/TestLogRolling-testLogRollOnDatanodeDeath/7d3bc7ac49f7cff74e5caee430bfe50b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-11 04:58:27,264 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b. 2023-08-11 04:58:27,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7d3bc7ac49f7cff74e5caee430bfe50b: 2023-08-11 04:58:27,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1691729896633.7d3bc7ac49f7cff74e5caee430bfe50b. 2023-08-11 04:58:27,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8d8739d27093b529da1bf26bd116c50b, disabling compactions & flushes 2023-08-11 04:58:27,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b. 2023-08-11 04:58:27,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b. 2023-08-11 04:58:27,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b. after waiting 0 ms 2023-08-11 04:58:27,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b. 2023-08-11 04:58:27,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8d8739d27093b529da1bf26bd116c50b 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-11 04:58:27,268 DEBUG [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(1504): Waiting on 1588230740, 8d8739d27093b529da1bf26bd116c50b 2023-08-11 04:58:27,268 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/.tmp/info/dce27cfee99e42bcb9877918a552df29 as hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/info/dce27cfee99e42bcb9877918a552df29 2023-08-11 04:58:27,277 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/info/dce27cfee99e42bcb9877918a552df29, entries=20, sequenceid=14, filesize=7.4 K 2023-08-11 04:58:27,284 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/.tmp/table/944d6580c2944a36854dc4d5eb86e72c as hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/table/944d6580c2944a36854dc4d5eb86e72c 2023-08-11 04:58:27,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/namespace/8d8739d27093b529da1bf26bd116c50b/.tmp/info/841b4f7447ff4e80af96f5612a3c74a5 2023-08-11 04:58:27,296 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/table/944d6580c2944a36854dc4d5eb86e72c, entries=4, sequenceid=14, filesize=4.8 K 2023-08-11 04:58:27,298 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.92 KB/2994, heapSize ~5.16 KB/5288, currentSize=0 B/0 for 1588230740 in 232ms, sequenceid=14, compaction requested=false 2023-08-11 04:58:27,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/namespace/8d8739d27093b529da1bf26bd116c50b/.tmp/info/841b4f7447ff4e80af96f5612a3c74a5 as hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/namespace/8d8739d27093b529da1bf26bd116c50b/info/841b4f7447ff4e80af96f5612a3c74a5 2023-08-11 04:58:27,306 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-08-11 04:58:27,307 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-11 04:58:27,309 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 04:58:27,309 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 04:58:27,309 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-11 04:58:27,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/namespace/8d8739d27093b529da1bf26bd116c50b/info/841b4f7447ff4e80af96f5612a3c74a5, entries=2, sequenceid=6, filesize=4.8 K 2023-08-11 04:58:27,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8d8739d27093b529da1bf26bd116c50b in 48ms, sequenceid=6, compaction requested=false 2023-08-11 04:58:27,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/data/hbase/namespace/8d8739d27093b529da1bf26bd116c50b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-11 04:58:27,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b. 2023-08-11 04:58:27,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8d8739d27093b529da1bf26bd116c50b: 2023-08-11 04:58:27,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1691729895317.8d8739d27093b529da1bf26bd116c50b. 2023-08-11 04:58:27,468 INFO [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35925,1691729893554; all regions closed. 2023-08-11 04:58:27,742 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-08-11 04:58:27,742 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-08-11 04:58:28,738 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-11 04:58:31,068 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.1691729894885 after 4010ms 2023-08-11 04:58:31,069 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.1691729894885 to hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/oldWALs/jenkins-hbase4.apache.org%2C35925%2C1691729893554.1691729894885 2023-08-11 04:58:31,103 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.meta.1691729895083.meta after 4002ms 2023-08-11 04:58:31,104 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/WALs/jenkins-hbase4.apache.org,35925,1691729893554/jenkins-hbase4.apache.org%2C35925%2C1691729893554.meta.1691729895083.meta to hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/oldWALs/jenkins-hbase4.apache.org%2C35925%2C1691729893554.meta.1691729895083.meta 2023-08-11 04:58:31,109 DEBUG [RS:0;jenkins-hbase4:35925] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/oldWALs 2023-08-11 04:58:31,109 INFO [RS:0;jenkins-hbase4:35925] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35925%2C1691729893554.meta:.meta(num 1691729907077) 2023-08-11 04:58:31,118 DEBUG [RS:0;jenkins-hbase4:35925] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/oldWALs 2023-08-11 04:58:31,118 INFO [RS:0;jenkins-hbase4:35925] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35925%2C1691729893554:(num 1691729906920) 2023-08-11 04:58:31,118 DEBUG [RS:0;jenkins-hbase4:35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 04:58:31,118 INFO [RS:0;jenkins-hbase4:35925] regionserver.LeaseManager(133): Closed leases 2023-08-11 04:58:31,119 INFO [RS:0;jenkins-hbase4:35925] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-08-11 04:58:31,119 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 04:58:31,119 INFO [RS:0;jenkins-hbase4:35925] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35925 2023-08-11 04:58:31,125 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): regionserver:35925-0x101f26413a70001, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35925,1691729893554 2023-08-11 04:58:31,126 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 04:58:31,126 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): regionserver:35925-0x101f26413a70001, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 04:58:31,129 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35925,1691729893554] 2023-08-11 04:58:31,129 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35925,1691729893554; numProcessing=1 2023-08-11 04:58:31,130 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35925,1691729893554 already deleted, retry=false 2023-08-11 04:58:31,130 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35925,1691729893554 expired; onlineServers=0 2023-08-11 04:58:31,130 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38633,1691729892345' ***** 2023-08-11 04:58:31,130 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-11 04:58:31,131 DEBUG [M:0;jenkins-hbase4:38633] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7978a4be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 04:58:31,131 INFO [M:0;jenkins-hbase4:38633] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38633,1691729892345 2023-08-11 04:58:31,131 INFO [M:0;jenkins-hbase4:38633] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38633,1691729892345; all regions closed. 2023-08-11 04:58:31,131 DEBUG [M:0;jenkins-hbase4:38633] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 04:58:31,131 DEBUG [M:0;jenkins-hbase4:38633] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-11 04:58:31,131 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-11 04:58:31,131 DEBUG [M:0;jenkins-hbase4:38633] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-11 04:58:31,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691729894599] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691729894599,5,FailOnTimeoutGroup] 2023-08-11 04:58:31,133 INFO [M:0;jenkins-hbase4:38633] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-11 04:58:31,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691729894597] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691729894597,5,FailOnTimeoutGroup] 2023-08-11 04:58:31,133 INFO [M:0;jenkins-hbase4:38633] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-11 04:58:31,134 INFO [M:0;jenkins-hbase4:38633] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-11 04:58:31,134 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-11 04:58:31,134 DEBUG [M:0;jenkins-hbase4:38633] master.HMaster(1512): Stopping service threads 2023-08-11 04:58:31,134 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:31,134 INFO [M:0;jenkins-hbase4:38633] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-11 04:58:31,135 ERROR [M:0;jenkins-hbase4:38633] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] 2023-08-11 04:58:31,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 04:58:31,136 INFO [M:0;jenkins-hbase4:38633] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-11 04:58:31,136 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-11 04:58:31,136 DEBUG [M:0;jenkins-hbase4:38633] zookeeper.ZKUtil(398): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-11 04:58:31,136 WARN [M:0;jenkins-hbase4:38633] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-11 04:58:31,136 INFO [M:0;jenkins-hbase4:38633] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-11 04:58:31,137 INFO [M:0;jenkins-hbase4:38633] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-11 04:58:31,137 DEBUG [M:0;jenkins-hbase4:38633] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 04:58:31,137 INFO [M:0;jenkins-hbase4:38633] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:58:31,137 DEBUG [M:0;jenkins-hbase4:38633] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:58:31,137 DEBUG [M:0;jenkins-hbase4:38633] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 04:58:31,137 DEBUG [M:0;jenkins-hbase4:38633] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:58:31,137 INFO [M:0;jenkins-hbase4:38633] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.08 KB heapSize=45.73 KB 2023-08-11 04:58:31,138 WARN [AsyncFSWAL-0-hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData-prefix:jenkins-hbase4.apache.org,38633,1691729892345] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:31,138 DEBUG [master:store-WAL-Roller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase4.apache.org%2C38633%2C1691729892345:(num 1691729893979) roll requested 2023-08-11 04:58:31,157 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37375,DS-f3795438-8554-43b0-988a-6a467402083a,DISK] 2023-08-11 04:58:31,157 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40359,DS-c11391ae-1e76-481b-bad7-cbf6493528f2,DISK] 2023-08-11 04:58:31,161 INFO [master:store-WAL-Roller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/WALs/jenkins-hbase4.apache.org,38633,1691729892345/jenkins-hbase4.apache.org%2C38633%2C1691729892345.1691729893979 with entries=89, filesize=43.93 KB; new WAL /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/WALs/jenkins-hbase4.apache.org,38633,1691729892345/jenkins-hbase4.apache.org%2C38633%2C1691729892345.1691729911138 2023-08-11 04:58:31,161 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37375,DS-f3795438-8554-43b0-988a-6a467402083a,DISK], DatanodeInfoWithStorage[127.0.0.1:40359,DS-c11391ae-1e76-481b-bad7-cbf6493528f2,DISK]] 2023-08-11 04:58:31,161 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(716): hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/WALs/jenkins-hbase4.apache.org,38633,1691729892345/jenkins-hbase4.apache.org%2C38633%2C1691729892345.1691729893979 is not closed yet, will try archiving it next time 2023-08-11 04:58:31,161 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:31,161 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 04:58:31,162 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/WALs/jenkins-hbase4.apache.org,38633,1691729892345/jenkins-hbase4.apache.org%2C38633%2C1691729892345.1691729893979 2023-08-11 04:58:31,163 WARN [IPC Server handler 3 on default port 44477] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/WALs/jenkins-hbase4.apache.org,38633,1691729892345/jenkins-hbase4.apache.org%2C38633%2C1691729892345.1691729893979 has not been closed. Lease recovery is in progress. RecoveryId = 1024 for block blk_1073741829_1005 2023-08-11 04:58:31,163 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/WALs/jenkins-hbase4.apache.org,38633,1691729892345/jenkins-hbase4.apache.org%2C38633%2C1691729892345.1691729893979 after 1ms 2023-08-11 04:58:31,184 INFO [M:0;jenkins-hbase4:38633] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.08 KB at sequenceid=91 (bloomFilter=true), to=hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8fed4393973442828c3c4f4c41edd434 2023-08-11 04:58:31,192 DEBUG [M:0;jenkins-hbase4:38633] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8fed4393973442828c3c4f4c41edd434 as hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8fed4393973442828c3c4f4c41edd434 2023-08-11 04:58:31,199 INFO [M:0;jenkins-hbase4:38633] regionserver.HStore(1080): Added hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8fed4393973442828c3c4f4c41edd434, entries=11, sequenceid=91, filesize=7.0 K 2023-08-11 04:58:31,200 INFO [M:0;jenkins-hbase4:38633] regionserver.HRegion(2948): Finished flush of dataSize ~38.08 KB/38997, heapSize ~45.72 KB/46816, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 63ms, sequenceid=91, compaction requested=false 2023-08-11 04:58:31,202 INFO [M:0;jenkins-hbase4:38633] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:58:31,202 DEBUG [M:0;jenkins-hbase4:38633] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 04:58:31,229 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): regionserver:35925-0x101f26413a70001, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 04:58:31,229 INFO [RS:0;jenkins-hbase4:35925] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35925,1691729893554; zookeeper connection closed. 2023-08-11 04:58:31,229 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): regionserver:35925-0x101f26413a70001, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 04:58:31,229 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6d424a6d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6d424a6d 2023-08-11 04:58:31,230 INFO [Listener at localhost/38145] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-11 04:58:32,799 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-11 04:58:32,845 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-11 04:58:35,164 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/WALs/jenkins-hbase4.apache.org,38633,1691729892345/jenkins-hbase4.apache.org%2C38633%2C1691729892345.1691729893979 after 4002ms 2023-08-11 04:58:35,165 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/WALs/jenkins-hbase4.apache.org,38633,1691729892345/jenkins-hbase4.apache.org%2C38633%2C1691729892345.1691729893979 to hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/oldWALs/jenkins-hbase4.apache.org%2C38633%2C1691729892345.1691729893979 2023-08-11 04:58:35,171 INFO [WAL-Archive-0] region.MasterRegionUtils(50): Moved hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/MasterData/oldWALs/jenkins-hbase4.apache.org%2C38633%2C1691729892345.1691729893979 to hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/oldWALs/jenkins-hbase4.apache.org%2C38633%2C1691729892345.1691729893979$masterlocalwal$ 2023-08-11 04:58:35,171 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 04:58:35,171 INFO [M:0;jenkins-hbase4:38633] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-11 04:58:35,172 INFO [M:0;jenkins-hbase4:38633] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38633 2023-08-11 04:58:35,174 DEBUG [M:0;jenkins-hbase4:38633] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38633,1691729892345 already deleted, retry=false 2023-08-11 04:58:35,276 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 04:58:35,276 INFO [M:0;jenkins-hbase4:38633] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38633,1691729892345; zookeeper connection closed. 2023-08-11 04:58:35,276 DEBUG [Listener at localhost/35373-EventThread] zookeeper.ZKWatcher(600): master:38633-0x101f26413a70000, quorum=127.0.0.1:52221, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 04:58:35,278 WARN [Listener at localhost/38145] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 04:58:35,281 INFO [Listener at localhost/38145] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 04:58:35,385 WARN [BP-576763742-172.31.14.131-1691729889350 heartbeating to localhost/127.0.0.1:44477] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 04:58:35,385 WARN [BP-576763742-172.31.14.131-1691729889350 heartbeating to localhost/127.0.0.1:44477] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-576763742-172.31.14.131-1691729889350 (Datanode Uuid 637f416b-844a-4ee5-8d7d-d4ca4477246a) service to localhost/127.0.0.1:44477 2023-08-11 04:58:35,386 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6/dfs/data/data1/current/BP-576763742-172.31.14.131-1691729889350] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:58:35,387 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6/dfs/data/data2/current/BP-576763742-172.31.14.131-1691729889350] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:58:35,390 WARN [Listener at localhost/38145] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 04:58:35,393 INFO [Listener at localhost/38145] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 04:58:35,497 WARN [BP-576763742-172.31.14.131-1691729889350 heartbeating to localhost/127.0.0.1:44477] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 04:58:35,497 WARN [BP-576763742-172.31.14.131-1691729889350 heartbeating to localhost/127.0.0.1:44477] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-576763742-172.31.14.131-1691729889350 (Datanode Uuid 6703ded0-05f8-4c85-9bff-e39c6c38ae76) service to localhost/127.0.0.1:44477 2023-08-11 04:58:35,497 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6/dfs/data/data9/current/BP-576763742-172.31.14.131-1691729889350] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:58:35,498 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6/dfs/data/data10/current/BP-576763742-172.31.14.131-1691729889350] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:58:35,499 WARN [Listener at localhost/38145] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 04:58:35,503 INFO [Listener at localhost/38145] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 04:58:35,606 WARN [BP-576763742-172.31.14.131-1691729889350 heartbeating to localhost/127.0.0.1:44477] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 04:58:35,606 WARN [BP-576763742-172.31.14.131-1691729889350 heartbeating to localhost/127.0.0.1:44477] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-576763742-172.31.14.131-1691729889350 (Datanode Uuid b1bf77b8-9358-4f76-96ad-1314095f3190) service to localhost/127.0.0.1:44477 2023-08-11 04:58:35,607 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6/dfs/data/data7/current/BP-576763742-172.31.14.131-1691729889350] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:58:35,607 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6/dfs/data/data8/current/BP-576763742-172.31.14.131-1691729889350] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:58:35,609 WARN [Listener at localhost/38145] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 04:58:35,612 INFO [Listener at localhost/38145] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 04:58:35,715 WARN [BP-576763742-172.31.14.131-1691729889350 heartbeating to localhost/127.0.0.1:44477] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 04:58:35,716 WARN [BP-576763742-172.31.14.131-1691729889350 heartbeating to localhost/127.0.0.1:44477] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-576763742-172.31.14.131-1691729889350 (Datanode Uuid 34fd3e10-af88-45aa-af3c-78eeddacb634) service to localhost/127.0.0.1:44477 2023-08-11 04:58:35,716 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6/dfs/data/data5/current/BP-576763742-172.31.14.131-1691729889350] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:58:35,716 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6/dfs/data/data6/current/BP-576763742-172.31.14.131-1691729889350] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:58:35,717 WARN [Listener at localhost/38145] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 04:58:35,719 INFO [Listener at localhost/38145] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 04:58:35,820 WARN [BP-576763742-172.31.14.131-1691729889350 heartbeating to localhost/127.0.0.1:44477] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 04:58:35,820 WARN [BP-576763742-172.31.14.131-1691729889350 heartbeating to localhost/127.0.0.1:44477] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-576763742-172.31.14.131-1691729889350 (Datanode Uuid 99bdefbb-b4e1-4adc-b539-94618afaeb4d) service to localhost/127.0.0.1:44477 2023-08-11 04:58:35,821 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6/dfs/data/data3/current/BP-576763742-172.31.14.131-1691729889350] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:58:35,821 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/cluster_494c7cc9-c3d9-0554-1e71-357b9de9edf6/dfs/data/data4/current/BP-576763742-172.31.14.131-1691729889350] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:58:35,853 INFO [Listener at localhost/38145] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 04:58:35,968 INFO [Listener at localhost/38145] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-11 04:58:36,010 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-11 04:58:36,022 INFO [Listener at localhost/38145] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=77 (was 10) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:44477 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44477 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1637391751) connection to localhost/127.0.0.1:44477 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38145 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1637391751) connection to localhost/127.0.0.1:44477 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1637391751) connection to localhost/127.0.0.1:44477 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@1a315fc9 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=464 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=112 (was 155), ProcessCount=171 (was 171), AvailableMemoryMB=3056 (was 3857) 2023-08-11 04:58:36,032 INFO [Listener at localhost/38145] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=77, OpenFileDescriptor=464, MaxFileDescriptor=60000, SystemLoadAverage=112, ProcessCount=171, AvailableMemoryMB=3055 2023-08-11 04:58:36,032 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-11 04:58:36,032 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/hadoop.log.dir so I do NOT create it in target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850 2023-08-11 04:58:36,032 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fe075898-15ff-66a3-385d-857e1f66956c/hadoop.tmp.dir so I do NOT create it in target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850 2023-08-11 04:58:36,032 INFO [Listener at localhost/38145] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/cluster_03d06096-7497-2983-a402-41f72f5dbdb5, deleteOnExit=true 2023-08-11 04:58:36,032 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-11 04:58:36,032 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/test.cache.data in system properties and HBase conf 2023-08-11 04:58:36,033 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/hadoop.tmp.dir in system properties and HBase conf 2023-08-11 04:58:36,033 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/hadoop.log.dir in system properties and HBase conf 2023-08-11 04:58:36,033 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-11 04:58:36,033 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-11 04:58:36,033 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-11 04:58:36,033 DEBUG [Listener at localhost/38145] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-11 04:58:36,033 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-11 04:58:36,034 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-11 04:58:36,034 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-11 04:58:36,034 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 04:58:36,034 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-11 04:58:36,034 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-11 04:58:36,034 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 04:58:36,034 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 04:58:36,034 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-11 04:58:36,035 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/nfs.dump.dir in system properties and HBase conf 2023-08-11 04:58:36,035 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/java.io.tmpdir in system properties and HBase conf 2023-08-11 04:58:36,035 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 04:58:36,035 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-11 04:58:36,035 INFO [Listener at localhost/38145] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-11 04:58:36,039 WARN [Listener at localhost/38145] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 04:58:36,039 WARN [Listener at localhost/38145] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 04:58:36,080 WARN [Listener at localhost/38145] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 04:58:36,083 INFO [Listener at localhost/38145] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 04:58:36,088 INFO [Listener at localhost/38145] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/java.io.tmpdir/Jetty_localhost_35047_hdfs____.k3ndc5/webapp 2023-08-11 04:58:36,185 INFO [Listener at localhost/38145] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35047 2023-08-11 04:58:36,189 WARN [Listener at localhost/38145] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 04:58:36,190 WARN [Listener at localhost/38145] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 04:58:36,231 WARN [Listener at localhost/36197] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 04:58:36,247 WARN [Listener at localhost/36197] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 04:58:36,249 WARN [Listener at localhost/36197] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 04:58:36,250 INFO [Listener at localhost/36197] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 04:58:36,254 INFO [Listener at localhost/36197] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/java.io.tmpdir/Jetty_localhost_36977_datanode____yomf1/webapp 2023-08-11 04:58:36,346 INFO [Listener at localhost/36197] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36977 2023-08-11 04:58:36,352 WARN [Listener at localhost/36893] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 04:58:36,367 WARN [Listener at localhost/36893] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 04:58:36,370 WARN [Listener at localhost/36893] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 04:58:36,371 INFO [Listener at localhost/36893] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 04:58:36,374 INFO [Listener at localhost/36893] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/java.io.tmpdir/Jetty_localhost_43671_datanode____2zpyxk/webapp 2023-08-11 04:58:36,450 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6aa767bcfb4dbab3: Processing first storage report for DS-38838a65-85e8-405c-9dcc-587b106c8932 from datanode 7107d80b-0e7d-482e-a474-41087783b8af 2023-08-11 04:58:36,450 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6aa767bcfb4dbab3: from storage DS-38838a65-85e8-405c-9dcc-587b106c8932 node DatanodeRegistration(127.0.0.1:43299, datanodeUuid=7107d80b-0e7d-482e-a474-41087783b8af, infoPort=42939, infoSecurePort=0, ipcPort=36893, storageInfo=lv=-57;cid=testClusterID;nsid=329372460;c=1691729916042), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 04:58:36,450 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6aa767bcfb4dbab3: Processing first storage report for DS-b0e4834e-a137-40a4-ad61-5e78c3600a38 from datanode 7107d80b-0e7d-482e-a474-41087783b8af 2023-08-11 04:58:36,450 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6aa767bcfb4dbab3: from storage DS-b0e4834e-a137-40a4-ad61-5e78c3600a38 node DatanodeRegistration(127.0.0.1:43299, datanodeUuid=7107d80b-0e7d-482e-a474-41087783b8af, infoPort=42939, infoSecurePort=0, ipcPort=36893, storageInfo=lv=-57;cid=testClusterID;nsid=329372460;c=1691729916042), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 04:58:36,472 INFO [Listener at localhost/36893] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43671 2023-08-11 04:58:36,478 WARN [Listener at localhost/36325] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 04:58:36,559 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd0f85d6f535f0af2: Processing first storage report for DS-0ac95baf-97bc-4a1b-82b6-f2b6a26cdfaf from datanode cd4f99df-cdb9-470a-8f2c-1d4a89d9c736 2023-08-11 04:58:36,559 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd0f85d6f535f0af2: from storage DS-0ac95baf-97bc-4a1b-82b6-f2b6a26cdfaf node DatanodeRegistration(127.0.0.1:34757, datanodeUuid=cd4f99df-cdb9-470a-8f2c-1d4a89d9c736, infoPort=40893, infoSecurePort=0, ipcPort=36325, storageInfo=lv=-57;cid=testClusterID;nsid=329372460;c=1691729916042), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 04:58:36,559 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd0f85d6f535f0af2: Processing first storage report for DS-8cb67ef0-0df3-4a40-971b-cdd4f2e2f0b7 from datanode cd4f99df-cdb9-470a-8f2c-1d4a89d9c736 2023-08-11 04:58:36,559 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd0f85d6f535f0af2: from storage DS-8cb67ef0-0df3-4a40-971b-cdd4f2e2f0b7 node DatanodeRegistration(127.0.0.1:34757, datanodeUuid=cd4f99df-cdb9-470a-8f2c-1d4a89d9c736, infoPort=40893, infoSecurePort=0, ipcPort=36325, storageInfo=lv=-57;cid=testClusterID;nsid=329372460;c=1691729916042), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 04:58:36,585 DEBUG [Listener at localhost/36325] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850 2023-08-11 04:58:36,588 INFO [Listener at localhost/36325] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/cluster_03d06096-7497-2983-a402-41f72f5dbdb5/zookeeper_0, clientPort=60470, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/cluster_03d06096-7497-2983-a402-41f72f5dbdb5/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/cluster_03d06096-7497-2983-a402-41f72f5dbdb5/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-11 04:58:36,590 INFO [Listener at localhost/36325] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60470 2023-08-11 04:58:36,590 INFO [Listener at localhost/36325] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:36,591 INFO [Listener at localhost/36325] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:36,606 INFO [Listener at localhost/36325] util.FSUtils(471): Created version file at hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4 with version=8 2023-08-11 04:58:36,606 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/hbase-staging 2023-08-11 04:58:36,608 INFO [Listener at localhost/36325] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 04:58:36,608 INFO [Listener at localhost/36325] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 04:58:36,608 INFO [Listener at localhost/36325] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 04:58:36,608 INFO [Listener at localhost/36325] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 04:58:36,608 INFO [Listener at localhost/36325] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 04:58:36,609 INFO [Listener at localhost/36325] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 04:58:36,609 INFO [Listener at localhost/36325] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 04:58:36,610 INFO [Listener at localhost/36325] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42283 2023-08-11 04:58:36,610 INFO [Listener at localhost/36325] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:36,611 INFO [Listener at localhost/36325] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:36,612 INFO [Listener at localhost/36325] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42283 connecting to ZooKeeper ensemble=127.0.0.1:60470 2023-08-11 04:58:36,620 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:422830x0, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 04:58:36,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42283-0x101f26475af0000 connected 2023-08-11 04:58:36,636 DEBUG [Listener at localhost/36325] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 04:58:36,636 DEBUG [Listener at localhost/36325] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 04:58:36,636 DEBUG [Listener at localhost/36325] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 04:58:36,637 DEBUG [Listener at localhost/36325] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42283 2023-08-11 04:58:36,637 DEBUG [Listener at localhost/36325] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42283 2023-08-11 04:58:36,637 DEBUG [Listener at localhost/36325] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42283 2023-08-11 04:58:36,637 DEBUG [Listener at localhost/36325] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42283 2023-08-11 04:58:36,638 DEBUG [Listener at localhost/36325] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42283 2023-08-11 04:58:36,638 INFO [Listener at localhost/36325] master.HMaster(444): hbase.rootdir=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4, hbase.cluster.distributed=false 2023-08-11 04:58:36,651 INFO [Listener at localhost/36325] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 04:58:36,651 INFO [Listener at localhost/36325] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 04:58:36,651 INFO [Listener at localhost/36325] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 04:58:36,651 INFO [Listener at localhost/36325] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 04:58:36,652 INFO [Listener at localhost/36325] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 04:58:36,652 INFO [Listener at localhost/36325] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 04:58:36,652 INFO [Listener at localhost/36325] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 04:58:36,653 INFO [Listener at localhost/36325] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35057 2023-08-11 04:58:36,653 INFO [Listener at localhost/36325] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-11 04:58:36,654 DEBUG [Listener at localhost/36325] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-11 04:58:36,655 INFO [Listener at localhost/36325] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:36,656 INFO [Listener at localhost/36325] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:36,657 INFO [Listener at localhost/36325] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35057 connecting to ZooKeeper ensemble=127.0.0.1:60470 2023-08-11 04:58:36,661 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:350570x0, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 04:58:36,663 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35057-0x101f26475af0001 connected 2023-08-11 04:58:36,663 DEBUG [Listener at localhost/36325] zookeeper.ZKUtil(164): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 04:58:36,663 DEBUG [Listener at localhost/36325] zookeeper.ZKUtil(164): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 04:58:36,664 DEBUG [Listener at localhost/36325] zookeeper.ZKUtil(164): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 04:58:36,665 DEBUG [Listener at localhost/36325] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35057 2023-08-11 04:58:36,665 DEBUG [Listener at localhost/36325] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35057 2023-08-11 04:58:36,665 DEBUG [Listener at localhost/36325] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35057 2023-08-11 04:58:36,665 DEBUG [Listener at localhost/36325] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35057 2023-08-11 04:58:36,666 DEBUG [Listener at localhost/36325] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35057 2023-08-11 04:58:36,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42283,1691729916608 2023-08-11 04:58:36,671 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 04:58:36,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42283,1691729916608 2023-08-11 04:58:36,673 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 04:58:36,673 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 04:58:36,673 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:36,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 04:58:36,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 04:58:36,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42283,1691729916608 from backup master directory 2023-08-11 04:58:36,676 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42283,1691729916608 2023-08-11 04:58:36,677 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 04:58:36,677 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 04:58:36,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42283,1691729916608 2023-08-11 04:58:36,693 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/hbase.id with ID: 861c7c89-ce40-488a-b3d2-44370a1f7113 2023-08-11 04:58:36,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:36,712 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:36,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3dee6afe to 127.0.0.1:60470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 04:58:36,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f6411a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 04:58:36,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-11 04:58:36,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-11 04:58:36,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 04:58:36,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/MasterData/data/master/store-tmp 2023-08-11 04:58:36,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:36,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 04:58:36,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:58:36,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:58:36,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 04:58:36,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:58:36,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:58:36,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 04:58:36,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/MasterData/WALs/jenkins-hbase4.apache.org,42283,1691729916608 2023-08-11 04:58:36,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42283%2C1691729916608, suffix=, logDir=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/MasterData/WALs/jenkins-hbase4.apache.org,42283,1691729916608, archiveDir=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/MasterData/oldWALs, maxLogs=10 2023-08-11 04:58:36,756 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43299,DS-38838a65-85e8-405c-9dcc-587b106c8932,DISK] 2023-08-11 04:58:36,758 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34757,DS-0ac95baf-97bc-4a1b-82b6-f2b6a26cdfaf,DISK] 2023-08-11 04:58:36,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/MasterData/WALs/jenkins-hbase4.apache.org,42283,1691729916608/jenkins-hbase4.apache.org%2C42283%2C1691729916608.1691729916742 2023-08-11 04:58:36,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43299,DS-38838a65-85e8-405c-9dcc-587b106c8932,DISK], DatanodeInfoWithStorage[127.0.0.1:34757,DS-0ac95baf-97bc-4a1b-82b6-f2b6a26cdfaf,DISK]] 2023-08-11 04:58:36,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-11 04:58:36,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:36,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:58:36,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:58:36,763 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:58:36,765 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-11 04:58:36,766 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-11 04:58:36,767 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:36,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:58:36,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:58:36,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:58:36,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 04:58:36,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=883740, jitterRate=0.1237344741821289}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 04:58:36,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 04:58:36,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-11 04:58:36,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-11 04:58:36,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-11 04:58:36,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-11 04:58:36,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-11 04:58:36,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-11 04:58:36,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-11 04:58:36,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-11 04:58:36,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-11 04:58:36,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-11 04:58:36,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-11 04:58:36,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-11 04:58:36,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-11 04:58:36,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-11 04:58:36,797 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:36,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-11 04:58:36,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-11 04:58:36,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-11 04:58:36,802 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 04:58:36,802 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 04:58:36,802 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:36,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42283,1691729916608, sessionid=0x101f26475af0000, setting cluster-up flag (Was=false) 2023-08-11 04:58:36,811 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:36,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-11 04:58:36,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42283,1691729916608 2023-08-11 04:58:36,821 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:36,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-11 04:58:36,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42283,1691729916608 2023-08-11 04:58:36,829 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/.hbase-snapshot/.tmp 2023-08-11 04:58:36,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-11 04:58:36,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 04:58:36,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 04:58:36,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 04:58:36,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 04:58:36,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-11 04:58:36,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:36,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 04:58:36,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:36,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1691729946834 2023-08-11 04:58:36,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-11 04:58:36,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-11 04:58:36,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-11 04:58:36,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-11 04:58:36,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-11 04:58:36,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-11 04:58:36,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:36,837 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 04:58:36,838 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-11 04:58:36,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-11 04:58:36,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-11 04:58:36,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-11 04:58:36,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-11 04:58:36,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-11 04:58:36,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691729916839,5,FailOnTimeoutGroup] 2023-08-11 04:58:36,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691729916839,5,FailOnTimeoutGroup] 2023-08-11 04:58:36,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:36,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-11 04:58:36,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:36,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:36,839 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 04:58:36,856 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 04:58:36,857 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 04:58:36,857 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4 2023-08-11 04:58:36,868 INFO [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(951): ClusterId : 861c7c89-ce40-488a-b3d2-44370a1f7113 2023-08-11 04:58:36,869 DEBUG [RS:0;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-11 04:58:36,870 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:36,872 DEBUG [RS:0;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-11 04:58:36,872 DEBUG [RS:0;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-11 04:58:36,872 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 04:58:36,874 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/info 2023-08-11 04:58:36,874 DEBUG [RS:0;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-11 04:58:36,875 DEBUG [RS:0;jenkins-hbase4:35057] zookeeper.ReadOnlyZKClient(139): Connect 0x247be208 to 127.0.0.1:60470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 04:58:36,875 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 04:58:36,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:36,877 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 04:58:36,879 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/rep_barrier 2023-08-11 04:58:36,879 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 04:58:36,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:36,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 04:58:36,881 DEBUG [RS:0;jenkins-hbase4:35057] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2abc18f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 04:58:36,881 DEBUG [RS:0;jenkins-hbase4:35057] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e838978, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 04:58:36,882 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/table 2023-08-11 04:58:36,882 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 04:58:36,883 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:36,884 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740 2023-08-11 04:58:36,885 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740 2023-08-11 04:58:36,888 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 04:58:36,890 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 04:58:36,892 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 04:58:36,893 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=867429, jitterRate=0.10299359261989594}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 04:58:36,893 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 04:58:36,893 DEBUG [RS:0;jenkins-hbase4:35057] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35057 2023-08-11 04:58:36,893 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 04:58:36,893 INFO [RS:0;jenkins-hbase4:35057] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-11 04:58:36,894 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 04:58:36,894 INFO [RS:0;jenkins-hbase4:35057] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-11 04:58:36,894 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 04:58:36,894 DEBUG [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(1022): About to register with Master. 2023-08-11 04:58:36,894 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 04:58:36,894 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 04:58:36,894 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 04:58:36,894 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 04:58:36,894 INFO [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42283,1691729916608 with isa=jenkins-hbase4.apache.org/172.31.14.131:35057, startcode=1691729916651 2023-08-11 04:58:36,894 DEBUG [RS:0;jenkins-hbase4:35057] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-11 04:58:36,897 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 04:58:36,897 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-11 04:58:36,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-11 04:58:36,897 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45019, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-08-11 04:58:36,899 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42283] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:36,899 DEBUG [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4 2023-08-11 04:58:36,899 DEBUG [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36197 2023-08-11 04:58:36,899 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-11 04:58:36,900 DEBUG [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-11 04:58:36,901 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-11 04:58:36,902 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 04:58:36,902 DEBUG [RS:0;jenkins-hbase4:35057] zookeeper.ZKUtil(162): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:36,903 WARN [RS:0;jenkins-hbase4:35057] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 04:58:36,903 INFO [RS:0;jenkins-hbase4:35057] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 04:58:36,903 DEBUG [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:36,903 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35057,1691729916651] 2023-08-11 04:58:36,907 DEBUG [RS:0;jenkins-hbase4:35057] zookeeper.ZKUtil(162): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:36,908 DEBUG [RS:0;jenkins-hbase4:35057] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-11 04:58:36,908 INFO [RS:0;jenkins-hbase4:35057] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-11 04:58:36,910 INFO [RS:0;jenkins-hbase4:35057] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-11 04:58:36,911 INFO [RS:0;jenkins-hbase4:35057] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-11 04:58:36,911 INFO [RS:0;jenkins-hbase4:35057] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:36,914 INFO [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-11 04:58:36,915 INFO [RS:0;jenkins-hbase4:35057] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:36,915 DEBUG [RS:0;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:36,915 DEBUG [RS:0;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:36,916 DEBUG [RS:0;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:36,916 DEBUG [RS:0;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:36,916 DEBUG [RS:0;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:36,916 DEBUG [RS:0;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 04:58:36,916 DEBUG [RS:0;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:36,916 DEBUG [RS:0;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:36,916 DEBUG [RS:0;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:36,916 DEBUG [RS:0;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:58:36,919 INFO [RS:0;jenkins-hbase4:35057] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:36,919 INFO [RS:0;jenkins-hbase4:35057] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:36,919 INFO [RS:0;jenkins-hbase4:35057] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:36,930 INFO [RS:0;jenkins-hbase4:35057] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-11 04:58:36,930 INFO [RS:0;jenkins-hbase4:35057] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35057,1691729916651-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:36,942 INFO [RS:0;jenkins-hbase4:35057] regionserver.Replication(203): jenkins-hbase4.apache.org,35057,1691729916651 started 2023-08-11 04:58:36,942 INFO [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35057,1691729916651, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35057, sessionid=0x101f26475af0001 2023-08-11 04:58:36,942 DEBUG [RS:0;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-11 04:58:36,942 DEBUG [RS:0;jenkins-hbase4:35057] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:36,942 DEBUG [RS:0;jenkins-hbase4:35057] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35057,1691729916651' 2023-08-11 04:58:36,942 DEBUG [RS:0;jenkins-hbase4:35057] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 04:58:36,943 DEBUG [RS:0;jenkins-hbase4:35057] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 04:58:36,943 DEBUG [RS:0;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-11 04:58:36,943 DEBUG [RS:0;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-11 04:58:36,943 DEBUG [RS:0;jenkins-hbase4:35057] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:36,943 DEBUG [RS:0;jenkins-hbase4:35057] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35057,1691729916651' 2023-08-11 04:58:36,943 DEBUG [RS:0;jenkins-hbase4:35057] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-11 04:58:36,943 DEBUG [RS:0;jenkins-hbase4:35057] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-11 04:58:36,944 DEBUG [RS:0;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-11 04:58:36,944 INFO [RS:0;jenkins-hbase4:35057] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-11 04:58:36,944 INFO [RS:0;jenkins-hbase4:35057] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-11 04:58:37,046 INFO [RS:0;jenkins-hbase4:35057] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35057%2C1691729916651, suffix=, logDir=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651, archiveDir=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/oldWALs, maxLogs=32 2023-08-11 04:58:37,051 DEBUG [jenkins-hbase4:42283] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-11 04:58:37,052 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35057,1691729916651, state=OPENING 2023-08-11 04:58:37,054 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-11 04:58:37,055 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:37,056 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 04:58:37,056 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35057,1691729916651}] 2023-08-11 04:58:37,065 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43299,DS-38838a65-85e8-405c-9dcc-587b106c8932,DISK] 2023-08-11 04:58:37,065 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34757,DS-0ac95baf-97bc-4a1b-82b6-f2b6a26cdfaf,DISK] 2023-08-11 04:58:37,067 INFO [RS:0;jenkins-hbase4:35057] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651/jenkins-hbase4.apache.org%2C35057%2C1691729916651.1691729917047 2023-08-11 04:58:37,068 DEBUG [RS:0;jenkins-hbase4:35057] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43299,DS-38838a65-85e8-405c-9dcc-587b106c8932,DISK], DatanodeInfoWithStorage[127.0.0.1:34757,DS-0ac95baf-97bc-4a1b-82b6-f2b6a26cdfaf,DISK]] 2023-08-11 04:58:37,211 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:37,211 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-11 04:58:37,213 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-11 04:58:37,218 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-11 04:58:37,218 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 04:58:37,220 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35057%2C1691729916651.meta, suffix=.meta, logDir=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651, archiveDir=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/oldWALs, maxLogs=32 2023-08-11 04:58:37,235 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34757,DS-0ac95baf-97bc-4a1b-82b6-f2b6a26cdfaf,DISK] 2023-08-11 04:58:37,235 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43299,DS-38838a65-85e8-405c-9dcc-587b106c8932,DISK] 2023-08-11 04:58:37,237 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651/jenkins-hbase4.apache.org%2C35057%2C1691729916651.meta.1691729917221.meta 2023-08-11 04:58:37,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34757,DS-0ac95baf-97bc-4a1b-82b6-f2b6a26cdfaf,DISK], DatanodeInfoWithStorage[127.0.0.1:43299,DS-38838a65-85e8-405c-9dcc-587b106c8932,DISK]] 2023-08-11 04:58:37,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-11 04:58:37,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-11 04:58:37,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-11 04:58:37,239 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-11 04:58:37,239 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-11 04:58:37,239 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:37,239 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-11 04:58:37,239 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-11 04:58:37,241 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 04:58:37,242 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/info 2023-08-11 04:58:37,242 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/info 2023-08-11 04:58:37,243 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 04:58:37,243 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:37,244 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 04:58:37,244 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/rep_barrier 2023-08-11 04:58:37,245 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/rep_barrier 2023-08-11 04:58:37,245 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 04:58:37,245 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:37,246 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 04:58:37,247 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/table 2023-08-11 04:58:37,247 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/table 2023-08-11 04:58:37,248 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 04:58:37,249 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:37,249 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740 2023-08-11 04:58:37,251 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740 2023-08-11 04:58:37,253 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 04:58:37,255 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 04:58:37,256 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=831943, jitterRate=0.057870715856552124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 04:58:37,256 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 04:58:37,257 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1691729917211 2023-08-11 04:58:37,261 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-11 04:58:37,261 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-11 04:58:37,262 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35057,1691729916651, state=OPEN 2023-08-11 04:58:37,264 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-11 04:58:37,264 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 04:58:37,267 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-11 04:58:37,267 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35057,1691729916651 in 209 msec 2023-08-11 04:58:37,269 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-11 04:58:37,269 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 370 msec 2023-08-11 04:58:37,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 440 msec 2023-08-11 04:58:37,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1691729917273, completionTime=-1 2023-08-11 04:58:37,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-11 04:58:37,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-11 04:58:37,276 DEBUG [hconnection-0x66d898ca-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 04:58:37,278 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 04:58:37,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-11 04:58:37,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1691729977279 2023-08-11 04:58:37,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1691730037279 2023-08-11 04:58:37,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-08-11 04:58:37,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42283,1691729916608-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:37,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42283,1691729916608-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:37,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42283,1691729916608-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:37,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42283, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:37,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-11 04:58:37,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-11 04:58:37,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 04:58:37,287 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-11 04:58:37,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-11 04:58:37,289 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-11 04:58:37,290 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-11 04:58:37,292 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/.tmp/data/hbase/namespace/c3d6fa6455911f1ee2c8f4c480bf8f8d 2023-08-11 04:58:37,293 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/.tmp/data/hbase/namespace/c3d6fa6455911f1ee2c8f4c480bf8f8d empty. 2023-08-11 04:58:37,293 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/.tmp/data/hbase/namespace/c3d6fa6455911f1ee2c8f4c480bf8f8d 2023-08-11 04:58:37,293 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-11 04:58:37,308 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-11 04:58:37,310 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c3d6fa6455911f1ee2c8f4c480bf8f8d, NAME => 'hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/.tmp 2023-08-11 04:58:37,320 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:37,320 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c3d6fa6455911f1ee2c8f4c480bf8f8d, disabling compactions & flushes 2023-08-11 04:58:37,320 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. 2023-08-11 04:58:37,320 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. 2023-08-11 04:58:37,320 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. after waiting 0 ms 2023-08-11 04:58:37,320 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. 2023-08-11 04:58:37,320 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. 2023-08-11 04:58:37,320 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c3d6fa6455911f1ee2c8f4c480bf8f8d: 2023-08-11 04:58:37,323 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-11 04:58:37,325 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691729917325"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691729917325"}]},"ts":"1691729917325"} 2023-08-11 04:58:37,327 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-11 04:58:37,328 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-11 04:58:37,329 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691729917329"}]},"ts":"1691729917329"} 2023-08-11 04:58:37,331 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-11 04:58:37,338 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c3d6fa6455911f1ee2c8f4c480bf8f8d, ASSIGN}] 2023-08-11 04:58:37,340 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c3d6fa6455911f1ee2c8f4c480bf8f8d, ASSIGN 2023-08-11 04:58:37,341 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c3d6fa6455911f1ee2c8f4c480bf8f8d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35057,1691729916651; forceNewPlan=false, retain=false 2023-08-11 04:58:37,492 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c3d6fa6455911f1ee2c8f4c480bf8f8d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:37,492 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691729917492"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691729917492"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691729917492"}]},"ts":"1691729917492"} 2023-08-11 04:58:37,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c3d6fa6455911f1ee2c8f4c480bf8f8d, server=jenkins-hbase4.apache.org,35057,1691729916651}] 2023-08-11 04:58:37,653 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. 2023-08-11 04:58:37,653 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c3d6fa6455911f1ee2c8f4c480bf8f8d, NAME => 'hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d.', STARTKEY => '', ENDKEY => ''} 2023-08-11 04:58:37,654 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c3d6fa6455911f1ee2c8f4c480bf8f8d 2023-08-11 04:58:37,654 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:37,654 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c3d6fa6455911f1ee2c8f4c480bf8f8d 2023-08-11 04:58:37,654 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c3d6fa6455911f1ee2c8f4c480bf8f8d 2023-08-11 04:58:37,655 INFO [StoreOpener-c3d6fa6455911f1ee2c8f4c480bf8f8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c3d6fa6455911f1ee2c8f4c480bf8f8d 2023-08-11 04:58:37,657 DEBUG [StoreOpener-c3d6fa6455911f1ee2c8f4c480bf8f8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/namespace/c3d6fa6455911f1ee2c8f4c480bf8f8d/info 2023-08-11 04:58:37,657 DEBUG [StoreOpener-c3d6fa6455911f1ee2c8f4c480bf8f8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/namespace/c3d6fa6455911f1ee2c8f4c480bf8f8d/info 2023-08-11 04:58:37,658 INFO [StoreOpener-c3d6fa6455911f1ee2c8f4c480bf8f8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3d6fa6455911f1ee2c8f4c480bf8f8d columnFamilyName info 2023-08-11 04:58:37,658 INFO [StoreOpener-c3d6fa6455911f1ee2c8f4c480bf8f8d-1] regionserver.HStore(310): Store=c3d6fa6455911f1ee2c8f4c480bf8f8d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:37,659 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/namespace/c3d6fa6455911f1ee2c8f4c480bf8f8d 2023-08-11 04:58:37,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/namespace/c3d6fa6455911f1ee2c8f4c480bf8f8d 2023-08-11 04:58:37,663 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c3d6fa6455911f1ee2c8f4c480bf8f8d 2023-08-11 04:58:37,665 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/namespace/c3d6fa6455911f1ee2c8f4c480bf8f8d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 04:58:37,666 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c3d6fa6455911f1ee2c8f4c480bf8f8d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=777342, jitterRate=-0.011558979749679565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 04:58:37,666 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c3d6fa6455911f1ee2c8f4c480bf8f8d: 2023-08-11 04:58:37,667 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d., pid=6, masterSystemTime=1691729917648 2023-08-11 04:58:37,670 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. 2023-08-11 04:58:37,670 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. 2023-08-11 04:58:37,671 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c3d6fa6455911f1ee2c8f4c480bf8f8d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:37,671 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691729917670"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691729917670"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691729917670"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691729917670"}]},"ts":"1691729917670"} 2023-08-11 04:58:37,676 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-11 04:58:37,676 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c3d6fa6455911f1ee2c8f4c480bf8f8d, server=jenkins-hbase4.apache.org,35057,1691729916651 in 178 msec 2023-08-11 04:58:37,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-11 04:58:37,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c3d6fa6455911f1ee2c8f4c480bf8f8d, ASSIGN in 338 msec 2023-08-11 04:58:37,680 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-11 04:58:37,680 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691729917680"}]},"ts":"1691729917680"} 2023-08-11 04:58:37,682 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-11 04:58:37,685 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-11 04:58:37,687 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 398 msec 2023-08-11 04:58:37,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-11 04:58:37,690 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-11 04:58:37,690 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:37,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-11 04:58:37,704 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 04:58:37,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-08-11 04:58:37,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-11 04:58:37,725 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 04:58:37,729 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-08-11 04:58:37,741 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-11 04:58:37,744 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-11 04:58:37,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.067sec 2023-08-11 04:58:37,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-11 04:58:37,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-11 04:58:37,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-11 04:58:37,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42283,1691729916608-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-11 04:58:37,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42283,1691729916608-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-11 04:58:37,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-11 04:58:37,768 DEBUG [Listener at localhost/36325] zookeeper.ReadOnlyZKClient(139): Connect 0x411f5a54 to 127.0.0.1:60470 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 04:58:37,772 DEBUG [Listener at localhost/36325] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d7edd75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 04:58:37,774 DEBUG [hconnection-0x9b3403c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 04:58:37,776 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 04:58:37,778 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42283,1691729916608 2023-08-11 04:58:37,779 INFO [Listener at localhost/36325] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:58:37,782 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-11 04:58:37,782 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:58:37,783 INFO [Listener at localhost/36325] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-11 04:58:37,785 DEBUG [Listener at localhost/36325] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-11 04:58:37,789 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-11 04:58:37,791 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-11 04:58:37,791 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-11 04:58:37,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-11 04:58:37,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:37,795 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-08-11 04:58:37,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testCompactionRecordDoesntBlockRolling" procId is: 9 2023-08-11 04:58:37,796 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-11 04:58:37,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-11 04:58:37,801 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1 2023-08-11 04:58:37,802 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1 empty. 2023-08-11 04:58:37,803 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1 2023-08-11 04:58:37,803 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testCompactionRecordDoesntBlockRolling regions 2023-08-11 04:58:37,819 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/.tabledesc/.tableinfo.0000000001 2023-08-11 04:58:37,821 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => d08ef49e69c6c2f0235862da6d6ae4e1, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/.tmp 2023-08-11 04:58:37,834 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:37,834 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1604): Closing d08ef49e69c6c2f0235862da6d6ae4e1, disabling compactions & flushes 2023-08-11 04:58:37,834 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:58:37,834 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:58:37,834 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. after waiting 0 ms 2023-08-11 04:58:37,834 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:58:37,834 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:58:37,835 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1558): Region close journal for d08ef49e69c6c2f0235862da6d6ae4e1: 2023-08-11 04:58:37,837 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ADD_TO_META 2023-08-11 04:58:37,839 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1691729917839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691729917839"}]},"ts":"1691729917839"} 2023-08-11 04:58:37,842 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-11 04:58:37,843 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-11 04:58:37,843 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691729917843"}]},"ts":"1691729917843"} 2023-08-11 04:58:37,845 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLING in hbase:meta 2023-08-11 04:58:37,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=d08ef49e69c6c2f0235862da6d6ae4e1, ASSIGN}] 2023-08-11 04:58:37,853 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=d08ef49e69c6c2f0235862da6d6ae4e1, ASSIGN 2023-08-11 04:58:37,854 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=d08ef49e69c6c2f0235862da6d6ae4e1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35057,1691729916651; forceNewPlan=false, retain=false 2023-08-11 04:58:38,005 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d08ef49e69c6c2f0235862da6d6ae4e1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:38,005 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1691729918005"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691729918005"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691729918005"}]},"ts":"1691729918005"} 2023-08-11 04:58:38,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure d08ef49e69c6c2f0235862da6d6ae4e1, server=jenkins-hbase4.apache.org,35057,1691729916651}] 2023-08-11 04:58:38,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:58:38,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d08ef49e69c6c2f0235862da6d6ae4e1, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1.', STARTKEY => '', ENDKEY => ''} 2023-08-11 04:58:38,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testCompactionRecordDoesntBlockRolling d08ef49e69c6c2f0235862da6d6ae4e1 2023-08-11 04:58:38,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:58:38,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d08ef49e69c6c2f0235862da6d6ae4e1 2023-08-11 04:58:38,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d08ef49e69c6c2f0235862da6d6ae4e1 2023-08-11 04:58:38,168 INFO [StoreOpener-d08ef49e69c6c2f0235862da6d6ae4e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d08ef49e69c6c2f0235862da6d6ae4e1 2023-08-11 04:58:38,170 DEBUG [StoreOpener-d08ef49e69c6c2f0235862da6d6ae4e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info 2023-08-11 04:58:38,170 DEBUG [StoreOpener-d08ef49e69c6c2f0235862da6d6ae4e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info 2023-08-11 04:58:38,170 INFO [StoreOpener-d08ef49e69c6c2f0235862da6d6ae4e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d08ef49e69c6c2f0235862da6d6ae4e1 columnFamilyName info 2023-08-11 04:58:38,171 INFO [StoreOpener-d08ef49e69c6c2f0235862da6d6ae4e1-1] regionserver.HStore(310): Store=d08ef49e69c6c2f0235862da6d6ae4e1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:58:38,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1 2023-08-11 04:58:38,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1 2023-08-11 04:58:38,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d08ef49e69c6c2f0235862da6d6ae4e1 2023-08-11 04:58:38,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 04:58:38,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d08ef49e69c6c2f0235862da6d6ae4e1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=874515, jitterRate=0.11200430989265442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 04:58:38,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d08ef49e69c6c2f0235862da6d6ae4e1: 2023-08-11 04:58:38,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1., pid=11, masterSystemTime=1691729918161 2023-08-11 04:58:38,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:58:38,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:58:38,183 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d08ef49e69c6c2f0235862da6d6ae4e1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:38,183 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1691729918182"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691729918182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691729918182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691729918182"}]},"ts":"1691729918182"} 2023-08-11 04:58:38,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-11 04:58:38,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure d08ef49e69c6c2f0235862da6d6ae4e1, server=jenkins-hbase4.apache.org,35057,1691729916651 in 177 msec 2023-08-11 04:58:38,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-11 04:58:38,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=d08ef49e69c6c2f0235862da6d6ae4e1, ASSIGN in 338 msec 2023-08-11 04:58:38,192 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-11 04:58:38,192 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691729918192"}]},"ts":"1691729918192"} 2023-08-11 04:58:38,194 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLED in hbase:meta 2023-08-11 04:58:38,197 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_POST_OPERATION 2023-08-11 04:58:38,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling in 406 msec 2023-08-11 04:58:38,348 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-11 04:58:42,506 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-11 04:58:42,506 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-08-11 04:58:42,908 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-11 04:58:42,909 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-11 04:58:42,909 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 04:58:43,670 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-11 04:58:47,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-11 04:58:47,799 INFO [Listener at localhost/36325] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testCompactionRecordDoesntBlockRolling, procId: 9 completed 2023-08-11 04:58:47,802 DEBUG [Listener at localhost/36325] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:47,802 DEBUG [Listener at localhost/36325] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:58:47,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-11 04:58:47,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] procedure.ProcedureCoordinator(165): Submitting procedure hbase:namespace 2023-08-11 04:58:47,822 INFO [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase:namespace' 2023-08-11 04:58:47,822 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 04:58:47,823 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase:namespace' starting 'acquire' 2023-08-11 04:58:47,823 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase:namespace', kicking off acquire phase on members. 2023-08-11 04:58:47,823 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 04:58:47,823 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-11 04:58:47,825 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 04:58:47,825 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 04:58:47,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 04:58:47,825 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase:namespace 2023-08-11 04:58:47,825 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-11 04:58:47,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 04:58:47,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-11 04:58:47,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-11 04:58:47,827 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase:namespace 2023-08-11 04:58:47,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase:namespace 2023-08-11 04:58:47,828 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase:namespace' with timeout 60000ms 2023-08-11 04:58:47,828 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 04:58:47,829 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase:namespace' starting 'acquire' stage 2023-08-11 04:58:47,829 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-11 04:58:47,829 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-11 04:58:47,829 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. 2023-08-11 04:58:47,829 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. started... 2023-08-11 04:58:47,830 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3d6fa6455911f1ee2c8f4c480bf8f8d 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-11 04:58:47,843 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/namespace/c3d6fa6455911f1ee2c8f4c480bf8f8d/.tmp/info/4b26c85392794edaa94eb1522034123e 2023-08-11 04:58:47,855 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/namespace/c3d6fa6455911f1ee2c8f4c480bf8f8d/.tmp/info/4b26c85392794edaa94eb1522034123e as hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/namespace/c3d6fa6455911f1ee2c8f4c480bf8f8d/info/4b26c85392794edaa94eb1522034123e 2023-08-11 04:58:47,861 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/namespace/c3d6fa6455911f1ee2c8f4c480bf8f8d/info/4b26c85392794edaa94eb1522034123e, entries=2, sequenceid=6, filesize=4.8 K 2023-08-11 04:58:47,863 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c3d6fa6455911f1ee2c8f4c480bf8f8d in 32ms, sequenceid=6, compaction requested=false 2023-08-11 04:58:47,863 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3d6fa6455911f1ee2c8f4c480bf8f8d: 2023-08-11 04:58:47,863 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. 2023-08-11 04:58:47,863 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-11 04:58:47,863 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-11 04:58:47,863 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,863 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase:namespace' locally acquired 2023-08-11 04:58:47,863 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35057,1691729916651' joining acquired barrier for procedure (hbase:namespace) in zk 2023-08-11 04:58:47,866 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,866 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 04:58:47,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 04:58:47,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 04:58:47,866 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 04:58:47,866 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase:namespace' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-11 04:58:47,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 04:58:47,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 04:58:47,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-11 04:58:47,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 04:58:47,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35057,1691729916651' joining acquired barrier for procedure 'hbase:namespace' on coordinator 2023-08-11 04:58:47,868 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase:namespace' starting 'in-barrier' execution. 2023-08-11 04:58:47,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b47def9[Count = 0] remaining members to acquire global barrier 2023-08-11 04:58:47,868 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 04:58:47,870 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 04:58:47,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 04:58:47,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 04:58:47,871 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase:namespace' received 'reached' from coordinator. 2023-08-11 04:58:47,871 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase:namespace' locally completed 2023-08-11 04:58:47,871 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase:namespace' completed for member 'jenkins-hbase4.apache.org,35057,1691729916651' in zk 2023-08-11 04:58:47,871 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,871 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-11 04:58:47,874 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,874 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase:namespace' has notified controller of completion 2023-08-11 04:58:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 04:58:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 04:58:47,874 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 04:58:47,874 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase:namespace' completed. 2023-08-11 04:58:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 04:58:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 04:58:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-11 04:58:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 04:58:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-11 04:58:47,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase:namespace' member 'jenkins-hbase4.apache.org,35057,1691729916651': 2023-08-11 04:58:47,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35057,1691729916651' released barrier for procedure'hbase:namespace', counting down latch. Waiting for 0 more 2023-08-11 04:58:47,877 INFO [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase:namespace' execution completed 2023-08-11 04:58:47,877 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-11 04:58:47,877 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-11 04:58:47,877 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase:namespace 2023-08-11 04:58:47,878 INFO [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase:namespaceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-11 04:58:47,880 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 04:58:47,880 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 04:58:47,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 04:58:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 04:58:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 04:58:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 04:58:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 04:58:47,880 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 04:58:47,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 04:58:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 04:58:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 04:58:47,881 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 04:58:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-11 04:58:47,882 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 04:58:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-11 04:58:47,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 04:58:47,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-11 04:58:47,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,889 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,889 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-11 04:58:47,889 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 04:58:47,889 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-11 04:58:47,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 04:58:47,889 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:47,889 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 04:58:47,889 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 04:58:47,889 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 04:58:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 04:58:47,890 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 04:58:47,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase:namespace' 2023-08-11 04:58:47,890 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 04:58:47,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-11 04:58:47,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 04:58:47,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 04:58:47,892 DEBUG [Listener at localhost/36325] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase:namespace'' to complete. (max 20000 ms per retry) 2023-08-11 04:58:47,892 DEBUG [Listener at localhost/36325] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-11 04:58:57,892 DEBUG [Listener at localhost/36325] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-11 04:58:57,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-11 04:58:57,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-11 04:58:57,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,911 INFO [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 04:58:57,911 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 04:58:57,912 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-11 04:58:57,912 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-11 04:58:57,912 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,912 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,914 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,914 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 04:58:57,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 04:58:57,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 04:58:57,914 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,914 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-11 04:58:57,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-11 04:58:57,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,915 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,915 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,916 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-11 04:58:57,916 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 04:58:57,916 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-11 04:58:57,916 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-11 04:58:57,916 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-11 04:58:57,916 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:58:57,916 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. started... 2023-08-11 04:58:57,917 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d08ef49e69c6c2f0235862da6d6ae4e1 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-11 04:58:57,932 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/.tmp/info/7dd6d0c9eb7140b292e20ff388e2a338 2023-08-11 04:58:57,941 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/.tmp/info/7dd6d0c9eb7140b292e20ff388e2a338 as hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/7dd6d0c9eb7140b292e20ff388e2a338 2023-08-11 04:58:57,948 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/7dd6d0c9eb7140b292e20ff388e2a338, entries=1, sequenceid=5, filesize=5.8 K 2023-08-11 04:58:57,950 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for d08ef49e69c6c2f0235862da6d6ae4e1 in 33ms, sequenceid=5, compaction requested=false 2023-08-11 04:58:57,950 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d08ef49e69c6c2f0235862da6d6ae4e1: 2023-08-11 04:58:57,950 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:58:57,950 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-11 04:58:57,951 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-11 04:58:57,951 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,951 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-11 04:58:57,951 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35057,1691729916651' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-11 04:58:57,954 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,954 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 04:58:57,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 04:58:57,954 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,954 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-11 04:58:57,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 04:58:57,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 04:58:57,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 04:58:57,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35057,1691729916651' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-11 04:58:57,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f785f49[Count = 0] remaining members to acquire global barrier 2023-08-11 04:58:57,956 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-11 04:58:57,956 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,957 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-11 04:58:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-11 04:58:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,35057,1691729916651' in zk 2023-08-11 04:58:57,958 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,958 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-11 04:58:57,959 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-11 04:58:57,959 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,959 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 04:58:57,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 04:58:57,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 04:58:57,959 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-11 04:58:57,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 04:58:57,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 04:58:57,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 04:58:57,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,35057,1691729916651': 2023-08-11 04:58:57,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35057,1691729916651' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-11 04:58:57,963 INFO [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-11 04:58:57,963 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-11 04:58:57,963 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-11 04:58:57,963 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,963 INFO [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-11 04:58:57,969 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,969 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 04:58:57,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 04:58:57,969 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 04:58:57,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 04:58:57,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 04:58:57,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 04:58:57,970 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 04:58:57,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,971 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 04:58:57,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,974 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,975 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,975 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,975 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:58:57,975 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,975 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,975 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:58:57,975 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 04:58:57,975 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 04:58:57,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 04:58:57,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 04:58:57,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 04:58:57,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-11 04:58:57,975 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-11 04:58:57,975 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 04:58:57,976 DEBUG [Listener at localhost/36325] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-11 04:58:57,976 DEBUG [Listener at localhost/36325] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-11 04:58:57,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 04:58:57,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 04:59:07,976 DEBUG [Listener at localhost/36325] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-11 04:59:07,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-11 04:59:07,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-11 04:59:07,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-11 04:59:07,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:07,988 INFO [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 04:59:07,988 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 04:59:07,988 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-11 04:59:07,988 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-11 04:59:07,989 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:07,989 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:07,991 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:07,991 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 04:59:07,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 04:59:07,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 04:59:07,991 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:07,992 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-11 04:59:07,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:07,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:07,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-11 04:59:07,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:07,992 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:07,993 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-11 04:59:07,993 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:07,993 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-11 04:59:07,993 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 04:59:07,993 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-11 04:59:07,993 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-11 04:59:07,993 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-11 04:59:07,994 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:59:07,994 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. started... 2023-08-11 04:59:07,994 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d08ef49e69c6c2f0235862da6d6ae4e1 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-11 04:59:08,007 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/.tmp/info/da75896bf63e40b4baceadb3b6836fdd 2023-08-11 04:59:08,014 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/.tmp/info/da75896bf63e40b4baceadb3b6836fdd as hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/da75896bf63e40b4baceadb3b6836fdd 2023-08-11 04:59:08,022 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/da75896bf63e40b4baceadb3b6836fdd, entries=1, sequenceid=9, filesize=5.8 K 2023-08-11 04:59:08,023 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for d08ef49e69c6c2f0235862da6d6ae4e1 in 29ms, sequenceid=9, compaction requested=false 2023-08-11 04:59:08,023 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d08ef49e69c6c2f0235862da6d6ae4e1: 2023-08-11 04:59:08,023 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:59:08,023 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-11 04:59:08,023 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-11 04:59:08,023 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:08,024 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-11 04:59:08,024 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35057,1691729916651' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-11 04:59:08,025 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,025 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 04:59:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 04:59:08,026 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,026 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-11 04:59:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 04:59:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 04:59:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 04:59:08,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35057,1691729916651' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-11 04:59:08,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a7ad4c2[Count = 0] remaining members to acquire global barrier 2023-08-11 04:59:08,028 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-11 04:59:08,028 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,029 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,029 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-11 04:59:08,029 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:08,029 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-11 04:59:08,029 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-11 04:59:08,029 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,35057,1691729916651' in zk 2023-08-11 04:59:08,031 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:08,031 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-11 04:59:08,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:08,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 04:59:08,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 04:59:08,031 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 04:59:08,031 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-11 04:59:08,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 04:59:08,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 04:59:08,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:08,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 04:59:08,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,35057,1691729916651': 2023-08-11 04:59:08,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35057,1691729916651' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-11 04:59:08,034 INFO [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-11 04:59:08,034 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-11 04:59:08,034 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-11 04:59:08,034 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,034 INFO [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-11 04:59:08,037 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,037 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 04:59:08,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 04:59:08,037 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 04:59:08,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 04:59:08,038 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:08,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 04:59:08,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 04:59:08,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 04:59:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,039 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:08,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 04:59:08,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:08,042 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:08,042 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,042 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 04:59:08,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 04:59:08,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-11 04:59:08,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 04:59:08,042 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 04:59:08,042 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 04:59:08,042 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-11 04:59:08,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 04:59:08,043 DEBUG [Listener at localhost/36325] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-11 04:59:08,043 DEBUG [Listener at localhost/36325] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-11 04:59:08,043 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:08,043 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,043 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:08,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 04:59:08,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 04:59:08,043 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,043 DEBUG [Listener at localhost/36325] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-11 04:59:18,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-11 04:59:18,063 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34757,DS-0ac95baf-97bc-4a1b-82b6-f2b6a26cdfaf,DISK] 2023-08-11 04:59:18,063 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43299,DS-38838a65-85e8-405c-9dcc-587b106c8932,DISK] 2023-08-11 04:59:18,067 INFO [Listener at localhost/36325] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651/jenkins-hbase4.apache.org%2C35057%2C1691729916651.1691729917047 with entries=13, filesize=6.36 KB; new WAL /user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651/jenkins-hbase4.apache.org%2C35057%2C1691729916651.1691729958047 2023-08-11 04:59:18,067 DEBUG [Listener at localhost/36325] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34757,DS-0ac95baf-97bc-4a1b-82b6-f2b6a26cdfaf,DISK], DatanodeInfoWithStorage[127.0.0.1:43299,DS-38838a65-85e8-405c-9dcc-587b106c8932,DISK]] 2023-08-11 04:59:18,067 DEBUG [Listener at localhost/36325] wal.AbstractFSWAL(716): hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651/jenkins-hbase4.apache.org%2C35057%2C1691729916651.1691729917047 is not closed yet, will try archiving it next time 2023-08-11 04:59:18,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-11 04:59:18,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-11 04:59:18,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,075 INFO [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 04:59:18,075 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 04:59:18,075 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-11 04:59:18,075 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-11 04:59:18,076 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,076 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,077 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,077 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 04:59:18,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 04:59:18,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 04:59:18,078 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,078 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-11 04:59:18,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-11 04:59:18,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,079 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-11 04:59:18,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,079 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-11 04:59:18,079 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 04:59:18,079 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-11 04:59:18,079 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-11 04:59:18,079 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-11 04:59:18,079 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:59:18,079 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. started... 2023-08-11 04:59:18,080 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d08ef49e69c6c2f0235862da6d6ae4e1 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-11 04:59:18,091 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=13 (bloomFilter=true), to=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/.tmp/info/ff5c78c0273f4b6588b9ca143db15f1b 2023-08-11 04:59:18,100 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/.tmp/info/ff5c78c0273f4b6588b9ca143db15f1b as hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/ff5c78c0273f4b6588b9ca143db15f1b 2023-08-11 04:59:18,106 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/ff5c78c0273f4b6588b9ca143db15f1b, entries=1, sequenceid=13, filesize=5.8 K 2023-08-11 04:59:18,107 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for d08ef49e69c6c2f0235862da6d6ae4e1 in 27ms, sequenceid=13, compaction requested=true 2023-08-11 04:59:18,107 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d08ef49e69c6c2f0235862da6d6ae4e1: 2023-08-11 04:59:18,107 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:59:18,107 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-11 04:59:18,107 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-11 04:59:18,107 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,107 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-11 04:59:18,107 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35057,1691729916651' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-11 04:59:18,109 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,109 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 04:59:18,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 04:59:18,109 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,109 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-11 04:59:18,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 04:59:18,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 04:59:18,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 04:59:18,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35057,1691729916651' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-11 04:59:18,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4eff0448[Count = 0] remaining members to acquire global barrier 2023-08-11 04:59:18,111 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-11 04:59:18,111 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,113 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,113 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-11 04:59:18,113 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-11 04:59:18,113 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,113 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-11 04:59:18,113 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,35057,1691729916651' in zk 2023-08-11 04:59:18,115 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,115 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-11 04:59:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 04:59:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 04:59:18,115 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 04:59:18,115 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-11 04:59:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 04:59:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 04:59:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 04:59:18,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,35057,1691729916651': 2023-08-11 04:59:18,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35057,1691729916651' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-11 04:59:18,118 INFO [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-11 04:59:18,118 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-11 04:59:18,118 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-11 04:59:18,118 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,118 INFO [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-11 04:59:18,119 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,119 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 04:59:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 04:59:18,119 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 04:59:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 04:59:18,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 04:59:18,120 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 04:59:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 04:59:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,121 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 04:59:18,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,124 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,124 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 04:59:18,124 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 04:59:18,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-11 04:59:18,124 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 04:59:18,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 04:59:18,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 04:59:18,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-11 04:59:18,124 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 04:59:18,124 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,125 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:18,125 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,125 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 04:59:18,125 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:18,125 DEBUG [Listener at localhost/36325] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-11 04:59:18,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 04:59:18,125 DEBUG [Listener at localhost/36325] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-11 04:59:28,125 DEBUG [Listener at localhost/36325] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-11 04:59:28,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-11 04:59:28,128 DEBUG [Listener at localhost/36325] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 04:59:28,133 DEBUG [Listener at localhost/36325] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 17694 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 04:59:28,135 DEBUG [Listener at localhost/36325] regionserver.HStore(1912): d08ef49e69c6c2f0235862da6d6ae4e1/info is initiating minor compaction (all files) 2023-08-11 04:59:28,135 INFO [Listener at localhost/36325] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-11 04:59:28,135 INFO [Listener at localhost/36325] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:28,135 INFO [Listener at localhost/36325] regionserver.HRegion(2259): Starting compaction of d08ef49e69c6c2f0235862da6d6ae4e1/info in TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:59:28,135 INFO [Listener at localhost/36325] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/7dd6d0c9eb7140b292e20ff388e2a338, hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/da75896bf63e40b4baceadb3b6836fdd, hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/ff5c78c0273f4b6588b9ca143db15f1b] into tmpdir=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/.tmp, totalSize=17.3 K 2023-08-11 04:59:28,136 DEBUG [Listener at localhost/36325] compactions.Compactor(207): Compacting 7dd6d0c9eb7140b292e20ff388e2a338, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1691729937903 2023-08-11 04:59:28,137 DEBUG [Listener at localhost/36325] compactions.Compactor(207): Compacting da75896bf63e40b4baceadb3b6836fdd, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1691729947980 2023-08-11 04:59:28,137 DEBUG [Listener at localhost/36325] compactions.Compactor(207): Compacting ff5c78c0273f4b6588b9ca143db15f1b, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1691729958045 2023-08-11 04:59:28,158 INFO [Listener at localhost/36325] throttle.PressureAwareThroughputController(145): d08ef49e69c6c2f0235862da6d6ae4e1#info#compaction#9 average throughput is 3.01 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 04:59:28,177 DEBUG [Listener at localhost/36325] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/.tmp/info/c93bc4518b5f4ff0abc257a55ad02d2c as hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/c93bc4518b5f4ff0abc257a55ad02d2c 2023-08-11 04:59:28,190 INFO [Listener at localhost/36325] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d08ef49e69c6c2f0235862da6d6ae4e1/info of d08ef49e69c6c2f0235862da6d6ae4e1 into c93bc4518b5f4ff0abc257a55ad02d2c(size=7.9 K), total size for store is 7.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 04:59:28,190 DEBUG [Listener at localhost/36325] regionserver.HRegion(2289): Compaction status journal for d08ef49e69c6c2f0235862da6d6ae4e1: 2023-08-11 04:59:28,206 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34757,DS-0ac95baf-97bc-4a1b-82b6-f2b6a26cdfaf,DISK] 2023-08-11 04:59:28,207 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43299,DS-38838a65-85e8-405c-9dcc-587b106c8932,DISK] 2023-08-11 04:59:28,209 INFO [Listener at localhost/36325] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651/jenkins-hbase4.apache.org%2C35057%2C1691729916651.1691729958047 with entries=4, filesize=2.43 KB; new WAL /user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651/jenkins-hbase4.apache.org%2C35057%2C1691729916651.1691729968192 2023-08-11 04:59:28,209 DEBUG [Listener at localhost/36325] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34757,DS-0ac95baf-97bc-4a1b-82b6-f2b6a26cdfaf,DISK], DatanodeInfoWithStorage[127.0.0.1:43299,DS-38838a65-85e8-405c-9dcc-587b106c8932,DISK]] 2023-08-11 04:59:28,209 DEBUG [Listener at localhost/36325] wal.AbstractFSWAL(716): hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651/jenkins-hbase4.apache.org%2C35057%2C1691729916651.1691729958047 is not closed yet, will try archiving it next time 2023-08-11 04:59:28,210 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651/jenkins-hbase4.apache.org%2C35057%2C1691729916651.1691729917047 to hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/oldWALs/jenkins-hbase4.apache.org%2C35057%2C1691729916651.1691729917047 2023-08-11 04:59:28,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-11 04:59:28,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-11 04:59:28,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,217 INFO [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 04:59:28,217 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 04:59:28,218 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-11 04:59:28,218 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-11 04:59:28,218 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,218 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,223 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,223 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 04:59:28,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 04:59:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 04:59:28,224 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,224 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-11 04:59:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-11 04:59:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,224 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,224 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-11 04:59:28,224 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,225 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-11 04:59:28,225 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 04:59:28,225 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-11 04:59:28,225 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-11 04:59:28,225 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-11 04:59:28,225 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:59:28,225 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. started... 2023-08-11 04:59:28,225 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d08ef49e69c6c2f0235862da6d6ae4e1 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-11 04:59:28,238 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=18 (bloomFilter=true), to=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/.tmp/info/4275af54700a4657b96cf7fa6018ece4 2023-08-11 04:59:28,244 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/.tmp/info/4275af54700a4657b96cf7fa6018ece4 as hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/4275af54700a4657b96cf7fa6018ece4 2023-08-11 04:59:28,250 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/4275af54700a4657b96cf7fa6018ece4, entries=1, sequenceid=18, filesize=5.8 K 2023-08-11 04:59:28,251 INFO [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for d08ef49e69c6c2f0235862da6d6ae4e1 in 26ms, sequenceid=18, compaction requested=false 2023-08-11 04:59:28,251 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d08ef49e69c6c2f0235862da6d6ae4e1: 2023-08-11 04:59:28,251 DEBUG [rs(jenkins-hbase4.apache.org,35057,1691729916651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:59:28,251 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-11 04:59:28,252 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-11 04:59:28,252 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,252 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-11 04:59:28,252 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35057,1691729916651' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-11 04:59:28,253 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,253 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 04:59:28,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 04:59:28,254 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 04:59:28,254 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-11 04:59:28,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 04:59:28,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 04:59:28,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35057,1691729916651' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-11 04:59:28,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b5abb78[Count = 0] remaining members to acquire global barrier 2023-08-11 04:59:28,256 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-11 04:59:28,256 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,257 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,257 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-11 04:59:28,257 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-11 04:59:28,257 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,257 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,35057,1691729916651' in zk 2023-08-11 04:59:28,257 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-11 04:59:28,259 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,259 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-11 04:59:28,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 04:59:28,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 04:59:28,259 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 04:59:28,259 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1691729916651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-11 04:59:28,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 04:59:28,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 04:59:28,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 04:59:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,35057,1691729916651': 2023-08-11 04:59:28,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35057,1691729916651' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-11 04:59:28,262 INFO [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-11 04:59:28,262 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-11 04:59:28,262 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-11 04:59:28,262 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,262 INFO [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-11 04:59:28,265 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,265 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 04:59:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 04:59:28,265 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 04:59:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 04:59:28,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 04:59:28,266 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 04:59:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 04:59:28,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,267 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 04:59:28,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,270 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 04:59:28,270 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 04:59:28,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 04:59:28,270 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 04:59:28,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-11 04:59:28,270 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,270 DEBUG [(jenkins-hbase4.apache.org,42283,1691729916608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 04:59:28,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 04:59:28,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-11 04:59:28,270 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,271 DEBUG [Listener at localhost/36325] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-11 04:59:28,271 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:28,271 DEBUG [Listener at localhost/36325] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-11 04:59:28,271 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,271 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,271 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 04:59:28,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 04:59:28,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 04:59:38,271 DEBUG [Listener at localhost/36325] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-11 04:59:38,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42283] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-11 04:59:38,290 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43299,DS-38838a65-85e8-405c-9dcc-587b106c8932,DISK] 2023-08-11 04:59:38,291 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34757,DS-0ac95baf-97bc-4a1b-82b6-f2b6a26cdfaf,DISK] 2023-08-11 04:59:38,292 INFO [Listener at localhost/36325] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651/jenkins-hbase4.apache.org%2C35057%2C1691729916651.1691729968192 with entries=3, filesize=1.94 KB; new WAL /user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651/jenkins-hbase4.apache.org%2C35057%2C1691729916651.1691729978275 2023-08-11 04:59:38,292 DEBUG [Listener at localhost/36325] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43299,DS-38838a65-85e8-405c-9dcc-587b106c8932,DISK], DatanodeInfoWithStorage[127.0.0.1:34757,DS-0ac95baf-97bc-4a1b-82b6-f2b6a26cdfaf,DISK]] 2023-08-11 04:59:38,293 DEBUG [Listener at localhost/36325] wal.AbstractFSWAL(716): hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651/jenkins-hbase4.apache.org%2C35057%2C1691729916651.1691729968192 is not closed yet, will try archiving it next time 2023-08-11 04:59:38,293 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-11 04:59:38,293 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651/jenkins-hbase4.apache.org%2C35057%2C1691729916651.1691729958047 to hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/oldWALs/jenkins-hbase4.apache.org%2C35057%2C1691729916651.1691729958047 2023-08-11 04:59:38,293 INFO [Listener at localhost/36325] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-11 04:59:38,293 DEBUG [Listener at localhost/36325] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x411f5a54 to 127.0.0.1:60470 2023-08-11 04:59:38,294 DEBUG [Listener at localhost/36325] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 04:59:38,294 DEBUG [Listener at localhost/36325] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-11 04:59:38,294 DEBUG [Listener at localhost/36325] util.JVMClusterUtil(257): Found active master hash=1162128683, stopped=false 2023-08-11 04:59:38,294 INFO [Listener at localhost/36325] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42283,1691729916608 2023-08-11 04:59:38,300 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 04:59:38,300 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 04:59:38,300 INFO [Listener at localhost/36325] procedure2.ProcedureExecutor(629): Stopping 2023-08-11 04:59:38,300 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:59:38,300 DEBUG [Listener at localhost/36325] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3dee6afe to 127.0.0.1:60470 2023-08-11 04:59:38,300 DEBUG [Listener at localhost/36325] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 04:59:38,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 04:59:38,301 INFO [Listener at localhost/36325] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35057,1691729916651' ***** 2023-08-11 04:59:38,301 INFO [Listener at localhost/36325] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-11 04:59:38,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 04:59:38,301 INFO [RS:0;jenkins-hbase4:35057] regionserver.HeapMemoryManager(220): Stopping 2023-08-11 04:59:38,301 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-11 04:59:38,301 INFO [RS:0;jenkins-hbase4:35057] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-11 04:59:38,302 INFO [RS:0;jenkins-hbase4:35057] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-11 04:59:38,302 INFO [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(3305): Received CLOSE for c3d6fa6455911f1ee2c8f4c480bf8f8d 2023-08-11 04:59:38,302 INFO [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(3305): Received CLOSE for d08ef49e69c6c2f0235862da6d6ae4e1 2023-08-11 04:59:38,302 INFO [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:38,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c3d6fa6455911f1ee2c8f4c480bf8f8d, disabling compactions & flushes 2023-08-11 04:59:38,302 DEBUG [RS:0;jenkins-hbase4:35057] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x247be208 to 127.0.0.1:60470 2023-08-11 04:59:38,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. 2023-08-11 04:59:38,302 DEBUG [RS:0;jenkins-hbase4:35057] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 04:59:38,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. 2023-08-11 04:59:38,302 INFO [RS:0;jenkins-hbase4:35057] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-11 04:59:38,303 INFO [RS:0;jenkins-hbase4:35057] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-11 04:59:38,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. after waiting 0 ms 2023-08-11 04:59:38,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. 2023-08-11 04:59:38,303 INFO [RS:0;jenkins-hbase4:35057] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-11 04:59:38,303 INFO [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-11 04:59:38,306 INFO [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-08-11 04:59:38,306 DEBUG [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, c3d6fa6455911f1ee2c8f4c480bf8f8d=hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d., d08ef49e69c6c2f0235862da6d6ae4e1=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1.} 2023-08-11 04:59:38,306 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 04:59:38,307 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 04:59:38,307 DEBUG [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(1504): Waiting on 1588230740, c3d6fa6455911f1ee2c8f4c480bf8f8d, d08ef49e69c6c2f0235862da6d6ae4e1 2023-08-11 04:59:38,307 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 04:59:38,307 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 04:59:38,307 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 04:59:38,308 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=3.10 KB heapSize=5.61 KB 2023-08-11 04:59:38,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/namespace/c3d6fa6455911f1ee2c8f4c480bf8f8d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-11 04:59:38,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. 2023-08-11 04:59:38,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c3d6fa6455911f1ee2c8f4c480bf8f8d: 2023-08-11 04:59:38,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1691729917286.c3d6fa6455911f1ee2c8f4c480bf8f8d. 2023-08-11 04:59:38,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d08ef49e69c6c2f0235862da6d6ae4e1, disabling compactions & flushes 2023-08-11 04:59:38,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:59:38,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:59:38,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. after waiting 0 ms 2023-08-11 04:59:38,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:59:38,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d08ef49e69c6c2f0235862da6d6ae4e1 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-11 04:59:38,328 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.84 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/.tmp/info/f37127dd455e4a2dba9a73b59cb02410 2023-08-11 04:59:38,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=22 (bloomFilter=true), to=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/.tmp/info/f7a19da80a0740c2bfe4ea78a218839a 2023-08-11 04:59:38,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/.tmp/info/f7a19da80a0740c2bfe4ea78a218839a as hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/f7a19da80a0740c2bfe4ea78a218839a 2023-08-11 04:59:38,354 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=264 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/.tmp/table/9fdfcd00fbe5432c90e7387defb6f10a 2023-08-11 04:59:38,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/f7a19da80a0740c2bfe4ea78a218839a, entries=1, sequenceid=22, filesize=5.8 K 2023-08-11 04:59:38,362 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/.tmp/info/f37127dd455e4a2dba9a73b59cb02410 as hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/info/f37127dd455e4a2dba9a73b59cb02410 2023-08-11 04:59:38,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for d08ef49e69c6c2f0235862da6d6ae4e1 in 49ms, sequenceid=22, compaction requested=true 2023-08-11 04:59:38,367 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/info/f37127dd455e4a2dba9a73b59cb02410, entries=20, sequenceid=14, filesize=7.6 K 2023-08-11 04:59:38,373 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/7dd6d0c9eb7140b292e20ff388e2a338, hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/da75896bf63e40b4baceadb3b6836fdd, hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/ff5c78c0273f4b6588b9ca143db15f1b] to archive 2023-08-11 04:59:38,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/.tmp/table/9fdfcd00fbe5432c90e7387defb6f10a as hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/table/9fdfcd00fbe5432c90e7387defb6f10a 2023-08-11 04:59:38,374 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-11 04:59:38,378 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/7dd6d0c9eb7140b292e20ff388e2a338 to hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/7dd6d0c9eb7140b292e20ff388e2a338 2023-08-11 04:59:38,380 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/da75896bf63e40b4baceadb3b6836fdd to hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/da75896bf63e40b4baceadb3b6836fdd 2023-08-11 04:59:38,381 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/table/9fdfcd00fbe5432c90e7387defb6f10a, entries=4, sequenceid=14, filesize=4.9 K 2023-08-11 04:59:38,382 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/ff5c78c0273f4b6588b9ca143db15f1b to hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/info/ff5c78c0273f4b6588b9ca143db15f1b 2023-08-11 04:59:38,383 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.10 KB/3174, heapSize ~5.33 KB/5456, currentSize=0 B/0 for 1588230740 in 76ms, sequenceid=14, compaction requested=false 2023-08-11 04:59:38,396 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-08-11 04:59:38,397 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-11 04:59:38,398 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 04:59:38,398 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 04:59:38,398 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-11 04:59:38,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/d08ef49e69c6c2f0235862da6d6ae4e1/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=1 2023-08-11 04:59:38,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:59:38,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d08ef49e69c6c2f0235862da6d6ae4e1: 2023-08-11 04:59:38,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691729917790.d08ef49e69c6c2f0235862da6d6ae4e1. 2023-08-11 04:59:38,507 INFO [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35057,1691729916651; all regions closed. 2023-08-11 04:59:38,513 DEBUG [RS:0;jenkins-hbase4:35057] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/oldWALs 2023-08-11 04:59:38,513 INFO [RS:0;jenkins-hbase4:35057] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35057%2C1691729916651.meta:.meta(num 1691729917221) 2023-08-11 04:59:38,516 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/WALs/jenkins-hbase4.apache.org,35057,1691729916651/jenkins-hbase4.apache.org%2C35057%2C1691729916651.1691729978275 not finished, retry = 0 2023-08-11 04:59:38,620 DEBUG [RS:0;jenkins-hbase4:35057] wal.AbstractFSWAL(1028): Moved 2 WAL file(s) to /user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/oldWALs 2023-08-11 04:59:38,620 INFO [RS:0;jenkins-hbase4:35057] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35057%2C1691729916651:(num 1691729978275) 2023-08-11 04:59:38,621 DEBUG [RS:0;jenkins-hbase4:35057] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 04:59:38,621 INFO [RS:0;jenkins-hbase4:35057] regionserver.LeaseManager(133): Closed leases 2023-08-11 04:59:38,621 INFO [RS:0;jenkins-hbase4:35057] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-08-11 04:59:38,621 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 04:59:38,622 INFO [RS:0;jenkins-hbase4:35057] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35057 2023-08-11 04:59:38,625 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35057,1691729916651 2023-08-11 04:59:38,625 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 04:59:38,625 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 04:59:38,626 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35057,1691729916651] 2023-08-11 04:59:38,626 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35057,1691729916651; numProcessing=1 2023-08-11 04:59:38,628 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35057,1691729916651 already deleted, retry=false 2023-08-11 04:59:38,628 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35057,1691729916651 expired; onlineServers=0 2023-08-11 04:59:38,628 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42283,1691729916608' ***** 2023-08-11 04:59:38,628 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-11 04:59:38,628 DEBUG [M:0;jenkins-hbase4:42283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@417b315b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 04:59:38,628 INFO [M:0;jenkins-hbase4:42283] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42283,1691729916608 2023-08-11 04:59:38,629 INFO [M:0;jenkins-hbase4:42283] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42283,1691729916608; all regions closed. 2023-08-11 04:59:38,629 DEBUG [M:0;jenkins-hbase4:42283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 04:59:38,629 DEBUG [M:0;jenkins-hbase4:42283] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-11 04:59:38,629 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-11 04:59:38,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691729916839] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691729916839,5,FailOnTimeoutGroup] 2023-08-11 04:59:38,629 DEBUG [M:0;jenkins-hbase4:42283] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-11 04:59:38,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691729916839] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691729916839,5,FailOnTimeoutGroup] 2023-08-11 04:59:38,629 INFO [M:0;jenkins-hbase4:42283] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-11 04:59:38,629 INFO [M:0;jenkins-hbase4:42283] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-11 04:59:38,629 INFO [M:0;jenkins-hbase4:42283] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-11 04:59:38,630 DEBUG [M:0;jenkins-hbase4:42283] master.HMaster(1512): Stopping service threads 2023-08-11 04:59:38,630 INFO [M:0;jenkins-hbase4:42283] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-11 04:59:38,630 ERROR [M:0;jenkins-hbase4:42283] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-08-11 04:59:38,630 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-11 04:59:38,630 INFO [M:0;jenkins-hbase4:42283] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-11 04:59:38,630 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:59:38,630 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-11 04:59:38,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 04:59:38,631 DEBUG [M:0;jenkins-hbase4:42283] zookeeper.ZKUtil(398): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-11 04:59:38,631 WARN [M:0;jenkins-hbase4:42283] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-11 04:59:38,631 INFO [M:0;jenkins-hbase4:42283] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-11 04:59:38,631 INFO [M:0;jenkins-hbase4:42283] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-11 04:59:38,632 DEBUG [M:0;jenkins-hbase4:42283] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 04:59:38,632 INFO [M:0;jenkins-hbase4:42283] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:59:38,632 DEBUG [M:0;jenkins-hbase4:42283] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:59:38,632 DEBUG [M:0;jenkins-hbase4:42283] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 04:59:38,632 DEBUG [M:0;jenkins-hbase4:42283] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:59:38,632 INFO [M:0;jenkins-hbase4:42283] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.89 KB heapSize=47.33 KB 2023-08-11 04:59:38,646 INFO [M:0;jenkins-hbase4:42283] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.89 KB at sequenceid=100 (bloomFilter=true), to=hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/78f4c8f057f5457181f7fdf257a0633b 2023-08-11 04:59:38,652 INFO [M:0;jenkins-hbase4:42283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78f4c8f057f5457181f7fdf257a0633b 2023-08-11 04:59:38,653 DEBUG [M:0;jenkins-hbase4:42283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/78f4c8f057f5457181f7fdf257a0633b as hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/78f4c8f057f5457181f7fdf257a0633b 2023-08-11 04:59:38,659 INFO [M:0;jenkins-hbase4:42283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78f4c8f057f5457181f7fdf257a0633b 2023-08-11 04:59:38,659 INFO [M:0;jenkins-hbase4:42283] regionserver.HStore(1080): Added hdfs://localhost:36197/user/jenkins/test-data/35703aec-a72e-c4db-6187-ba12b571b0c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/78f4c8f057f5457181f7fdf257a0633b, entries=11, sequenceid=100, filesize=6.1 K 2023-08-11 04:59:38,660 INFO [M:0;jenkins-hbase4:42283] regionserver.HRegion(2948): Finished flush of dataSize ~38.89 KB/39824, heapSize ~47.31 KB/48448, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=100, compaction requested=false 2023-08-11 04:59:38,661 INFO [M:0;jenkins-hbase4:42283] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:59:38,661 DEBUG [M:0;jenkins-hbase4:42283] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 04:59:38,664 INFO [M:0;jenkins-hbase4:42283] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-11 04:59:38,664 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 04:59:38,665 INFO [M:0;jenkins-hbase4:42283] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42283 2023-08-11 04:59:38,667 DEBUG [M:0;jenkins-hbase4:42283] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42283,1691729916608 already deleted, retry=false 2023-08-11 04:59:38,726 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 04:59:38,726 INFO [RS:0;jenkins-hbase4:35057] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35057,1691729916651; zookeeper connection closed. 2023-08-11 04:59:38,726 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x101f26475af0001, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 04:59:38,727 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5e67a77] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5e67a77 2023-08-11 04:59:38,727 INFO [Listener at localhost/36325] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-11 04:59:38,827 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 04:59:38,827 INFO [M:0;jenkins-hbase4:42283] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42283,1691729916608; zookeeper connection closed. 2023-08-11 04:59:38,827 DEBUG [Listener at localhost/36325-EventThread] zookeeper.ZKWatcher(600): master:42283-0x101f26475af0000, quorum=127.0.0.1:60470, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 04:59:38,828 WARN [Listener at localhost/36325] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 04:59:38,831 INFO [Listener at localhost/36325] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 04:59:38,921 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-11 04:59:38,935 WARN [BP-555268549-172.31.14.131-1691729916042 heartbeating to localhost/127.0.0.1:36197] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 04:59:38,935 WARN [BP-555268549-172.31.14.131-1691729916042 heartbeating to localhost/127.0.0.1:36197] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-555268549-172.31.14.131-1691729916042 (Datanode Uuid cd4f99df-cdb9-470a-8f2c-1d4a89d9c736) service to localhost/127.0.0.1:36197 2023-08-11 04:59:38,936 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/cluster_03d06096-7497-2983-a402-41f72f5dbdb5/dfs/data/data3/current/BP-555268549-172.31.14.131-1691729916042] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:59:38,936 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/cluster_03d06096-7497-2983-a402-41f72f5dbdb5/dfs/data/data4/current/BP-555268549-172.31.14.131-1691729916042] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:59:38,937 WARN [Listener at localhost/36325] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 04:59:38,940 INFO [Listener at localhost/36325] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 04:59:39,044 WARN [BP-555268549-172.31.14.131-1691729916042 heartbeating to localhost/127.0.0.1:36197] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 04:59:39,044 WARN [BP-555268549-172.31.14.131-1691729916042 heartbeating to localhost/127.0.0.1:36197] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-555268549-172.31.14.131-1691729916042 (Datanode Uuid 7107d80b-0e7d-482e-a474-41087783b8af) service to localhost/127.0.0.1:36197 2023-08-11 04:59:39,045 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/cluster_03d06096-7497-2983-a402-41f72f5dbdb5/dfs/data/data1/current/BP-555268549-172.31.14.131-1691729916042] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:59:39,045 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/cluster_03d06096-7497-2983-a402-41f72f5dbdb5/dfs/data/data2/current/BP-555268549-172.31.14.131-1691729916042] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 04:59:39,057 INFO [Listener at localhost/36325] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 04:59:39,170 INFO [Listener at localhost/36325] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-11 04:59:39,192 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-11 04:59:39,201 INFO [Listener at localhost/36325] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=63 (was 77), OpenFileDescriptor=436 (was 464), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=94 (was 112), ProcessCount=171 (was 171), AvailableMemoryMB=2972 (was 3055) 2023-08-11 04:59:39,209 INFO [Listener at localhost/36325] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=64, OpenFileDescriptor=436, MaxFileDescriptor=60000, SystemLoadAverage=94, ProcessCount=171, AvailableMemoryMB=2972 2023-08-11 04:59:39,209 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-11 04:59:39,210 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/hadoop.log.dir so I do NOT create it in target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726 2023-08-11 04:59:39,210 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb14137-e8bb-72b7-1d61-3bf977169850/hadoop.tmp.dir so I do NOT create it in target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726 2023-08-11 04:59:39,210 INFO [Listener at localhost/36325] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/cluster_b7ba7f60-a909-7143-c633-bbf530f8bdf6, deleteOnExit=true 2023-08-11 04:59:39,210 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-11 04:59:39,210 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/test.cache.data in system properties and HBase conf 2023-08-11 04:59:39,210 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/hadoop.tmp.dir in system properties and HBase conf 2023-08-11 04:59:39,210 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/hadoop.log.dir in system properties and HBase conf 2023-08-11 04:59:39,211 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-11 04:59:39,211 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-11 04:59:39,211 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-11 04:59:39,211 DEBUG [Listener at localhost/36325] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-11 04:59:39,211 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-11 04:59:39,211 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-11 04:59:39,211 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-11 04:59:39,211 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 04:59:39,212 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-11 04:59:39,212 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-11 04:59:39,212 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 04:59:39,212 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 04:59:39,212 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-11 04:59:39,212 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/nfs.dump.dir in system properties and HBase conf 2023-08-11 04:59:39,212 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/java.io.tmpdir in system properties and HBase conf 2023-08-11 04:59:39,212 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 04:59:39,212 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-11 04:59:39,213 INFO [Listener at localhost/36325] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-11 04:59:39,221 WARN [Listener at localhost/36325] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 04:59:39,221 WARN [Listener at localhost/36325] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 04:59:39,264 WARN [Listener at localhost/36325] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 04:59:39,267 INFO [Listener at localhost/36325] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 04:59:39,272 INFO [Listener at localhost/36325] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/java.io.tmpdir/Jetty_localhost_42479_hdfs____.6o7hby/webapp 2023-08-11 04:59:39,365 INFO [Listener at localhost/36325] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42479 2023-08-11 04:59:39,410 WARN [Listener at localhost/36325] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 04:59:39,411 WARN [Listener at localhost/36325] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 04:59:39,450 WARN [Listener at localhost/35167] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 04:59:39,459 WARN [Listener at localhost/35167] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 04:59:39,461 WARN [Listener at localhost/35167] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 04:59:39,463 INFO [Listener at localhost/35167] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 04:59:39,469 INFO [Listener at localhost/35167] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/java.io.tmpdir/Jetty_localhost_36471_datanode____.njvsge/webapp 2023-08-11 04:59:39,564 INFO [Listener at localhost/35167] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36471 2023-08-11 04:59:39,570 WARN [Listener at localhost/42419] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 04:59:39,582 WARN [Listener at localhost/42419] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 04:59:39,584 WARN [Listener at localhost/42419] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 04:59:39,585 INFO [Listener at localhost/42419] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 04:59:39,589 INFO [Listener at localhost/42419] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/java.io.tmpdir/Jetty_localhost_40571_datanode____3e1gl6/webapp 2023-08-11 04:59:39,669 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8a0a7da9012de743: Processing first storage report for DS-d6014163-e773-4315-91b4-f7629aeaecf5 from datanode 79614b21-abb9-4e98-87ab-c0356c6fe860 2023-08-11 04:59:39,670 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8a0a7da9012de743: from storage DS-d6014163-e773-4315-91b4-f7629aeaecf5 node DatanodeRegistration(127.0.0.1:44881, datanodeUuid=79614b21-abb9-4e98-87ab-c0356c6fe860, infoPort=37727, infoSecurePort=0, ipcPort=42419, storageInfo=lv=-57;cid=testClusterID;nsid=1391116867;c=1691729979227), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-11 04:59:39,670 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8a0a7da9012de743: Processing first storage report for DS-fd7fcdb8-4b1c-46ad-8e61-3b53b9b182a1 from datanode 79614b21-abb9-4e98-87ab-c0356c6fe860 2023-08-11 04:59:39,670 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8a0a7da9012de743: from storage DS-fd7fcdb8-4b1c-46ad-8e61-3b53b9b182a1 node DatanodeRegistration(127.0.0.1:44881, datanodeUuid=79614b21-abb9-4e98-87ab-c0356c6fe860, infoPort=37727, infoSecurePort=0, ipcPort=42419, storageInfo=lv=-57;cid=testClusterID;nsid=1391116867;c=1691729979227), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 04:59:39,691 INFO [Listener at localhost/42419] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40571 2023-08-11 04:59:39,697 WARN [Listener at localhost/35889] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 04:59:39,789 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x23667db280f1079c: Processing first storage report for DS-9c546271-899e-4373-bb37-456d570f5e73 from datanode 79487b76-b43e-4255-8722-5cf2b79d818b 2023-08-11 04:59:39,789 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x23667db280f1079c: from storage DS-9c546271-899e-4373-bb37-456d570f5e73 node DatanodeRegistration(127.0.0.1:35351, datanodeUuid=79487b76-b43e-4255-8722-5cf2b79d818b, infoPort=34705, infoSecurePort=0, ipcPort=35889, storageInfo=lv=-57;cid=testClusterID;nsid=1391116867;c=1691729979227), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 04:59:39,789 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x23667db280f1079c: Processing first storage report for DS-81b24f05-4e38-4977-8ef9-b6dbeec32135 from datanode 79487b76-b43e-4255-8722-5cf2b79d818b 2023-08-11 04:59:39,789 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x23667db280f1079c: from storage DS-81b24f05-4e38-4977-8ef9-b6dbeec32135 node DatanodeRegistration(127.0.0.1:35351, datanodeUuid=79487b76-b43e-4255-8722-5cf2b79d818b, infoPort=34705, infoSecurePort=0, ipcPort=35889, storageInfo=lv=-57;cid=testClusterID;nsid=1391116867;c=1691729979227), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 04:59:39,804 DEBUG [Listener at localhost/35889] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726 2023-08-11 04:59:39,806 INFO [Listener at localhost/35889] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/cluster_b7ba7f60-a909-7143-c633-bbf530f8bdf6/zookeeper_0, clientPort=59265, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/cluster_b7ba7f60-a909-7143-c633-bbf530f8bdf6/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/cluster_b7ba7f60-a909-7143-c633-bbf530f8bdf6/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-11 04:59:39,808 INFO [Listener at localhost/35889] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59265 2023-08-11 04:59:39,808 INFO [Listener at localhost/35889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:59:39,809 INFO [Listener at localhost/35889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:59:39,823 INFO [Listener at localhost/35889] util.FSUtils(471): Created version file at hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935 with version=8 2023-08-11 04:59:39,823 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/hbase-staging 2023-08-11 04:59:39,825 INFO [Listener at localhost/35889] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 04:59:39,825 INFO [Listener at localhost/35889] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 04:59:39,825 INFO [Listener at localhost/35889] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 04:59:39,826 INFO [Listener at localhost/35889] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 04:59:39,826 INFO [Listener at localhost/35889] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 04:59:39,826 INFO [Listener at localhost/35889] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 04:59:39,826 INFO [Listener at localhost/35889] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 04:59:39,828 INFO [Listener at localhost/35889] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46565 2023-08-11 04:59:39,828 INFO [Listener at localhost/35889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:59:39,829 INFO [Listener at localhost/35889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:59:39,830 INFO [Listener at localhost/35889] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46565 connecting to ZooKeeper ensemble=127.0.0.1:59265 2023-08-11 04:59:39,839 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:465650x0, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 04:59:39,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46565-0x101f2656ca10000 connected 2023-08-11 04:59:39,853 DEBUG [Listener at localhost/35889] zookeeper.ZKUtil(164): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 04:59:39,853 DEBUG [Listener at localhost/35889] zookeeper.ZKUtil(164): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 04:59:39,854 DEBUG [Listener at localhost/35889] zookeeper.ZKUtil(164): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 04:59:39,854 DEBUG [Listener at localhost/35889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46565 2023-08-11 04:59:39,855 DEBUG [Listener at localhost/35889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46565 2023-08-11 04:59:39,855 DEBUG [Listener at localhost/35889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46565 2023-08-11 04:59:39,855 DEBUG [Listener at localhost/35889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46565 2023-08-11 04:59:39,855 DEBUG [Listener at localhost/35889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46565 2023-08-11 04:59:39,855 INFO [Listener at localhost/35889] master.HMaster(444): hbase.rootdir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935, hbase.cluster.distributed=false 2023-08-11 04:59:39,868 INFO [Listener at localhost/35889] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 04:59:39,868 INFO [Listener at localhost/35889] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 04:59:39,868 INFO [Listener at localhost/35889] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 04:59:39,868 INFO [Listener at localhost/35889] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 04:59:39,868 INFO [Listener at localhost/35889] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 04:59:39,868 INFO [Listener at localhost/35889] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 04:59:39,869 INFO [Listener at localhost/35889] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 04:59:39,870 INFO [Listener at localhost/35889] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42289 2023-08-11 04:59:39,870 INFO [Listener at localhost/35889] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-11 04:59:39,871 DEBUG [Listener at localhost/35889] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-11 04:59:39,871 INFO [Listener at localhost/35889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:59:39,872 INFO [Listener at localhost/35889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:59:39,873 INFO [Listener at localhost/35889] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42289 connecting to ZooKeeper ensemble=127.0.0.1:59265 2023-08-11 04:59:39,876 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): regionserver:422890x0, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 04:59:39,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42289-0x101f2656ca10001 connected 2023-08-11 04:59:39,877 DEBUG [Listener at localhost/35889] zookeeper.ZKUtil(164): regionserver:42289-0x101f2656ca10001, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 04:59:39,877 DEBUG [Listener at localhost/35889] zookeeper.ZKUtil(164): regionserver:42289-0x101f2656ca10001, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 04:59:39,878 DEBUG [Listener at localhost/35889] zookeeper.ZKUtil(164): regionserver:42289-0x101f2656ca10001, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 04:59:39,878 DEBUG [Listener at localhost/35889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42289 2023-08-11 04:59:39,878 DEBUG [Listener at localhost/35889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42289 2023-08-11 04:59:39,878 DEBUG [Listener at localhost/35889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42289 2023-08-11 04:59:39,879 DEBUG [Listener at localhost/35889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42289 2023-08-11 04:59:39,879 DEBUG [Listener at localhost/35889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42289 2023-08-11 04:59:39,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46565,1691729979824 2023-08-11 04:59:39,881 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 04:59:39,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46565,1691729979824 2023-08-11 04:59:39,887 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 04:59:39,887 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): regionserver:42289-0x101f2656ca10001, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 04:59:39,887 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:59:39,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 04:59:39,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46565,1691729979824 from backup master directory 2023-08-11 04:59:39,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 04:59:39,890 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46565,1691729979824 2023-08-11 04:59:39,890 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 04:59:39,890 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 04:59:39,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46565,1691729979824 2023-08-11 04:59:39,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/hbase.id with ID: 93ed7d2d-1e18-442a-a52b-a30fc6020857 2023-08-11 04:59:39,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:59:39,921 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:59:39,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4a9e38c1 to 127.0.0.1:59265 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 04:59:39,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40d063c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 04:59:39,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-11 04:59:39,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-11 04:59:39,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 04:59:39,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/MasterData/data/master/store-tmp 2023-08-11 04:59:39,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:59:39,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 04:59:39,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:59:39,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:59:39,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 04:59:39,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:59:39,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 04:59:39,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 04:59:39,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/MasterData/WALs/jenkins-hbase4.apache.org,46565,1691729979824 2023-08-11 04:59:39,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46565%2C1691729979824, suffix=, logDir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/MasterData/WALs/jenkins-hbase4.apache.org,46565,1691729979824, archiveDir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/MasterData/oldWALs, maxLogs=10 2023-08-11 04:59:39,969 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35351,DS-9c546271-899e-4373-bb37-456d570f5e73,DISK] 2023-08-11 04:59:39,970 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44881,DS-d6014163-e773-4315-91b4-f7629aeaecf5,DISK] 2023-08-11 04:59:39,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/MasterData/WALs/jenkins-hbase4.apache.org,46565,1691729979824/jenkins-hbase4.apache.org%2C46565%2C1691729979824.1691729979948 2023-08-11 04:59:39,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35351,DS-9c546271-899e-4373-bb37-456d570f5e73,DISK], DatanodeInfoWithStorage[127.0.0.1:44881,DS-d6014163-e773-4315-91b4-f7629aeaecf5,DISK]] 2023-08-11 04:59:39,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-11 04:59:39,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:59:39,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:59:39,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:59:39,975 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:59:39,976 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-11 04:59:39,977 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-11 04:59:39,977 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:59:39,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:59:39,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:59:39,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 04:59:39,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 04:59:39,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=756944, jitterRate=-0.03749604523181915}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 04:59:39,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 04:59:39,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-11 04:59:39,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-11 04:59:39,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-11 04:59:39,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-11 04:59:39,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-11 04:59:39,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-11 04:59:39,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-11 04:59:39,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-11 04:59:39,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-11 04:59:40,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-11 04:59:40,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-11 04:59:40,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-11 04:59:40,002 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-11 04:59:40,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-11 04:59:40,005 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:59:40,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-11 04:59:40,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-11 04:59:40,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-11 04:59:40,008 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 04:59:40,008 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): regionserver:42289-0x101f2656ca10001, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 04:59:40,008 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:59:40,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46565,1691729979824, sessionid=0x101f2656ca10000, setting cluster-up flag (Was=false) 2023-08-11 04:59:40,011 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:59:40,016 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-11 04:59:40,016 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46565,1691729979824 2023-08-11 04:59:40,020 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:59:40,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-11 04:59:40,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46565,1691729979824 2023-08-11 04:59:40,025 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/.hbase-snapshot/.tmp 2023-08-11 04:59:40,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-11 04:59:40,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 04:59:40,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 04:59:40,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 04:59:40,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 04:59:40,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-11 04:59:40,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:59:40,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 04:59:40,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:59:40,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1691730010028 2023-08-11 04:59:40,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-11 04:59:40,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-11 04:59:40,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-11 04:59:40,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-11 04:59:40,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-11 04:59:40,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-11 04:59:40,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:40,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-11 04:59:40,030 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 04:59:40,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-11 04:59:40,030 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-11 04:59:40,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-11 04:59:40,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-11 04:59:40,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-11 04:59:40,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691729980031,5,FailOnTimeoutGroup] 2023-08-11 04:59:40,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691729980031,5,FailOnTimeoutGroup] 2023-08-11 04:59:40,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:40,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-11 04:59:40,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:40,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:40,032 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 04:59:40,041 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 04:59:40,042 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 04:59:40,042 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935 2023-08-11 04:59:40,051 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:59:40,052 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 04:59:40,054 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/info 2023-08-11 04:59:40,054 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 04:59:40,055 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:59:40,055 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 04:59:40,056 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/rep_barrier 2023-08-11 04:59:40,057 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 04:59:40,057 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:59:40,058 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 04:59:40,059 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/table 2023-08-11 04:59:40,060 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 04:59:40,060 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:59:40,061 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740 2023-08-11 04:59:40,062 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740 2023-08-11 04:59:40,064 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 04:59:40,065 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 04:59:40,068 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 04:59:40,068 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=745001, jitterRate=-0.052682310342788696}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 04:59:40,068 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 04:59:40,068 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 04:59:40,069 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 04:59:40,069 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 04:59:40,069 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 04:59:40,069 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 04:59:40,069 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 04:59:40,069 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 04:59:40,070 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 04:59:40,070 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-11 04:59:40,070 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-11 04:59:40,072 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-11 04:59:40,073 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-11 04:59:40,080 INFO [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(951): ClusterId : 93ed7d2d-1e18-442a-a52b-a30fc6020857 2023-08-11 04:59:40,081 DEBUG [RS:0;jenkins-hbase4:42289] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-11 04:59:40,083 DEBUG [RS:0;jenkins-hbase4:42289] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-11 04:59:40,084 DEBUG [RS:0;jenkins-hbase4:42289] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-11 04:59:40,085 DEBUG [RS:0;jenkins-hbase4:42289] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-11 04:59:40,086 DEBUG [RS:0;jenkins-hbase4:42289] zookeeper.ReadOnlyZKClient(139): Connect 0x497d7cca to 127.0.0.1:59265 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 04:59:40,089 DEBUG [RS:0;jenkins-hbase4:42289] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47ba8b95, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 04:59:40,089 DEBUG [RS:0;jenkins-hbase4:42289] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@438517ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 04:59:40,098 DEBUG [RS:0;jenkins-hbase4:42289] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42289 2023-08-11 04:59:40,098 INFO [RS:0;jenkins-hbase4:42289] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-11 04:59:40,098 INFO [RS:0;jenkins-hbase4:42289] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-11 04:59:40,098 DEBUG [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(1022): About to register with Master. 2023-08-11 04:59:40,099 INFO [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46565,1691729979824 with isa=jenkins-hbase4.apache.org/172.31.14.131:42289, startcode=1691729979868 2023-08-11 04:59:40,099 DEBUG [RS:0;jenkins-hbase4:42289] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-11 04:59:40,101 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38663, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-08-11 04:59:40,102 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46565] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 04:59:40,102 DEBUG [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935 2023-08-11 04:59:40,102 DEBUG [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35167 2023-08-11 04:59:40,102 DEBUG [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-11 04:59:40,103 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 04:59:40,104 DEBUG [RS:0;jenkins-hbase4:42289] zookeeper.ZKUtil(162): regionserver:42289-0x101f2656ca10001, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 04:59:40,104 WARN [RS:0;jenkins-hbase4:42289] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 04:59:40,104 INFO [RS:0;jenkins-hbase4:42289] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 04:59:40,104 DEBUG [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/WALs/jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 04:59:40,104 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42289,1691729979868] 2023-08-11 04:59:40,107 DEBUG [RS:0;jenkins-hbase4:42289] zookeeper.ZKUtil(162): regionserver:42289-0x101f2656ca10001, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 04:59:40,108 DEBUG [RS:0;jenkins-hbase4:42289] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-11 04:59:40,108 INFO [RS:0;jenkins-hbase4:42289] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-11 04:59:40,110 INFO [RS:0;jenkins-hbase4:42289] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-11 04:59:40,110 INFO [RS:0;jenkins-hbase4:42289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-11 04:59:40,110 INFO [RS:0;jenkins-hbase4:42289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:40,110 INFO [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-11 04:59:40,111 INFO [RS:0;jenkins-hbase4:42289] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:40,111 DEBUG [RS:0;jenkins-hbase4:42289] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:59:40,111 DEBUG [RS:0;jenkins-hbase4:42289] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:59:40,111 DEBUG [RS:0;jenkins-hbase4:42289] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:59:40,111 DEBUG [RS:0;jenkins-hbase4:42289] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:59:40,111 DEBUG [RS:0;jenkins-hbase4:42289] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:59:40,111 DEBUG [RS:0;jenkins-hbase4:42289] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 04:59:40,112 DEBUG [RS:0;jenkins-hbase4:42289] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:59:40,112 DEBUG [RS:0;jenkins-hbase4:42289] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:59:40,112 DEBUG [RS:0;jenkins-hbase4:42289] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:59:40,112 DEBUG [RS:0;jenkins-hbase4:42289] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 04:59:40,112 INFO [RS:0;jenkins-hbase4:42289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:40,112 INFO [RS:0;jenkins-hbase4:42289] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:40,112 INFO [RS:0;jenkins-hbase4:42289] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:40,123 INFO [RS:0;jenkins-hbase4:42289] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-11 04:59:40,123 INFO [RS:0;jenkins-hbase4:42289] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42289,1691729979868-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:40,133 INFO [RS:0;jenkins-hbase4:42289] regionserver.Replication(203): jenkins-hbase4.apache.org,42289,1691729979868 started 2023-08-11 04:59:40,133 INFO [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42289,1691729979868, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42289, sessionid=0x101f2656ca10001 2023-08-11 04:59:40,133 DEBUG [RS:0;jenkins-hbase4:42289] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-11 04:59:40,133 DEBUG [RS:0;jenkins-hbase4:42289] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 04:59:40,133 DEBUG [RS:0;jenkins-hbase4:42289] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42289,1691729979868' 2023-08-11 04:59:40,133 DEBUG [RS:0;jenkins-hbase4:42289] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 04:59:40,134 DEBUG [RS:0;jenkins-hbase4:42289] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 04:59:40,134 DEBUG [RS:0;jenkins-hbase4:42289] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-11 04:59:40,134 DEBUG [RS:0;jenkins-hbase4:42289] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-11 04:59:40,134 DEBUG [RS:0;jenkins-hbase4:42289] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 04:59:40,134 DEBUG [RS:0;jenkins-hbase4:42289] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42289,1691729979868' 2023-08-11 04:59:40,134 DEBUG [RS:0;jenkins-hbase4:42289] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-11 04:59:40,134 DEBUG [RS:0;jenkins-hbase4:42289] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-11 04:59:40,135 DEBUG [RS:0;jenkins-hbase4:42289] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-11 04:59:40,135 INFO [RS:0;jenkins-hbase4:42289] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-11 04:59:40,135 INFO [RS:0;jenkins-hbase4:42289] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-11 04:59:40,223 DEBUG [jenkins-hbase4:46565] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-11 04:59:40,224 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42289,1691729979868, state=OPENING 2023-08-11 04:59:40,226 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-11 04:59:40,227 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:59:40,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42289,1691729979868}] 2023-08-11 04:59:40,228 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 04:59:40,237 INFO [RS:0;jenkins-hbase4:42289] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42289%2C1691729979868, suffix=, logDir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/WALs/jenkins-hbase4.apache.org,42289,1691729979868, archiveDir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/oldWALs, maxLogs=32 2023-08-11 04:59:40,253 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44881,DS-d6014163-e773-4315-91b4-f7629aeaecf5,DISK] 2023-08-11 04:59:40,253 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35351,DS-9c546271-899e-4373-bb37-456d570f5e73,DISK] 2023-08-11 04:59:40,255 INFO [RS:0;jenkins-hbase4:42289] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/WALs/jenkins-hbase4.apache.org,42289,1691729979868/jenkins-hbase4.apache.org%2C42289%2C1691729979868.1691729980237 2023-08-11 04:59:40,256 DEBUG [RS:0;jenkins-hbase4:42289] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44881,DS-d6014163-e773-4315-91b4-f7629aeaecf5,DISK], DatanodeInfoWithStorage[127.0.0.1:35351,DS-9c546271-899e-4373-bb37-456d570f5e73,DISK]] 2023-08-11 04:59:40,382 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 04:59:40,382 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-11 04:59:40,385 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-11 04:59:40,389 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-11 04:59:40,389 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 04:59:40,391 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42289%2C1691729979868.meta, suffix=.meta, logDir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/WALs/jenkins-hbase4.apache.org,42289,1691729979868, archiveDir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/oldWALs, maxLogs=32 2023-08-11 04:59:40,405 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44881,DS-d6014163-e773-4315-91b4-f7629aeaecf5,DISK] 2023-08-11 04:59:40,406 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35351,DS-9c546271-899e-4373-bb37-456d570f5e73,DISK] 2023-08-11 04:59:40,409 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/WALs/jenkins-hbase4.apache.org,42289,1691729979868/jenkins-hbase4.apache.org%2C42289%2C1691729979868.meta.1691729980391.meta 2023-08-11 04:59:40,409 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44881,DS-d6014163-e773-4315-91b4-f7629aeaecf5,DISK], DatanodeInfoWithStorage[127.0.0.1:35351,DS-9c546271-899e-4373-bb37-456d570f5e73,DISK]] 2023-08-11 04:59:40,409 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-11 04:59:40,409 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-11 04:59:40,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-11 04:59:40,410 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-11 04:59:40,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-11 04:59:40,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:59:40,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-11 04:59:40,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-11 04:59:40,411 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 04:59:40,412 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/info 2023-08-11 04:59:40,412 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/info 2023-08-11 04:59:40,413 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 04:59:40,413 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:59:40,413 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 04:59:40,414 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/rep_barrier 2023-08-11 04:59:40,414 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/rep_barrier 2023-08-11 04:59:40,415 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 04:59:40,415 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:59:40,415 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 04:59:40,416 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/table 2023-08-11 04:59:40,416 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/table 2023-08-11 04:59:40,417 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 04:59:40,417 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:59:40,418 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740 2023-08-11 04:59:40,419 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740 2023-08-11 04:59:40,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 04:59:40,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 04:59:40,423 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=786108, jitterRate=-4.1300058364868164E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 04:59:40,424 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 04:59:40,424 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1691729980382 2023-08-11 04:59:40,428 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-11 04:59:40,428 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-11 04:59:40,429 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42289,1691729979868, state=OPEN 2023-08-11 04:59:40,430 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-11 04:59:40,430 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 04:59:40,433 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-11 04:59:40,433 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42289,1691729979868 in 202 msec 2023-08-11 04:59:40,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-11 04:59:40,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 363 msec 2023-08-11 04:59:40,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 410 msec 2023-08-11 04:59:40,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1691729980437, completionTime=-1 2023-08-11 04:59:40,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-11 04:59:40,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-11 04:59:40,440 DEBUG [hconnection-0x54f4c4b4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 04:59:40,442 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 04:59:40,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-11 04:59:40,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1691730040443 2023-08-11 04:59:40,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1691730100443 2023-08-11 04:59:40,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-08-11 04:59:40,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46565,1691729979824-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:40,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46565,1691729979824-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:40,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46565,1691729979824-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:40,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46565, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:40,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-11 04:59:40,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-11 04:59:40,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 04:59:40,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-11 04:59:40,452 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-11 04:59:40,453 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-11 04:59:40,454 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-11 04:59:40,456 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/.tmp/data/hbase/namespace/0c19a1dc4dcb44f30f66bd3f65132a2f 2023-08-11 04:59:40,456 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/.tmp/data/hbase/namespace/0c19a1dc4dcb44f30f66bd3f65132a2f empty. 2023-08-11 04:59:40,457 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/.tmp/data/hbase/namespace/0c19a1dc4dcb44f30f66bd3f65132a2f 2023-08-11 04:59:40,457 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-11 04:59:40,467 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-11 04:59:40,469 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0c19a1dc4dcb44f30f66bd3f65132a2f, NAME => 'hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/.tmp 2023-08-11 04:59:40,476 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:59:40,476 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 0c19a1dc4dcb44f30f66bd3f65132a2f, disabling compactions & flushes 2023-08-11 04:59:40,476 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f. 2023-08-11 04:59:40,477 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f. 2023-08-11 04:59:40,477 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f. after waiting 0 ms 2023-08-11 04:59:40,477 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f. 2023-08-11 04:59:40,477 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f. 2023-08-11 04:59:40,477 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 0c19a1dc4dcb44f30f66bd3f65132a2f: 2023-08-11 04:59:40,479 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-11 04:59:40,480 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691729980480"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691729980480"}]},"ts":"1691729980480"} 2023-08-11 04:59:40,482 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-11 04:59:40,483 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-11 04:59:40,484 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691729980484"}]},"ts":"1691729980484"} 2023-08-11 04:59:40,485 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-11 04:59:40,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0c19a1dc4dcb44f30f66bd3f65132a2f, ASSIGN}] 2023-08-11 04:59:40,492 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0c19a1dc4dcb44f30f66bd3f65132a2f, ASSIGN 2023-08-11 04:59:40,493 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0c19a1dc4dcb44f30f66bd3f65132a2f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42289,1691729979868; forceNewPlan=false, retain=false 2023-08-11 04:59:40,644 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0c19a1dc4dcb44f30f66bd3f65132a2f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 04:59:40,645 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691729980644"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691729980644"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691729980644"}]},"ts":"1691729980644"} 2023-08-11 04:59:40,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0c19a1dc4dcb44f30f66bd3f65132a2f, server=jenkins-hbase4.apache.org,42289,1691729979868}] 2023-08-11 04:59:40,803 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f. 2023-08-11 04:59:40,803 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0c19a1dc4dcb44f30f66bd3f65132a2f, NAME => 'hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f.', STARTKEY => '', ENDKEY => ''} 2023-08-11 04:59:40,804 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0c19a1dc4dcb44f30f66bd3f65132a2f 2023-08-11 04:59:40,804 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:59:40,804 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0c19a1dc4dcb44f30f66bd3f65132a2f 2023-08-11 04:59:40,804 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0c19a1dc4dcb44f30f66bd3f65132a2f 2023-08-11 04:59:40,805 INFO [StoreOpener-0c19a1dc4dcb44f30f66bd3f65132a2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0c19a1dc4dcb44f30f66bd3f65132a2f 2023-08-11 04:59:40,807 DEBUG [StoreOpener-0c19a1dc4dcb44f30f66bd3f65132a2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/namespace/0c19a1dc4dcb44f30f66bd3f65132a2f/info 2023-08-11 04:59:40,807 DEBUG [StoreOpener-0c19a1dc4dcb44f30f66bd3f65132a2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/namespace/0c19a1dc4dcb44f30f66bd3f65132a2f/info 2023-08-11 04:59:40,807 INFO [StoreOpener-0c19a1dc4dcb44f30f66bd3f65132a2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c19a1dc4dcb44f30f66bd3f65132a2f columnFamilyName info 2023-08-11 04:59:40,808 INFO [StoreOpener-0c19a1dc4dcb44f30f66bd3f65132a2f-1] regionserver.HStore(310): Store=0c19a1dc4dcb44f30f66bd3f65132a2f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:59:40,809 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/namespace/0c19a1dc4dcb44f30f66bd3f65132a2f 2023-08-11 04:59:40,810 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/namespace/0c19a1dc4dcb44f30f66bd3f65132a2f 2023-08-11 04:59:40,812 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0c19a1dc4dcb44f30f66bd3f65132a2f 2023-08-11 04:59:40,814 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/namespace/0c19a1dc4dcb44f30f66bd3f65132a2f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 04:59:40,815 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0c19a1dc4dcb44f30f66bd3f65132a2f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=872668, jitterRate=0.10965596139431}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 04:59:40,815 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0c19a1dc4dcb44f30f66bd3f65132a2f: 2023-08-11 04:59:40,816 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f., pid=6, masterSystemTime=1691729980799 2023-08-11 04:59:40,818 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f. 2023-08-11 04:59:40,818 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f. 2023-08-11 04:59:40,819 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0c19a1dc4dcb44f30f66bd3f65132a2f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 04:59:40,819 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691729980819"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691729980819"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691729980819"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691729980819"}]},"ts":"1691729980819"} 2023-08-11 04:59:40,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-11 04:59:40,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0c19a1dc4dcb44f30f66bd3f65132a2f, server=jenkins-hbase4.apache.org,42289,1691729979868 in 174 msec 2023-08-11 04:59:40,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-11 04:59:40,826 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0c19a1dc4dcb44f30f66bd3f65132a2f, ASSIGN in 332 msec 2023-08-11 04:59:40,826 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-11 04:59:40,827 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691729980826"}]},"ts":"1691729980826"} 2023-08-11 04:59:40,828 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-11 04:59:40,833 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-11 04:59:40,835 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 382 msec 2023-08-11 04:59:40,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-11 04:59:40,854 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-11 04:59:40,854 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:59:40,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-11 04:59:40,867 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 04:59:40,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-08-11 04:59:40,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-11 04:59:40,888 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 04:59:40,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-08-11 04:59:40,904 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-11 04:59:40,907 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-11 04:59:40,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.017sec 2023-08-11 04:59:40,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-11 04:59:40,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-11 04:59:40,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-11 04:59:40,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46565,1691729979824-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-11 04:59:40,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46565,1691729979824-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-11 04:59:40,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-11 04:59:40,981 DEBUG [Listener at localhost/35889] zookeeper.ReadOnlyZKClient(139): Connect 0x6d9f0bec to 127.0.0.1:59265 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 04:59:40,985 DEBUG [Listener at localhost/35889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2630ef71, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 04:59:40,987 DEBUG [hconnection-0x14abad4e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 04:59:40,988 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 04:59:40,990 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46565,1691729979824 2023-08-11 04:59:40,990 INFO [Listener at localhost/35889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 04:59:40,994 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-11 04:59:40,994 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 04:59:40,995 INFO [Listener at localhost/35889] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-11 04:59:40,996 DEBUG [Listener at localhost/35889] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-11 04:59:40,999 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-11 04:59:41,000 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46565] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-11 04:59:41,000 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46565] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-11 04:59:41,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46565] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-11 04:59:41,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46565] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRolling 2023-08-11 04:59:41,005 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-08-11 04:59:41,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46565] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRolling" procId is: 9 2023-08-11 04:59:41,006 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-11 04:59:41,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46565] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-11 04:59:41,009 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/.tmp/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 04:59:41,009 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/.tmp/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf empty. 2023-08-11 04:59:41,010 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/.tmp/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 04:59:41,010 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRolling regions 2023-08-11 04:59:41,022 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/.tmp/data/default/TestLogRolling-testLogRolling/.tabledesc/.tableinfo.0000000001 2023-08-11 04:59:41,023 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => f603e6eaa425d7a4972b6fd9a0817fdf, NAME => 'TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/.tmp 2023-08-11 04:59:41,032 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:59:41,032 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1604): Closing f603e6eaa425d7a4972b6fd9a0817fdf, disabling compactions & flushes 2023-08-11 04:59:41,032 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. 2023-08-11 04:59:41,032 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. 2023-08-11 04:59:41,032 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. after waiting 0 ms 2023-08-11 04:59:41,032 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. 2023-08-11 04:59:41,032 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. 2023-08-11 04:59:41,032 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1558): Region close journal for f603e6eaa425d7a4972b6fd9a0817fdf: 2023-08-11 04:59:41,035 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ADD_TO_META 2023-08-11 04:59:41,037 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691729981037"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691729981037"}]},"ts":"1691729981037"} 2023-08-11 04:59:41,038 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-11 04:59:41,039 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-11 04:59:41,040 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691729981039"}]},"ts":"1691729981039"} 2023-08-11 04:59:41,041 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLING in hbase:meta 2023-08-11 04:59:41,044 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=f603e6eaa425d7a4972b6fd9a0817fdf, ASSIGN}] 2023-08-11 04:59:41,045 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=f603e6eaa425d7a4972b6fd9a0817fdf, ASSIGN 2023-08-11 04:59:41,046 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=f603e6eaa425d7a4972b6fd9a0817fdf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42289,1691729979868; forceNewPlan=false, retain=false 2023-08-11 04:59:41,197 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f603e6eaa425d7a4972b6fd9a0817fdf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 04:59:41,198 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691729981197"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691729981197"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691729981197"}]},"ts":"1691729981197"} 2023-08-11 04:59:41,200 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure f603e6eaa425d7a4972b6fd9a0817fdf, server=jenkins-hbase4.apache.org,42289,1691729979868}] 2023-08-11 04:59:41,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. 2023-08-11 04:59:41,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f603e6eaa425d7a4972b6fd9a0817fdf, NAME => 'TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.', STARTKEY => '', ENDKEY => ''} 2023-08-11 04:59:41,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 04:59:41,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 04:59:41,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 04:59:41,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 04:59:41,358 INFO [StoreOpener-f603e6eaa425d7a4972b6fd9a0817fdf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 04:59:41,359 DEBUG [StoreOpener-f603e6eaa425d7a4972b6fd9a0817fdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info 2023-08-11 04:59:41,359 DEBUG [StoreOpener-f603e6eaa425d7a4972b6fd9a0817fdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info 2023-08-11 04:59:41,360 INFO [StoreOpener-f603e6eaa425d7a4972b6fd9a0817fdf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f603e6eaa425d7a4972b6fd9a0817fdf columnFamilyName info 2023-08-11 04:59:41,360 INFO [StoreOpener-f603e6eaa425d7a4972b6fd9a0817fdf-1] regionserver.HStore(310): Store=f603e6eaa425d7a4972b6fd9a0817fdf/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 04:59:41,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 04:59:41,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 04:59:41,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 04:59:41,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 04:59:41,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f603e6eaa425d7a4972b6fd9a0817fdf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=816793, jitterRate=0.038606151938438416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 04:59:41,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f603e6eaa425d7a4972b6fd9a0817fdf: 2023-08-11 04:59:41,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf., pid=11, masterSystemTime=1691729981352 2023-08-11 04:59:41,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. 2023-08-11 04:59:41,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. 2023-08-11 04:59:41,370 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f603e6eaa425d7a4972b6fd9a0817fdf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 04:59:41,370 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691729981370"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691729981370"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691729981370"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691729981370"}]},"ts":"1691729981370"} 2023-08-11 04:59:41,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-11 04:59:41,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure f603e6eaa425d7a4972b6fd9a0817fdf, server=jenkins-hbase4.apache.org,42289,1691729979868 in 172 msec 2023-08-11 04:59:41,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-11 04:59:41,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=f603e6eaa425d7a4972b6fd9a0817fdf, ASSIGN in 331 msec 2023-08-11 04:59:41,378 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-11 04:59:41,378 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691729981378"}]},"ts":"1691729981378"} 2023-08-11 04:59:41,380 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLED in hbase:meta 2023-08-11 04:59:41,382 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_POST_OPERATION 2023-08-11 04:59:41,383 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRolling in 381 msec 2023-08-11 04:59:43,839 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-11 04:59:46,108 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-11 04:59:46,109 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-11 04:59:46,109 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRolling' 2023-08-11 04:59:51,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46565] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-11 04:59:51,008 INFO [Listener at localhost/35889] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRolling, procId: 9 completed 2023-08-11 04:59:51,011 DEBUG [Listener at localhost/35889] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRolling 2023-08-11 04:59:51,011 DEBUG [Listener at localhost/35889] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. 2023-08-11 04:59:51,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 04:59:51,027 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing f603e6eaa425d7a4972b6fd9a0817fdf 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 04:59:51,055 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=12 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp/info/8d59476f4fdf441f86de719eefe2cc31 2023-08-11 04:59:51,059 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=f603e6eaa425d7a4972b6fd9a0817fdf, server=jenkins-hbase4.apache.org,42289,1691729979868 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 04:59:51,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] ipc.CallRunner(144): callId: 38 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.14.131:41944 deadline: 1691730001059, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=f603e6eaa425d7a4972b6fd9a0817fdf, server=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 04:59:51,063 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp/info/8d59476f4fdf441f86de719eefe2cc31 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/8d59476f4fdf441f86de719eefe2cc31 2023-08-11 04:59:51,069 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/8d59476f4fdf441f86de719eefe2cc31, entries=8, sequenceid=12, filesize=13.0 K 2023-08-11 04:59:51,070 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for f603e6eaa425d7a4972b6fd9a0817fdf in 43ms, sequenceid=12, compaction requested=false 2023-08-11 04:59:51,070 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for f603e6eaa425d7a4972b6fd9a0817fdf: 2023-08-11 05:00:01,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 05:00:01,090 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing f603e6eaa425d7a4972b6fd9a0817fdf 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-11 05:00:01,110 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=37 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp/info/b99df73a7178485bbcd883b63c3275ad 2023-08-11 05:00:01,119 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp/info/b99df73a7178485bbcd883b63c3275ad as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/b99df73a7178485bbcd883b63c3275ad 2023-08-11 05:00:01,126 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/b99df73a7178485bbcd883b63c3275ad, entries=22, sequenceid=37, filesize=27.4 K 2023-08-11 05:00:01,127 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=2.05 KB/2102 for f603e6eaa425d7a4972b6fd9a0817fdf in 37ms, sequenceid=37, compaction requested=false 2023-08-11 05:00:01,128 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for f603e6eaa425d7a4972b6fd9a0817fdf: 2023-08-11 05:00:01,128 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=40.3 K, sizeToCheck=16.0 K 2023-08-11 05:00:01,128 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-11 05:00:01,129 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/b99df73a7178485bbcd883b63c3275ad because midkey is the same as first or last row 2023-08-11 05:00:03,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 05:00:03,114 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing f603e6eaa425d7a4972b6fd9a0817fdf 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 05:00:03,156 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=48 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp/info/5418cd3fae0044f58615aa618c7da659 2023-08-11 05:00:03,167 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=f603e6eaa425d7a4972b6fd9a0817fdf, server=jenkins-hbase4.apache.org,42289,1691729979868 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 05:00:03,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] ipc.CallRunner(144): callId: 70 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.14.131:41944 deadline: 1691730013163, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=f603e6eaa425d7a4972b6fd9a0817fdf, server=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:00:03,170 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp/info/5418cd3fae0044f58615aa618c7da659 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/5418cd3fae0044f58615aa618c7da659 2023-08-11 05:00:03,178 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/5418cd3fae0044f58615aa618c7da659, entries=8, sequenceid=48, filesize=13.0 K 2023-08-11 05:00:03,180 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for f603e6eaa425d7a4972b6fd9a0817fdf in 66ms, sequenceid=48, compaction requested=true 2023-08-11 05:00:03,180 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for f603e6eaa425d7a4972b6fd9a0817fdf: 2023-08-11 05:00:03,180 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=53.3 K, sizeToCheck=16.0 K 2023-08-11 05:00:03,180 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-11 05:00:03,180 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/b99df73a7178485bbcd883b63c3275ad because midkey is the same as first or last row 2023-08-11 05:00:03,183 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:00:03,183 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 05:00:03,186 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 54576 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 05:00:03,186 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1912): f603e6eaa425d7a4972b6fd9a0817fdf/info is initiating minor compaction (all files) 2023-08-11 05:00:03,186 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f603e6eaa425d7a4972b6fd9a0817fdf/info in TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. 2023-08-11 05:00:03,187 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/8d59476f4fdf441f86de719eefe2cc31, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/b99df73a7178485bbcd883b63c3275ad, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/5418cd3fae0044f58615aa618c7da659] into tmpdir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp, totalSize=53.3 K 2023-08-11 05:00:03,187 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 8d59476f4fdf441f86de719eefe2cc31, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1691729991014 2023-08-11 05:00:03,188 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting b99df73a7178485bbcd883b63c3275ad, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=37, earliestPutTs=1691729991028 2023-08-11 05:00:03,189 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 5418cd3fae0044f58615aa618c7da659, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1691730001091 2023-08-11 05:00:03,215 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] throttle.PressureAwareThroughputController(145): f603e6eaa425d7a4972b6fd9a0817fdf#info#compaction#18 average throughput is 9.52 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 05:00:03,669 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp/info/9e2fc37df1324f838b482c992577583b as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/9e2fc37df1324f838b482c992577583b 2023-08-11 05:00:03,677 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f603e6eaa425d7a4972b6fd9a0817fdf/info of f603e6eaa425d7a4972b6fd9a0817fdf into 9e2fc37df1324f838b482c992577583b(size=43.9 K), total size for store is 43.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 05:00:03,677 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f603e6eaa425d7a4972b6fd9a0817fdf: 2023-08-11 05:00:03,678 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf., storeName=f603e6eaa425d7a4972b6fd9a0817fdf/info, priority=13, startTime=1691730003182; duration=0sec 2023-08-11 05:00:03,679 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=43.9 K, sizeToCheck=16.0 K 2023-08-11 05:00:03,679 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-11 05:00:03,679 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.StoreUtils(129): cannot split hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/9e2fc37df1324f838b482c992577583b because midkey is the same as first or last row 2023-08-11 05:00:03,679 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:00:13,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 05:00:13,185 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing f603e6eaa425d7a4972b6fd9a0817fdf 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-11 05:00:13,202 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=74 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp/info/4dae32b372c846afba0a0ae0a282ec4e 2023-08-11 05:00:13,209 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp/info/4dae32b372c846afba0a0ae0a282ec4e as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/4dae32b372c846afba0a0ae0a282ec4e 2023-08-11 05:00:13,215 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/4dae32b372c846afba0a0ae0a282ec4e, entries=22, sequenceid=74, filesize=27.4 K 2023-08-11 05:00:13,216 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=4.11 KB/4204 for f603e6eaa425d7a4972b6fd9a0817fdf in 31ms, sequenceid=74, compaction requested=false 2023-08-11 05:00:13,216 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for f603e6eaa425d7a4972b6fd9a0817fdf: 2023-08-11 05:00:13,216 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=71.3 K, sizeToCheck=16.0 K 2023-08-11 05:00:13,216 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-11 05:00:13,216 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/9e2fc37df1324f838b482c992577583b because midkey is the same as first or last row 2023-08-11 05:00:15,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 05:00:15,197 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing f603e6eaa425d7a4972b6fd9a0817fdf 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 05:00:15,223 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=85 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp/info/b31b0a98f75643aebe26d4de5077e8f2 2023-08-11 05:00:15,231 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=f603e6eaa425d7a4972b6fd9a0817fdf, server=jenkins-hbase4.apache.org,42289,1691729979868 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 05:00:15,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] ipc.CallRunner(144): callId: 102 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.14.131:41944 deadline: 1691730025230, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=f603e6eaa425d7a4972b6fd9a0817fdf, server=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:00:15,231 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp/info/b31b0a98f75643aebe26d4de5077e8f2 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/b31b0a98f75643aebe26d4de5077e8f2 2023-08-11 05:00:15,239 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/b31b0a98f75643aebe26d4de5077e8f2, entries=8, sequenceid=85, filesize=13.0 K 2023-08-11 05:00:15,240 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for f603e6eaa425d7a4972b6fd9a0817fdf in 43ms, sequenceid=85, compaction requested=true 2023-08-11 05:00:15,240 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for f603e6eaa425d7a4972b6fd9a0817fdf: 2023-08-11 05:00:15,240 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=84.3 K, sizeToCheck=16.0 K 2023-08-11 05:00:15,240 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-11 05:00:15,240 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/9e2fc37df1324f838b482c992577583b because midkey is the same as first or last row 2023-08-11 05:00:15,240 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:00:15,240 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 05:00:15,242 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 86295 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 05:00:15,242 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1912): f603e6eaa425d7a4972b6fd9a0817fdf/info is initiating minor compaction (all files) 2023-08-11 05:00:15,242 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f603e6eaa425d7a4972b6fd9a0817fdf/info in TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. 2023-08-11 05:00:15,242 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/9e2fc37df1324f838b482c992577583b, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/4dae32b372c846afba0a0ae0a282ec4e, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/b31b0a98f75643aebe26d4de5077e8f2] into tmpdir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp, totalSize=84.3 K 2023-08-11 05:00:15,243 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 9e2fc37df1324f838b482c992577583b, keycount=38, bloomtype=ROW, size=43.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1691729991014 2023-08-11 05:00:15,243 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 4dae32b372c846afba0a0ae0a282ec4e, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=74, earliestPutTs=1691730003115 2023-08-11 05:00:15,244 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting b31b0a98f75643aebe26d4de5077e8f2, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=85, earliestPutTs=1691730013186 2023-08-11 05:00:15,258 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] throttle.PressureAwareThroughputController(145): f603e6eaa425d7a4972b6fd9a0817fdf#info#compaction#21 average throughput is 22.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 05:00:15,280 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp/info/2850811ff599440ab8840ec355655f82 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/2850811ff599440ab8840ec355655f82 2023-08-11 05:00:15,287 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f603e6eaa425d7a4972b6fd9a0817fdf/info of f603e6eaa425d7a4972b6fd9a0817fdf into 2850811ff599440ab8840ec355655f82(size=75.0 K), total size for store is 75.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 05:00:15,287 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f603e6eaa425d7a4972b6fd9a0817fdf: 2023-08-11 05:00:15,287 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf., storeName=f603e6eaa425d7a4972b6fd9a0817fdf/info, priority=13, startTime=1691730015240; duration=0sec 2023-08-11 05:00:15,287 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=75.0 K, sizeToCheck=16.0 K 2023-08-11 05:00:15,287 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-11 05:00:15,288 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit(227): Splitting TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf., compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:00:15,288 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:00:15,290 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46565] assignment.AssignmentManager(1140): Split request from jenkins-hbase4.apache.org,42289,1691729979868, parent={ENCODED => f603e6eaa425d7a4972b6fd9a0817fdf, NAME => 'TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.', STARTKEY => '', ENDKEY => ''} splitKey=row0064 2023-08-11 05:00:15,297 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46565] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:00:15,303 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46565] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=f603e6eaa425d7a4972b6fd9a0817fdf, daughterA=2fdf6bb919aae0f8be272293db33ea6c, daughterB=e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:15,304 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=f603e6eaa425d7a4972b6fd9a0817fdf, daughterA=2fdf6bb919aae0f8be272293db33ea6c, daughterB=e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:15,304 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=f603e6eaa425d7a4972b6fd9a0817fdf, daughterA=2fdf6bb919aae0f8be272293db33ea6c, daughterB=e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:15,304 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=f603e6eaa425d7a4972b6fd9a0817fdf, daughterA=2fdf6bb919aae0f8be272293db33ea6c, daughterB=e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:15,312 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=f603e6eaa425d7a4972b6fd9a0817fdf, UNASSIGN}] 2023-08-11 05:00:15,313 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=f603e6eaa425d7a4972b6fd9a0817fdf, UNASSIGN 2023-08-11 05:00:15,314 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f603e6eaa425d7a4972b6fd9a0817fdf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:00:15,315 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691730015314"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691730015314"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691730015314"}]},"ts":"1691730015314"} 2023-08-11 05:00:15,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; CloseRegionProcedure f603e6eaa425d7a4972b6fd9a0817fdf, server=jenkins-hbase4.apache.org,42289,1691729979868}] 2023-08-11 05:00:15,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 05:00:15,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f603e6eaa425d7a4972b6fd9a0817fdf, disabling compactions & flushes 2023-08-11 05:00:15,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. 2023-08-11 05:00:15,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. 2023-08-11 05:00:15,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. after waiting 0 ms 2023-08-11 05:00:15,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. 2023-08-11 05:00:15,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f603e6eaa425d7a4972b6fd9a0817fdf 1/1 column families, dataSize=21.55 KB heapSize=23.38 KB 2023-08-11 05:00:15,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=21.55 KB at sequenceid=110 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp/info/d98d2e8f86b340d593e036453ee3de93 2023-08-11 05:00:15,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.tmp/info/d98d2e8f86b340d593e036453ee3de93 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/d98d2e8f86b340d593e036453ee3de93 2023-08-11 05:00:15,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/d98d2e8f86b340d593e036453ee3de93, entries=21, sequenceid=110, filesize=26.3 K 2023-08-11 05:00:15,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~21.55 KB/22071, heapSize ~23.37 KB/23928, currentSize=0 B/0 for f603e6eaa425d7a4972b6fd9a0817fdf in 23ms, sequenceid=110, compaction requested=false 2023-08-11 05:00:15,505 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/8d59476f4fdf441f86de719eefe2cc31, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/b99df73a7178485bbcd883b63c3275ad, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/9e2fc37df1324f838b482c992577583b, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/5418cd3fae0044f58615aa618c7da659, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/4dae32b372c846afba0a0ae0a282ec4e, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/b31b0a98f75643aebe26d4de5077e8f2] to archive 2023-08-11 05:00:15,506 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-11 05:00:15,508 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/8d59476f4fdf441f86de719eefe2cc31 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/8d59476f4fdf441f86de719eefe2cc31 2023-08-11 05:00:15,510 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/b99df73a7178485bbcd883b63c3275ad to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/b99df73a7178485bbcd883b63c3275ad 2023-08-11 05:00:15,512 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/9e2fc37df1324f838b482c992577583b to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/9e2fc37df1324f838b482c992577583b 2023-08-11 05:00:15,513 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/5418cd3fae0044f58615aa618c7da659 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/5418cd3fae0044f58615aa618c7da659 2023-08-11 05:00:15,514 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/4dae32b372c846afba0a0ae0a282ec4e to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/4dae32b372c846afba0a0ae0a282ec4e 2023-08-11 05:00:15,516 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/b31b0a98f75643aebe26d4de5077e8f2 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/b31b0a98f75643aebe26d4de5077e8f2 2023-08-11 05:00:15,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/recovered.edits/113.seqid, newMaxSeqId=113, maxSeqId=1 2023-08-11 05:00:15,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. 2023-08-11 05:00:15,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f603e6eaa425d7a4972b6fd9a0817fdf: 2023-08-11 05:00:15,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 05:00:15,524 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f603e6eaa425d7a4972b6fd9a0817fdf, regionState=CLOSED 2023-08-11 05:00:15,525 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691730015524"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691730015524"}]},"ts":"1691730015524"} 2023-08-11 05:00:15,528 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-08-11 05:00:15,528 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; CloseRegionProcedure f603e6eaa425d7a4972b6fd9a0817fdf, server=jenkins-hbase4.apache.org,42289,1691729979868 in 210 msec 2023-08-11 05:00:15,530 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-08-11 05:00:15,530 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=f603e6eaa425d7a4972b6fd9a0817fdf, UNASSIGN in 216 msec 2023-08-11 05:00:15,540 INFO [PEWorker-4] assignment.SplitTableRegionProcedure(694): pid=12 splitting 2 storefiles, region=f603e6eaa425d7a4972b6fd9a0817fdf, threads=2 2023-08-11 05:00:15,541 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/2850811ff599440ab8840ec355655f82 for region: f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 05:00:15,541 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/d98d2e8f86b340d593e036453ee3de93 for region: f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 05:00:15,552 DEBUG [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/d98d2e8f86b340d593e036453ee3de93, top=true 2023-08-11 05:00:15,559 INFO [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/.splits/e09a29d8d57ff738e5c46b87d96accf6/info/TestLogRolling-testLogRolling=f603e6eaa425d7a4972b6fd9a0817fdf-d98d2e8f86b340d593e036453ee3de93 for child: e09a29d8d57ff738e5c46b87d96accf6, parent: f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 05:00:15,560 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/d98d2e8f86b340d593e036453ee3de93 for region: f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 05:00:15,574 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/2850811ff599440ab8840ec355655f82 for region: f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 05:00:15,574 DEBUG [PEWorker-4] assignment.SplitTableRegionProcedure(755): pid=12 split storefiles for region f603e6eaa425d7a4972b6fd9a0817fdf Daughter A: 1 storefiles, Daughter B: 2 storefiles. 2023-08-11 05:00:15,602 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/2fdf6bb919aae0f8be272293db33ea6c/recovered.edits/113.seqid, newMaxSeqId=113, maxSeqId=-1 2023-08-11 05:00:15,604 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/recovered.edits/113.seqid, newMaxSeqId=113, maxSeqId=-1 2023-08-11 05:00:15,606 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691730015605"},{"qualifier":"splitA","vlen":70,"tag":[],"timestamp":"1691730015605"},{"qualifier":"splitB","vlen":70,"tag":[],"timestamp":"1691730015605"}]},"ts":"1691730015605"} 2023-08-11 05:00:15,606 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691730015605"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691730015605"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691730015605"}]},"ts":"1691730015605"} 2023-08-11 05:00:15,606 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691730015605"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691730015605"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691730015605"}]},"ts":"1691730015605"} 2023-08-11 05:00:15,647 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42289] regionserver.HRegion(9158): Flush requested on 1588230740 2023-08-11 05:00:15,647 DEBUG [MemStoreFlusher.0] regionserver.FlushAllLargeStoresPolicy(69): Since none of the CFs were above the size, flushing all. 2023-08-11 05:00:15,647 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=4.82 KB heapSize=8.36 KB 2023-08-11 05:00:15,657 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=2fdf6bb919aae0f8be272293db33ea6c, ASSIGN}, {pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e09a29d8d57ff738e5c46b87d96accf6, ASSIGN}] 2023-08-11 05:00:15,658 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e09a29d8d57ff738e5c46b87d96accf6, ASSIGN 2023-08-11 05:00:15,659 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=2fdf6bb919aae0f8be272293db33ea6c, ASSIGN 2023-08-11 05:00:15,660 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e09a29d8d57ff738e5c46b87d96accf6, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,42289,1691729979868; forceNewPlan=false, retain=false 2023-08-11 05:00:15,660 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=2fdf6bb919aae0f8be272293db33ea6c, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,42289,1691729979868; forceNewPlan=false, retain=false 2023-08-11 05:00:15,665 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=4.61 KB at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/.tmp/info/215655e084304fcbb94839391861cd6b 2023-08-11 05:00:15,682 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=216 B at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/.tmp/table/aab91b92659848d49e4d174aa83a1520 2023-08-11 05:00:15,689 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/.tmp/info/215655e084304fcbb94839391861cd6b as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/info/215655e084304fcbb94839391861cd6b 2023-08-11 05:00:15,694 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/info/215655e084304fcbb94839391861cd6b, entries=29, sequenceid=17, filesize=8.6 K 2023-08-11 05:00:15,695 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/.tmp/table/aab91b92659848d49e4d174aa83a1520 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/table/aab91b92659848d49e4d174aa83a1520 2023-08-11 05:00:15,700 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/table/aab91b92659848d49e4d174aa83a1520, entries=4, sequenceid=17, filesize=4.8 K 2023-08-11 05:00:15,702 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~4.82 KB/4934, heapSize ~8.08 KB/8272, currentSize=0 B/0 for 1588230740 in 55ms, sequenceid=17, compaction requested=false 2023-08-11 05:00:15,702 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-08-11 05:00:15,811 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=2fdf6bb919aae0f8be272293db33ea6c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:00:15,811 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e09a29d8d57ff738e5c46b87d96accf6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:00:15,812 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691730015811"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691730015811"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691730015811"}]},"ts":"1691730015811"} 2023-08-11 05:00:15,812 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691730015811"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691730015811"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691730015811"}]},"ts":"1691730015811"} 2023-08-11 05:00:15,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 2fdf6bb919aae0f8be272293db33ea6c, server=jenkins-hbase4.apache.org,42289,1691729979868}] 2023-08-11 05:00:15,814 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=18, ppid=16, state=RUNNABLE; OpenRegionProcedure e09a29d8d57ff738e5c46b87d96accf6, server=jenkins-hbase4.apache.org,42289,1691729979868}] 2023-08-11 05:00:15,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:00:15,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e09a29d8d57ff738e5c46b87d96accf6, NAME => 'TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6.', STARTKEY => 'row0064', ENDKEY => ''} 2023-08-11 05:00:15,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:15,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:00:15,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:15,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:15,971 INFO [StoreOpener-e09a29d8d57ff738e5c46b87d96accf6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:15,972 DEBUG [StoreOpener-e09a29d8d57ff738e5c46b87d96accf6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info 2023-08-11 05:00:15,972 DEBUG [StoreOpener-e09a29d8d57ff738e5c46b87d96accf6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info 2023-08-11 05:00:15,973 INFO [StoreOpener-e09a29d8d57ff738e5c46b87d96accf6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e09a29d8d57ff738e5c46b87d96accf6 columnFamilyName info 2023-08-11 05:00:15,985 DEBUG [StoreOpener-e09a29d8d57ff738e5c46b87d96accf6-1] regionserver.HStore(539): loaded hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/2850811ff599440ab8840ec355655f82.f603e6eaa425d7a4972b6fd9a0817fdf->hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/2850811ff599440ab8840ec355655f82-top 2023-08-11 05:00:15,991 DEBUG [StoreOpener-e09a29d8d57ff738e5c46b87d96accf6-1] regionserver.HStore(539): loaded hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/TestLogRolling-testLogRolling=f603e6eaa425d7a4972b6fd9a0817fdf-d98d2e8f86b340d593e036453ee3de93 2023-08-11 05:00:15,992 INFO [StoreOpener-e09a29d8d57ff738e5c46b87d96accf6-1] regionserver.HStore(310): Store=e09a29d8d57ff738e5c46b87d96accf6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:00:15,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:15,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:15,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:15,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e09a29d8d57ff738e5c46b87d96accf6; next sequenceid=114; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=721078, jitterRate=-0.08310285210609436}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 05:00:15,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:00:16,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6., pid=18, masterSystemTime=1691730015965 2023-08-11 05:00:16,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:00:16,001 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 2 store files, 0 compacting, 2 eligible, 16 blocking 2023-08-11 05:00:16,002 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:00:16,002 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1912): e09a29d8d57ff738e5c46b87d96accf6/info is initiating minor compaction (all files) 2023-08-11 05:00:16,002 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e09a29d8d57ff738e5c46b87d96accf6/info in TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:00:16,002 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/2850811ff599440ab8840ec355655f82.f603e6eaa425d7a4972b6fd9a0817fdf->hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/2850811ff599440ab8840ec355655f82-top, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/TestLogRolling-testLogRolling=f603e6eaa425d7a4972b6fd9a0817fdf-d98d2e8f86b340d593e036453ee3de93] into tmpdir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp, totalSize=101.3 K 2023-08-11 05:00:16,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:00:16,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:00:16,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c. 2023-08-11 05:00:16,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2fdf6bb919aae0f8be272293db33ea6c, NAME => 'TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c.', STARTKEY => '', ENDKEY => 'row0064'} 2023-08-11 05:00:16,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling 2fdf6bb919aae0f8be272293db33ea6c 2023-08-11 05:00:16,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:00:16,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2fdf6bb919aae0f8be272293db33ea6c 2023-08-11 05:00:16,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2fdf6bb919aae0f8be272293db33ea6c 2023-08-11 05:00:16,003 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 2850811ff599440ab8840ec355655f82.f603e6eaa425d7a4972b6fd9a0817fdf, keycount=34, bloomtype=ROW, size=75.0 K, encoding=NONE, compression=NONE, seqNum=86, earliestPutTs=1691729991014 2023-08-11 05:00:16,004 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e09a29d8d57ff738e5c46b87d96accf6, regionState=OPEN, openSeqNum=114, regionLocation=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:00:16,005 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691730016004"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691730016004"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691730016004"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691730016004"}]},"ts":"1691730016004"} 2023-08-11 05:00:16,006 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting TestLogRolling-testLogRolling=f603e6eaa425d7a4972b6fd9a0817fdf-d98d2e8f86b340d593e036453ee3de93, keycount=21, bloomtype=ROW, size=26.3 K, encoding=NONE, compression=NONE, seqNum=110, earliestPutTs=1691730015198 2023-08-11 05:00:16,007 INFO [StoreOpener-2fdf6bb919aae0f8be272293db33ea6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2fdf6bb919aae0f8be272293db33ea6c 2023-08-11 05:00:16,009 DEBUG [StoreOpener-2fdf6bb919aae0f8be272293db33ea6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/2fdf6bb919aae0f8be272293db33ea6c/info 2023-08-11 05:00:16,009 DEBUG [StoreOpener-2fdf6bb919aae0f8be272293db33ea6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/2fdf6bb919aae0f8be272293db33ea6c/info 2023-08-11 05:00:16,010 INFO [StoreOpener-2fdf6bb919aae0f8be272293db33ea6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fdf6bb919aae0f8be272293db33ea6c columnFamilyName info 2023-08-11 05:00:16,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=16 2023-08-11 05:00:16,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=16, state=SUCCESS; OpenRegionProcedure e09a29d8d57ff738e5c46b87d96accf6, server=jenkins-hbase4.apache.org,42289,1691729979868 in 193 msec 2023-08-11 05:00:16,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e09a29d8d57ff738e5c46b87d96accf6, ASSIGN in 353 msec 2023-08-11 05:00:16,024 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] throttle.PressureAwareThroughputController(145): e09a29d8d57ff738e5c46b87d96accf6#info#compaction#25 average throughput is 26.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 05:00:16,045 DEBUG [StoreOpener-2fdf6bb919aae0f8be272293db33ea6c-1] regionserver.HStore(539): loaded hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/2fdf6bb919aae0f8be272293db33ea6c/info/2850811ff599440ab8840ec355655f82.f603e6eaa425d7a4972b6fd9a0817fdf->hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/2850811ff599440ab8840ec355655f82-bottom 2023-08-11 05:00:16,045 INFO [StoreOpener-2fdf6bb919aae0f8be272293db33ea6c-1] regionserver.HStore(310): Store=2fdf6bb919aae0f8be272293db33ea6c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:00:16,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/2fdf6bb919aae0f8be272293db33ea6c 2023-08-11 05:00:16,048 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/0698bca404ca44bfb52602e3ced6126b as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/0698bca404ca44bfb52602e3ced6126b 2023-08-11 05:00:16,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/2fdf6bb919aae0f8be272293db33ea6c 2023-08-11 05:00:16,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2fdf6bb919aae0f8be272293db33ea6c 2023-08-11 05:00:16,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2fdf6bb919aae0f8be272293db33ea6c; next sequenceid=114; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=767341, jitterRate=-0.024275988340377808}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 05:00:16,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2fdf6bb919aae0f8be272293db33ea6c: 2023-08-11 05:00:16,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c., pid=17, masterSystemTime=1691730015965 2023-08-11 05:00:16,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:00:16,055 DEBUG [RS:0;jenkins-hbase4:42289-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-08-11 05:00:16,056 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 (all) file(s) in e09a29d8d57ff738e5c46b87d96accf6/info of e09a29d8d57ff738e5c46b87d96accf6 into 0698bca404ca44bfb52602e3ced6126b(size=31.6 K), total size for store is 31.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 05:00:16,056 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:00:16,056 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6., storeName=e09a29d8d57ff738e5c46b87d96accf6/info, priority=14, startTime=1691730016000; duration=0sec 2023-08-11 05:00:16,056 INFO [RS:0;jenkins-hbase4:42289-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c. 2023-08-11 05:00:16,057 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:00:16,057 DEBUG [RS:0;jenkins-hbase4:42289-longCompactions-0] regionserver.HStore(1912): 2fdf6bb919aae0f8be272293db33ea6c/info is initiating minor compaction (all files) 2023-08-11 05:00:16,057 INFO [RS:0;jenkins-hbase4:42289-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 2fdf6bb919aae0f8be272293db33ea6c/info in TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c. 2023-08-11 05:00:16,057 INFO [RS:0;jenkins-hbase4:42289-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/2fdf6bb919aae0f8be272293db33ea6c/info/2850811ff599440ab8840ec355655f82.f603e6eaa425d7a4972b6fd9a0817fdf->hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/2850811ff599440ab8840ec355655f82-bottom] into tmpdir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/2fdf6bb919aae0f8be272293db33ea6c/.tmp, totalSize=75.0 K 2023-08-11 05:00:16,058 DEBUG [RS:0;jenkins-hbase4:42289-longCompactions-0] compactions.Compactor(207): Compacting 2850811ff599440ab8840ec355655f82.f603e6eaa425d7a4972b6fd9a0817fdf, keycount=34, bloomtype=ROW, size=75.0 K, encoding=NONE, compression=NONE, seqNum=85, earliestPutTs=1691729991014 2023-08-11 05:00:16,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c. 2023-08-11 05:00:16,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c. 2023-08-11 05:00:16,060 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=2fdf6bb919aae0f8be272293db33ea6c, regionState=OPEN, openSeqNum=114, regionLocation=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:00:16,060 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691730016060"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691730016060"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691730016060"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691730016060"}]},"ts":"1691730016060"} 2023-08-11 05:00:16,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-08-11 05:00:16,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 2fdf6bb919aae0f8be272293db33ea6c, server=jenkins-hbase4.apache.org,42289,1691729979868 in 250 msec 2023-08-11 05:00:16,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=12 2023-08-11 05:00:16,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=f603e6eaa425d7a4972b6fd9a0817fdf, daughterA=2fdf6bb919aae0f8be272293db33ea6c, daughterB=e09a29d8d57ff738e5c46b87d96accf6 in 772 msec 2023-08-11 05:00:16,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=2fdf6bb919aae0f8be272293db33ea6c, ASSIGN in 410 msec 2023-08-11 05:00:16,079 INFO [RS:0;jenkins-hbase4:42289-longCompactions-0] throttle.PressureAwareThroughputController(145): 2fdf6bb919aae0f8be272293db33ea6c#info#compaction#26 average throughput is 31.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 05:00:16,106 DEBUG [RS:0;jenkins-hbase4:42289-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/2fdf6bb919aae0f8be272293db33ea6c/.tmp/info/2f07334095bb4dda892db0dfab886960 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/2fdf6bb919aae0f8be272293db33ea6c/info/2f07334095bb4dda892db0dfab886960 2023-08-11 05:00:16,118 INFO [RS:0;jenkins-hbase4:42289-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 2fdf6bb919aae0f8be272293db33ea6c/info of 2fdf6bb919aae0f8be272293db33ea6c into 2f07334095bb4dda892db0dfab886960(size=69.7 K), total size for store is 69.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 05:00:16,118 DEBUG [RS:0;jenkins-hbase4:42289-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2fdf6bb919aae0f8be272293db33ea6c: 2023-08-11 05:00:16,118 INFO [RS:0;jenkins-hbase4:42289-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c., storeName=2fdf6bb919aae0f8be272293db33ea6c/info, priority=15, startTime=1691730016055; duration=0sec 2023-08-11 05:00:16,118 DEBUG [RS:0;jenkins-hbase4:42289-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:00:21,072 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-11 05:00:25,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] ipc.CallRunner(144): callId: 104 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.14.131:41944 deadline: 1691730035309, exception=org.apache.hadoop.hbase.NotServingRegionException: TestLogRolling-testLogRolling,,1691729981000.f603e6eaa425d7a4972b6fd9a0817fdf. is not online on jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:00:47,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:47,384 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e09a29d8d57ff738e5c46b87d96accf6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 05:00:47,399 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=125 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/9b80f2957de54a79929d6064914adc7f 2023-08-11 05:00:47,407 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/9b80f2957de54a79929d6064914adc7f as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/9b80f2957de54a79929d6064914adc7f 2023-08-11 05:00:47,414 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/9b80f2957de54a79929d6064914adc7f, entries=8, sequenceid=125, filesize=13.0 K 2023-08-11 05:00:47,415 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=14.37 KB/14714 for e09a29d8d57ff738e5c46b87d96accf6 in 31ms, sequenceid=125, compaction requested=false 2023-08-11 05:00:47,415 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:00:47,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:47,416 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e09a29d8d57ff738e5c46b87d96accf6 1/1 column families, dataSize=15.40 KB heapSize=16.77 KB 2023-08-11 05:00:47,455 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=15.40 KB at sequenceid=143 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/1796c785faf34f9a9ceb26b4244fbbc2 2023-08-11 05:00:47,460 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e09a29d8d57ff738e5c46b87d96accf6, server=jenkins-hbase4.apache.org,42289,1691729979868 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 05:00:47,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] ipc.CallRunner(144): callId: 145 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:41944 deadline: 1691730057460, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e09a29d8d57ff738e5c46b87d96accf6, server=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:00:47,473 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/1796c785faf34f9a9ceb26b4244fbbc2 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/1796c785faf34f9a9ceb26b4244fbbc2 2023-08-11 05:00:47,478 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/1796c785faf34f9a9ceb26b4244fbbc2, entries=15, sequenceid=143, filesize=20.2 K 2023-08-11 05:00:47,479 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~15.40 KB/15765, heapSize ~16.76 KB/17160, currentSize=14.37 KB/14714 for e09a29d8d57ff738e5c46b87d96accf6 in 63ms, sequenceid=143, compaction requested=true 2023-08-11 05:00:47,479 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:00:47,479 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:00:47,480 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 05:00:47,481 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 66344 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 05:00:47,481 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1912): e09a29d8d57ff738e5c46b87d96accf6/info is initiating minor compaction (all files) 2023-08-11 05:00:47,481 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e09a29d8d57ff738e5c46b87d96accf6/info in TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:00:47,481 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/0698bca404ca44bfb52602e3ced6126b, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/9b80f2957de54a79929d6064914adc7f, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/1796c785faf34f9a9ceb26b4244fbbc2] into tmpdir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp, totalSize=64.8 K 2023-08-11 05:00:47,482 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 0698bca404ca44bfb52602e3ced6126b, keycount=26, bloomtype=ROW, size=31.6 K, encoding=NONE, compression=NONE, seqNum=110, earliestPutTs=1691730013191 2023-08-11 05:00:47,482 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 9b80f2957de54a79929d6064914adc7f, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=125, earliestPutTs=1691730045370 2023-08-11 05:00:47,482 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 1796c785faf34f9a9ceb26b4244fbbc2, keycount=15, bloomtype=ROW, size=20.2 K, encoding=NONE, compression=NONE, seqNum=143, earliestPutTs=1691730047385 2023-08-11 05:00:47,494 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] throttle.PressureAwareThroughputController(145): e09a29d8d57ff738e5c46b87d96accf6#info#compaction#29 average throughput is 24.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 05:00:47,512 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/defbdffdcf6c4335bf990110ec9363f5 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/defbdffdcf6c4335bf990110ec9363f5 2023-08-11 05:00:47,519 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e09a29d8d57ff738e5c46b87d96accf6/info of e09a29d8d57ff738e5c46b87d96accf6 into defbdffdcf6c4335bf990110ec9363f5(size=55.4 K), total size for store is 55.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 05:00:47,519 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:00:47,519 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6., storeName=e09a29d8d57ff738e5c46b87d96accf6/info, priority=13, startTime=1691730047479; duration=0sec 2023-08-11 05:00:47,519 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:00:57,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:57,539 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e09a29d8d57ff738e5c46b87d96accf6 1/1 column families, dataSize=15.40 KB heapSize=16.77 KB 2023-08-11 05:00:57,552 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=15.40 KB at sequenceid=162 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/8b13f4050ba648ea9167efa0979d943c 2023-08-11 05:00:57,558 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/8b13f4050ba648ea9167efa0979d943c as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/8b13f4050ba648ea9167efa0979d943c 2023-08-11 05:00:57,562 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/8b13f4050ba648ea9167efa0979d943c, entries=15, sequenceid=162, filesize=20.2 K 2023-08-11 05:00:57,563 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~15.40 KB/15765, heapSize ~16.76 KB/17160, currentSize=1.03 KB/1051 for e09a29d8d57ff738e5c46b87d96accf6 in 24ms, sequenceid=162, compaction requested=false 2023-08-11 05:00:57,563 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:00:59,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:59,549 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e09a29d8d57ff738e5c46b87d96accf6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 05:00:59,564 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=173 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/3ffa12081849477883899b990d3e8a4a 2023-08-11 05:00:59,571 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/3ffa12081849477883899b990d3e8a4a as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/3ffa12081849477883899b990d3e8a4a 2023-08-11 05:00:59,577 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/3ffa12081849477883899b990d3e8a4a, entries=8, sequenceid=173, filesize=13.0 K 2023-08-11 05:00:59,578 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=20.53 KB/21020 for e09a29d8d57ff738e5c46b87d96accf6 in 28ms, sequenceid=173, compaction requested=true 2023-08-11 05:00:59,578 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:00:59,578 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:00:59,578 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 05:00:59,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:00:59,579 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e09a29d8d57ff738e5c46b87d96accf6 1/1 column families, dataSize=21.55 KB heapSize=23.38 KB 2023-08-11 05:00:59,579 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 90705 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 05:00:59,579 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1912): e09a29d8d57ff738e5c46b87d96accf6/info is initiating minor compaction (all files) 2023-08-11 05:00:59,579 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e09a29d8d57ff738e5c46b87d96accf6/info in TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:00:59,579 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/defbdffdcf6c4335bf990110ec9363f5, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/8b13f4050ba648ea9167efa0979d943c, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/3ffa12081849477883899b990d3e8a4a] into tmpdir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp, totalSize=88.6 K 2023-08-11 05:00:59,580 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting defbdffdcf6c4335bf990110ec9363f5, keycount=49, bloomtype=ROW, size=55.4 K, encoding=NONE, compression=NONE, seqNum=143, earliestPutTs=1691730013191 2023-08-11 05:00:59,580 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 8b13f4050ba648ea9167efa0979d943c, keycount=15, bloomtype=ROW, size=20.2 K, encoding=NONE, compression=NONE, seqNum=162, earliestPutTs=1691730047417 2023-08-11 05:00:59,581 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 3ffa12081849477883899b990d3e8a4a, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=173, earliestPutTs=1691730057539 2023-08-11 05:00:59,591 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=21.55 KB at sequenceid=197 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/dcf821fd321445dea745d5329ad2269c 2023-08-11 05:00:59,597 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] throttle.PressureAwareThroughputController(145): e09a29d8d57ff738e5c46b87d96accf6#info#compaction#33 average throughput is 36.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 05:00:59,606 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/dcf821fd321445dea745d5329ad2269c as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/dcf821fd321445dea745d5329ad2269c 2023-08-11 05:00:59,617 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/dcf821fd321445dea745d5329ad2269c, entries=21, sequenceid=197, filesize=26.4 K 2023-08-11 05:00:59,618 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~21.55 KB/22071, heapSize ~23.37 KB/23928, currentSize=4.11 KB/4204 for e09a29d8d57ff738e5c46b87d96accf6 in 40ms, sequenceid=197, compaction requested=false 2023-08-11 05:00:59,618 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:00:59,620 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/cbc1ddd614154352a82b3b696c99b659 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/cbc1ddd614154352a82b3b696c99b659 2023-08-11 05:00:59,626 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e09a29d8d57ff738e5c46b87d96accf6/info of e09a29d8d57ff738e5c46b87d96accf6 into cbc1ddd614154352a82b3b696c99b659(size=79.3 K), total size for store is 105.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 05:00:59,627 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:00:59,627 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6., storeName=e09a29d8d57ff738e5c46b87d96accf6/info, priority=13, startTime=1691730059578; duration=0sec 2023-08-11 05:00:59,627 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:01:01,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:01:01,590 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e09a29d8d57ff738e5c46b87d96accf6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 05:01:01,615 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=209 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/6e699bd6a0e441e9b53ed600862f439b 2023-08-11 05:01:01,615 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e09a29d8d57ff738e5c46b87d96accf6, server=jenkins-hbase4.apache.org,42289,1691729979868 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 05:01:01,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:41944 deadline: 1691730071615, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e09a29d8d57ff738e5c46b87d96accf6, server=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:01:01,622 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/6e699bd6a0e441e9b53ed600862f439b as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/6e699bd6a0e441e9b53ed600862f439b 2023-08-11 05:01:01,628 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/6e699bd6a0e441e9b53ed600862f439b, entries=8, sequenceid=209, filesize=13.0 K 2023-08-11 05:01:01,629 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for e09a29d8d57ff738e5c46b87d96accf6 in 39ms, sequenceid=209, compaction requested=true 2023-08-11 05:01:01,629 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:01:01,629 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:01:01,629 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 05:01:01,630 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 121485 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 05:01:01,630 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1912): e09a29d8d57ff738e5c46b87d96accf6/info is initiating minor compaction (all files) 2023-08-11 05:01:01,630 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e09a29d8d57ff738e5c46b87d96accf6/info in TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:01:01,630 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/cbc1ddd614154352a82b3b696c99b659, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/dcf821fd321445dea745d5329ad2269c, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/6e699bd6a0e441e9b53ed600862f439b] into tmpdir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp, totalSize=118.6 K 2023-08-11 05:01:01,631 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting cbc1ddd614154352a82b3b696c99b659, keycount=72, bloomtype=ROW, size=79.3 K, encoding=NONE, compression=NONE, seqNum=173, earliestPutTs=1691730013191 2023-08-11 05:01:01,631 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting dcf821fd321445dea745d5329ad2269c, keycount=21, bloomtype=ROW, size=26.4 K, encoding=NONE, compression=NONE, seqNum=197, earliestPutTs=1691730059550 2023-08-11 05:01:01,631 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 6e699bd6a0e441e9b53ed600862f439b, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=209, earliestPutTs=1691730059579 2023-08-11 05:01:01,644 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] throttle.PressureAwareThroughputController(145): e09a29d8d57ff738e5c46b87d96accf6#info#compaction#35 average throughput is 33.74 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 05:01:01,658 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/414283b8ade44a4583316f5515d66ee7 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/414283b8ade44a4583316f5515d66ee7 2023-08-11 05:01:01,665 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e09a29d8d57ff738e5c46b87d96accf6/info of e09a29d8d57ff738e5c46b87d96accf6 into 414283b8ade44a4583316f5515d66ee7(size=109.2 K), total size for store is 109.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 05:01:01,665 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:01:01,665 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6., storeName=e09a29d8d57ff738e5c46b87d96accf6/info, priority=13, startTime=1691730061629; duration=0sec 2023-08-11 05:01:01,665 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:01:11,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:01:11,651 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e09a29d8d57ff738e5c46b87d96accf6 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-11 05:01:11,668 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=235 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/d95159c4d4e94d52b8a186c5854461b4 2023-08-11 05:01:11,675 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/d95159c4d4e94d52b8a186c5854461b4 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/d95159c4d4e94d52b8a186c5854461b4 2023-08-11 05:01:11,681 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/d95159c4d4e94d52b8a186c5854461b4, entries=22, sequenceid=235, filesize=27.4 K 2023-08-11 05:01:11,682 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=6.16 KB/6306 for e09a29d8d57ff738e5c46b87d96accf6 in 31ms, sequenceid=235, compaction requested=false 2023-08-11 05:01:11,682 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:01:13,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:01:13,664 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e09a29d8d57ff738e5c46b87d96accf6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 05:01:13,679 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=246 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/14e5a66457404658960ebf383e5d740f 2023-08-11 05:01:13,685 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/14e5a66457404658960ebf383e5d740f as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/14e5a66457404658960ebf383e5d740f 2023-08-11 05:01:13,693 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e09a29d8d57ff738e5c46b87d96accf6, server=jenkins-hbase4.apache.org,42289,1691729979868 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 05:01:13,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] ipc.CallRunner(144): callId: 238 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:41944 deadline: 1691730083692, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e09a29d8d57ff738e5c46b87d96accf6, server=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:01:13,699 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/14e5a66457404658960ebf383e5d740f, entries=8, sequenceid=246, filesize=13.0 K 2023-08-11 05:01:13,700 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for e09a29d8d57ff738e5c46b87d96accf6 in 36ms, sequenceid=246, compaction requested=true 2023-08-11 05:01:13,700 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:01:13,700 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:01:13,700 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 05:01:13,701 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 153185 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 05:01:13,702 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1912): e09a29d8d57ff738e5c46b87d96accf6/info is initiating minor compaction (all files) 2023-08-11 05:01:13,702 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e09a29d8d57ff738e5c46b87d96accf6/info in TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:01:13,702 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/414283b8ade44a4583316f5515d66ee7, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/d95159c4d4e94d52b8a186c5854461b4, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/14e5a66457404658960ebf383e5d740f] into tmpdir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp, totalSize=149.6 K 2023-08-11 05:01:13,702 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 414283b8ade44a4583316f5515d66ee7, keycount=101, bloomtype=ROW, size=109.2 K, encoding=NONE, compression=NONE, seqNum=209, earliestPutTs=1691730013191 2023-08-11 05:01:13,703 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting d95159c4d4e94d52b8a186c5854461b4, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=235, earliestPutTs=1691730061591 2023-08-11 05:01:13,703 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 14e5a66457404658960ebf383e5d740f, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=246, earliestPutTs=1691730071653 2023-08-11 05:01:13,714 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] throttle.PressureAwareThroughputController(145): e09a29d8d57ff738e5c46b87d96accf6#info#compaction#38 average throughput is 65.65 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 05:01:13,727 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/f0426ecb74c442809402b6bd7fbc5574 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/f0426ecb74c442809402b6bd7fbc5574 2023-08-11 05:01:13,732 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e09a29d8d57ff738e5c46b87d96accf6/info of e09a29d8d57ff738e5c46b87d96accf6 into f0426ecb74c442809402b6bd7fbc5574(size=140.4 K), total size for store is 140.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 05:01:13,732 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:01:13,732 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6., storeName=e09a29d8d57ff738e5c46b87d96accf6/info, priority=13, startTime=1691730073700; duration=0sec 2023-08-11 05:01:13,732 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:01:23,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:01:23,744 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e09a29d8d57ff738e5c46b87d96accf6 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-11 05:01:23,756 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e09a29d8d57ff738e5c46b87d96accf6, server=jenkins-hbase4.apache.org,42289,1691729979868 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 05:01:23,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] ipc.CallRunner(144): callId: 248 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:41944 deadline: 1691730093756, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e09a29d8d57ff738e5c46b87d96accf6, server=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:01:23,757 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=272 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/1bae17c057094dd0a44cb448cd4ba56c 2023-08-11 05:01:23,763 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/1bae17c057094dd0a44cb448cd4ba56c as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/1bae17c057094dd0a44cb448cd4ba56c 2023-08-11 05:01:23,768 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/1bae17c057094dd0a44cb448cd4ba56c, entries=22, sequenceid=272, filesize=27.4 K 2023-08-11 05:01:23,769 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=7.18 KB/7357 for e09a29d8d57ff738e5c46b87d96accf6 in 25ms, sequenceid=272, compaction requested=false 2023-08-11 05:01:23,769 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:01:33,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:01:33,821 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e09a29d8d57ff738e5c46b87d96accf6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 05:01:33,833 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=283 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/076d0fa54c3244258b08d62370f189d2 2023-08-11 05:01:33,840 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/076d0fa54c3244258b08d62370f189d2 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/076d0fa54c3244258b08d62370f189d2 2023-08-11 05:01:33,845 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/076d0fa54c3244258b08d62370f189d2, entries=8, sequenceid=283, filesize=13.0 K 2023-08-11 05:01:33,845 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=0 B/0 for e09a29d8d57ff738e5c46b87d96accf6 in 24ms, sequenceid=283, compaction requested=true 2023-08-11 05:01:33,846 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:01:33,846 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:01:33,846 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 05:01:33,847 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 185103 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 05:01:33,847 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1912): e09a29d8d57ff738e5c46b87d96accf6/info is initiating minor compaction (all files) 2023-08-11 05:01:33,847 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e09a29d8d57ff738e5c46b87d96accf6/info in TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:01:33,847 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/f0426ecb74c442809402b6bd7fbc5574, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/1bae17c057094dd0a44cb448cd4ba56c, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/076d0fa54c3244258b08d62370f189d2] into tmpdir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp, totalSize=180.8 K 2023-08-11 05:01:33,847 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting f0426ecb74c442809402b6bd7fbc5574, keycount=131, bloomtype=ROW, size=140.4 K, encoding=NONE, compression=NONE, seqNum=246, earliestPutTs=1691730013191 2023-08-11 05:01:33,848 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 1bae17c057094dd0a44cb448cd4ba56c, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=272, earliestPutTs=1691730073665 2023-08-11 05:01:33,848 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 076d0fa54c3244258b08d62370f189d2, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=283, earliestPutTs=1691730083744 2023-08-11 05:01:33,861 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] throttle.PressureAwareThroughputController(145): e09a29d8d57ff738e5c46b87d96accf6#info#compaction#41 average throughput is 80.69 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 05:01:33,880 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/5d2773236c7945d4ac6d66a3d63da2d7 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/5d2773236c7945d4ac6d66a3d63da2d7 2023-08-11 05:01:33,886 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e09a29d8d57ff738e5c46b87d96accf6/info of e09a29d8d57ff738e5c46b87d96accf6 into 5d2773236c7945d4ac6d66a3d63da2d7(size=171.4 K), total size for store is 171.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 05:01:33,886 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:01:33,886 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6., storeName=e09a29d8d57ff738e5c46b87d96accf6/info, priority=13, startTime=1691730093846; duration=0sec 2023-08-11 05:01:33,886 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:01:35,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:01:35,830 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e09a29d8d57ff738e5c46b87d96accf6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 05:01:35,844 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=295 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/ac66867f600547289dff1ef9a5ea5705 2023-08-11 05:01:35,850 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/ac66867f600547289dff1ef9a5ea5705 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/ac66867f600547289dff1ef9a5ea5705 2023-08-11 05:01:35,855 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e09a29d8d57ff738e5c46b87d96accf6, server=jenkins-hbase4.apache.org,42289,1691729979868 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 05:01:35,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] ipc.CallRunner(144): callId: 280 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:41944 deadline: 1691730105855, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e09a29d8d57ff738e5c46b87d96accf6, server=jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:01:35,858 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/ac66867f600547289dff1ef9a5ea5705, entries=8, sequenceid=295, filesize=13.0 K 2023-08-11 05:01:35,858 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for e09a29d8d57ff738e5c46b87d96accf6 in 28ms, sequenceid=295, compaction requested=false 2023-08-11 05:01:35,859 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:01:40,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/2850811ff599440ab8840ec355655f82.f603e6eaa425d7a4972b6fd9a0817fdf->hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/2850811ff599440ab8840ec355655f82-top, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/0698bca404ca44bfb52602e3ced6126b, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/TestLogRolling-testLogRolling=f603e6eaa425d7a4972b6fd9a0817fdf-d98d2e8f86b340d593e036453ee3de93, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/9b80f2957de54a79929d6064914adc7f, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/defbdffdcf6c4335bf990110ec9363f5, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/1796c785faf34f9a9ceb26b4244fbbc2, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/8b13f4050ba648ea9167efa0979d943c, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/cbc1ddd614154352a82b3b696c99b659, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/3ffa12081849477883899b990d3e8a4a, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/dcf821fd321445dea745d5329ad2269c, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/414283b8ade44a4583316f5515d66ee7, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/6e699bd6a0e441e9b53ed600862f439b, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/d95159c4d4e94d52b8a186c5854461b4, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/f0426ecb74c442809402b6bd7fbc5574, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/14e5a66457404658960ebf383e5d740f, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/1bae17c057094dd0a44cb448cd4ba56c, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/076d0fa54c3244258b08d62370f189d2] to archive 2023-08-11 05:01:40,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-08-11 05:01:40,131 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/2850811ff599440ab8840ec355655f82.f603e6eaa425d7a4972b6fd9a0817fdf to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/2850811ff599440ab8840ec355655f82.f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 05:01:40,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/0698bca404ca44bfb52602e3ced6126b to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/0698bca404ca44bfb52602e3ced6126b 2023-08-11 05:01:40,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/TestLogRolling-testLogRolling=f603e6eaa425d7a4972b6fd9a0817fdf-d98d2e8f86b340d593e036453ee3de93 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/TestLogRolling-testLogRolling=f603e6eaa425d7a4972b6fd9a0817fdf-d98d2e8f86b340d593e036453ee3de93 2023-08-11 05:01:40,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/9b80f2957de54a79929d6064914adc7f to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/9b80f2957de54a79929d6064914adc7f 2023-08-11 05:01:40,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/defbdffdcf6c4335bf990110ec9363f5 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/defbdffdcf6c4335bf990110ec9363f5 2023-08-11 05:01:40,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/1796c785faf34f9a9ceb26b4244fbbc2 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/1796c785faf34f9a9ceb26b4244fbbc2 2023-08-11 05:01:40,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/8b13f4050ba648ea9167efa0979d943c to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/8b13f4050ba648ea9167efa0979d943c 2023-08-11 05:01:40,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/cbc1ddd614154352a82b3b696c99b659 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/cbc1ddd614154352a82b3b696c99b659 2023-08-11 05:01:40,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/3ffa12081849477883899b990d3e8a4a to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/3ffa12081849477883899b990d3e8a4a 2023-08-11 05:01:40,142 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/dcf821fd321445dea745d5329ad2269c to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/dcf821fd321445dea745d5329ad2269c 2023-08-11 05:01:40,143 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/414283b8ade44a4583316f5515d66ee7 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/414283b8ade44a4583316f5515d66ee7 2023-08-11 05:01:40,144 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/6e699bd6a0e441e9b53ed600862f439b to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/6e699bd6a0e441e9b53ed600862f439b 2023-08-11 05:01:40,145 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/d95159c4d4e94d52b8a186c5854461b4 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/d95159c4d4e94d52b8a186c5854461b4 2023-08-11 05:01:40,147 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/f0426ecb74c442809402b6bd7fbc5574 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/f0426ecb74c442809402b6bd7fbc5574 2023-08-11 05:01:40,148 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/14e5a66457404658960ebf383e5d740f to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/14e5a66457404658960ebf383e5d740f 2023-08-11 05:01:40,149 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/1bae17c057094dd0a44cb448cd4ba56c to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/1bae17c057094dd0a44cb448cd4ba56c 2023-08-11 05:01:40,150 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/076d0fa54c3244258b08d62370f189d2 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/076d0fa54c3244258b08d62370f189d2 2023-08-11 05:01:40,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/2fdf6bb919aae0f8be272293db33ea6c/info/2850811ff599440ab8840ec355655f82.f603e6eaa425d7a4972b6fd9a0817fdf->hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/f603e6eaa425d7a4972b6fd9a0817fdf/info/2850811ff599440ab8840ec355655f82-bottom] to archive 2023-08-11 05:01:40,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-08-11 05:01:40,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/2fdf6bb919aae0f8be272293db33ea6c/info/2850811ff599440ab8840ec355655f82.f603e6eaa425d7a4972b6fd9a0817fdf to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/2fdf6bb919aae0f8be272293db33ea6c/info/2850811ff599440ab8840ec355655f82.f603e6eaa425d7a4972b6fd9a0817fdf 2023-08-11 05:01:45,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42289] regionserver.HRegion(9158): Flush requested on e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:01:45,886 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e09a29d8d57ff738e5c46b87d96accf6 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-11 05:01:45,896 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=320 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/3000f04dc420431ab22e3b897f567b74 2023-08-11 05:01:45,903 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/3000f04dc420431ab22e3b897f567b74 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/3000f04dc420431ab22e3b897f567b74 2023-08-11 05:01:45,909 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/3000f04dc420431ab22e3b897f567b74, entries=22, sequenceid=320, filesize=27.4 K 2023-08-11 05:01:45,910 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=2.05 KB/2102 for e09a29d8d57ff738e5c46b87d96accf6 in 24ms, sequenceid=320, compaction requested=true 2023-08-11 05:01:45,910 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:01:45,910 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:01:45,910 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 05:01:45,911 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 216833 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 05:01:45,911 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1912): e09a29d8d57ff738e5c46b87d96accf6/info is initiating minor compaction (all files) 2023-08-11 05:01:45,912 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e09a29d8d57ff738e5c46b87d96accf6/info in TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:01:45,912 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/5d2773236c7945d4ac6d66a3d63da2d7, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/ac66867f600547289dff1ef9a5ea5705, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/3000f04dc420431ab22e3b897f567b74] into tmpdir=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp, totalSize=211.8 K 2023-08-11 05:01:45,912 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 5d2773236c7945d4ac6d66a3d63da2d7, keycount=161, bloomtype=ROW, size=171.4 K, encoding=NONE, compression=NONE, seqNum=283, earliestPutTs=1691730013191 2023-08-11 05:01:45,913 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting ac66867f600547289dff1ef9a5ea5705, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=295, earliestPutTs=1691730095822 2023-08-11 05:01:45,913 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] compactions.Compactor(207): Compacting 3000f04dc420431ab22e3b897f567b74, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=320, earliestPutTs=1691730095831 2023-08-11 05:01:45,928 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] throttle.PressureAwareThroughputController(145): e09a29d8d57ff738e5c46b87d96accf6#info#compaction#44 average throughput is 63.81 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 05:01:45,943 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/b03b54e5086f45d39fec27761a3913ed as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/b03b54e5086f45d39fec27761a3913ed 2023-08-11 05:01:45,948 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e09a29d8d57ff738e5c46b87d96accf6/info of e09a29d8d57ff738e5c46b87d96accf6 into b03b54e5086f45d39fec27761a3913ed(size=201.8 K), total size for store is 201.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 05:01:45,948 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:01:45,948 INFO [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6., storeName=e09a29d8d57ff738e5c46b87d96accf6/info, priority=13, startTime=1691730105910; duration=0sec 2023-08-11 05:01:45,949 DEBUG [RS:0;jenkins-hbase4:42289-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:01:47,889 INFO [Listener at localhost/35889] wal.AbstractTestLogRolling(188): after writing there are 0 log files 2023-08-11 05:01:47,906 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35351,DS-9c546271-899e-4373-bb37-456d570f5e73,DISK] 2023-08-11 05:01:47,907 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44881,DS-d6014163-e773-4315-91b4-f7629aeaecf5,DISK] 2023-08-11 05:01:47,909 INFO [Listener at localhost/35889] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/WALs/jenkins-hbase4.apache.org,42289,1691729979868/jenkins-hbase4.apache.org%2C42289%2C1691729979868.1691729980237 with entries=309, filesize=300.61 KB; new WAL /user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/WALs/jenkins-hbase4.apache.org,42289,1691729979868/jenkins-hbase4.apache.org%2C42289%2C1691729979868.1691730107889 2023-08-11 05:01:47,910 DEBUG [Listener at localhost/35889] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35351,DS-9c546271-899e-4373-bb37-456d570f5e73,DISK], DatanodeInfoWithStorage[127.0.0.1:44881,DS-d6014163-e773-4315-91b4-f7629aeaecf5,DISK]] 2023-08-11 05:01:47,910 DEBUG [Listener at localhost/35889] wal.AbstractFSWAL(716): hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/WALs/jenkins-hbase4.apache.org,42289,1691729979868/jenkins-hbase4.apache.org%2C42289%2C1691729979868.1691729980237 is not closed yet, will try archiving it next time 2023-08-11 05:01:47,915 INFO [Listener at localhost/35889] regionserver.HRegion(2745): Flushing 0c19a1dc4dcb44f30f66bd3f65132a2f 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-11 05:01:47,925 INFO [Listener at localhost/35889] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/namespace/0c19a1dc4dcb44f30f66bd3f65132a2f/.tmp/info/a3cf9ff7fb7f40beab46c0254f2839af 2023-08-11 05:01:47,931 DEBUG [Listener at localhost/35889] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/namespace/0c19a1dc4dcb44f30f66bd3f65132a2f/.tmp/info/a3cf9ff7fb7f40beab46c0254f2839af as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/namespace/0c19a1dc4dcb44f30f66bd3f65132a2f/info/a3cf9ff7fb7f40beab46c0254f2839af 2023-08-11 05:01:47,936 INFO [Listener at localhost/35889] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/namespace/0c19a1dc4dcb44f30f66bd3f65132a2f/info/a3cf9ff7fb7f40beab46c0254f2839af, entries=2, sequenceid=6, filesize=4.8 K 2023-08-11 05:01:47,936 INFO [Listener at localhost/35889] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 0c19a1dc4dcb44f30f66bd3f65132a2f in 21ms, sequenceid=6, compaction requested=false 2023-08-11 05:01:47,937 DEBUG [Listener at localhost/35889] regionserver.HRegion(2446): Flush status journal for 0c19a1dc4dcb44f30f66bd3f65132a2f: 2023-08-11 05:01:47,937 INFO [Listener at localhost/35889] regionserver.HRegion(2745): Flushing e09a29d8d57ff738e5c46b87d96accf6 1/1 column families, dataSize=2.05 KB heapSize=2.45 KB 2023-08-11 05:01:47,950 INFO [Listener at localhost/35889] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.05 KB at sequenceid=326 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/0ab93a1f6f8b4c539f21418d0220bf40 2023-08-11 05:01:47,955 DEBUG [Listener at localhost/35889] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/.tmp/info/0ab93a1f6f8b4c539f21418d0220bf40 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/0ab93a1f6f8b4c539f21418d0220bf40 2023-08-11 05:01:47,960 INFO [Listener at localhost/35889] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/0ab93a1f6f8b4c539f21418d0220bf40, entries=2, sequenceid=326, filesize=6.8 K 2023-08-11 05:01:47,960 INFO [Listener at localhost/35889] regionserver.HRegion(2948): Finished flush of dataSize ~2.05 KB/2102, heapSize ~2.44 KB/2496, currentSize=0 B/0 for e09a29d8d57ff738e5c46b87d96accf6 in 23ms, sequenceid=326, compaction requested=false 2023-08-11 05:01:47,960 DEBUG [Listener at localhost/35889] regionserver.HRegion(2446): Flush status journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:01:47,961 INFO [Listener at localhost/35889] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.26 KB heapSize=4.19 KB 2023-08-11 05:01:47,970 INFO [Listener at localhost/35889] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.26 KB at sequenceid=24 (bloomFilter=false), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/.tmp/info/bc970f0d4f8a4e65932e156868a53906 2023-08-11 05:01:47,976 DEBUG [Listener at localhost/35889] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/.tmp/info/bc970f0d4f8a4e65932e156868a53906 as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/info/bc970f0d4f8a4e65932e156868a53906 2023-08-11 05:01:47,981 INFO [Listener at localhost/35889] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/info/bc970f0d4f8a4e65932e156868a53906, entries=16, sequenceid=24, filesize=7.0 K 2023-08-11 05:01:47,982 INFO [Listener at localhost/35889] regionserver.HRegion(2948): Finished flush of dataSize ~2.26 KB/2312, heapSize ~3.67 KB/3760, currentSize=0 B/0 for 1588230740 in 21ms, sequenceid=24, compaction requested=false 2023-08-11 05:01:47,982 DEBUG [Listener at localhost/35889] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-08-11 05:01:47,982 DEBUG [Listener at localhost/35889] regionserver.HRegion(2446): Flush status journal for 2fdf6bb919aae0f8be272293db33ea6c: 2023-08-11 05:01:47,997 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35351,DS-9c546271-899e-4373-bb37-456d570f5e73,DISK] 2023-08-11 05:01:47,997 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44881,DS-d6014163-e773-4315-91b4-f7629aeaecf5,DISK] 2023-08-11 05:01:47,999 INFO [Listener at localhost/35889] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/WALs/jenkins-hbase4.apache.org,42289,1691729979868/jenkins-hbase4.apache.org%2C42289%2C1691729979868.1691730107889 with entries=4, filesize=1.22 KB; new WAL /user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/WALs/jenkins-hbase4.apache.org,42289,1691729979868/jenkins-hbase4.apache.org%2C42289%2C1691729979868.1691730107982 2023-08-11 05:01:47,999 DEBUG [Listener at localhost/35889] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35351,DS-9c546271-899e-4373-bb37-456d570f5e73,DISK], DatanodeInfoWithStorage[127.0.0.1:44881,DS-d6014163-e773-4315-91b4-f7629aeaecf5,DISK]] 2023-08-11 05:01:47,999 DEBUG [Listener at localhost/35889] wal.AbstractFSWAL(716): hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/WALs/jenkins-hbase4.apache.org,42289,1691729979868/jenkins-hbase4.apache.org%2C42289%2C1691729979868.1691730107889 is not closed yet, will try archiving it next time 2023-08-11 05:01:48,000 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/WALs/jenkins-hbase4.apache.org,42289,1691729979868/jenkins-hbase4.apache.org%2C42289%2C1691729979868.1691729980237 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/oldWALs/jenkins-hbase4.apache.org%2C42289%2C1691729979868.1691729980237 2023-08-11 05:01:48,000 INFO [Listener at localhost/35889] hbase.Waiter(180): Waiting up to [5,000] milli-secs(wait.for.ratio=[1]) 2023-08-11 05:01:48,002 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/WALs/jenkins-hbase4.apache.org,42289,1691729979868/jenkins-hbase4.apache.org%2C42289%2C1691729979868.1691730107889 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/oldWALs/jenkins-hbase4.apache.org%2C42289%2C1691729979868.1691730107889 2023-08-11 05:01:48,101 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-11 05:01:48,101 INFO [Listener at localhost/35889] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-11 05:01:48,101 DEBUG [Listener at localhost/35889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d9f0bec to 127.0.0.1:59265 2023-08-11 05:01:48,101 DEBUG [Listener at localhost/35889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:01:48,101 DEBUG [Listener at localhost/35889] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-11 05:01:48,101 DEBUG [Listener at localhost/35889] util.JVMClusterUtil(257): Found active master hash=1867044800, stopped=false 2023-08-11 05:01:48,101 INFO [Listener at localhost/35889] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46565,1691729979824 2023-08-11 05:01:48,103 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): regionserver:42289-0x101f2656ca10001, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 05:01:48,103 INFO [Listener at localhost/35889] procedure2.ProcedureExecutor(629): Stopping 2023-08-11 05:01:48,103 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 05:01:48,103 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:01:48,104 DEBUG [Listener at localhost/35889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a9e38c1 to 127.0.0.1:59265 2023-08-11 05:01:48,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42289-0x101f2656ca10001, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:01:48,104 DEBUG [Listener at localhost/35889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:01:48,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:01:48,104 INFO [Listener at localhost/35889] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42289,1691729979868' ***** 2023-08-11 05:01:48,104 INFO [Listener at localhost/35889] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-11 05:01:48,104 INFO [RS:0;jenkins-hbase4:42289] regionserver.HeapMemoryManager(220): Stopping 2023-08-11 05:01:48,104 INFO [RS:0;jenkins-hbase4:42289] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-11 05:01:48,105 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-11 05:01:48,105 INFO [RS:0;jenkins-hbase4:42289] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-11 05:01:48,105 INFO [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(3305): Received CLOSE for 0c19a1dc4dcb44f30f66bd3f65132a2f 2023-08-11 05:01:48,105 INFO [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(3305): Received CLOSE for e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:01:48,105 INFO [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(3305): Received CLOSE for 2fdf6bb919aae0f8be272293db33ea6c 2023-08-11 05:01:48,105 INFO [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:01:48,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0c19a1dc4dcb44f30f66bd3f65132a2f, disabling compactions & flushes 2023-08-11 05:01:48,105 DEBUG [RS:0;jenkins-hbase4:42289] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x497d7cca to 127.0.0.1:59265 2023-08-11 05:01:48,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f. 2023-08-11 05:01:48,105 DEBUG [RS:0;jenkins-hbase4:42289] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:01:48,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f. 2023-08-11 05:01:48,106 INFO [RS:0;jenkins-hbase4:42289] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-11 05:01:48,106 INFO [RS:0;jenkins-hbase4:42289] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-11 05:01:48,106 INFO [RS:0;jenkins-hbase4:42289] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-11 05:01:48,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f. after waiting 0 ms 2023-08-11 05:01:48,106 INFO [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-11 05:01:48,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f. 2023-08-11 05:01:48,106 INFO [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(1474): Waiting on 4 regions to close 2023-08-11 05:01:48,106 DEBUG [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(1478): Online Regions={0c19a1dc4dcb44f30f66bd3f65132a2f=hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f., e09a29d8d57ff738e5c46b87d96accf6=TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6., 1588230740=hbase:meta,,1.1588230740, 2fdf6bb919aae0f8be272293db33ea6c=TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c.} 2023-08-11 05:01:48,107 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 05:01:48,107 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 05:01:48,107 DEBUG [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(1504): Waiting on 0c19a1dc4dcb44f30f66bd3f65132a2f, 1588230740, 2fdf6bb919aae0f8be272293db33ea6c, e09a29d8d57ff738e5c46b87d96accf6 2023-08-11 05:01:48,107 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 05:01:48,107 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 05:01:48,107 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 05:01:48,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/namespace/0c19a1dc4dcb44f30f66bd3f65132a2f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-11 05:01:48,115 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/hbase/meta/1588230740/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-08-11 05:01:48,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f. 2023-08-11 05:01:48,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0c19a1dc4dcb44f30f66bd3f65132a2f: 2023-08-11 05:01:48,116 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-11 05:01:48,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1691729980451.0c19a1dc4dcb44f30f66bd3f65132a2f. 2023-08-11 05:01:48,116 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 05:01:48,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e09a29d8d57ff738e5c46b87d96accf6, disabling compactions & flushes 2023-08-11 05:01:48,116 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 05:01:48,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:01:48,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:01:48,116 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-11 05:01:48,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. after waiting 0 ms 2023-08-11 05:01:48,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:01:48,117 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/5d2773236c7945d4ac6d66a3d63da2d7, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/ac66867f600547289dff1ef9a5ea5705, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/3000f04dc420431ab22e3b897f567b74] to archive 2023-08-11 05:01:48,117 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-11 05:01:48,118 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-11 05:01:48,119 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/5d2773236c7945d4ac6d66a3d63da2d7 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/5d2773236c7945d4ac6d66a3d63da2d7 2023-08-11 05:01:48,121 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/ac66867f600547289dff1ef9a5ea5705 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/ac66867f600547289dff1ef9a5ea5705 2023-08-11 05:01:48,122 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/3000f04dc420431ab22e3b897f567b74 to hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/archive/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/info/3000f04dc420431ab22e3b897f567b74 2023-08-11 05:01:48,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/e09a29d8d57ff738e5c46b87d96accf6/recovered.edits/329.seqid, newMaxSeqId=329, maxSeqId=113 2023-08-11 05:01:48,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:01:48,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e09a29d8d57ff738e5c46b87d96accf6: 2023-08-11 05:01:48,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,row0064,1691730015297.e09a29d8d57ff738e5c46b87d96accf6. 2023-08-11 05:01:48,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2fdf6bb919aae0f8be272293db33ea6c, disabling compactions & flushes 2023-08-11 05:01:48,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c. 2023-08-11 05:01:48,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c. 2023-08-11 05:01:48,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c. after waiting 0 ms 2023-08-11 05:01:48,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c. 2023-08-11 05:01:48,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/data/default/TestLogRolling-testLogRolling/2fdf6bb919aae0f8be272293db33ea6c/recovered.edits/118.seqid, newMaxSeqId=118, maxSeqId=113 2023-08-11 05:01:48,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c. 2023-08-11 05:01:48,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2fdf6bb919aae0f8be272293db33ea6c: 2023-08-11 05:01:48,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,,1691730015297.2fdf6bb919aae0f8be272293db33ea6c. 2023-08-11 05:01:48,183 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-08-11 05:01:48,184 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-08-11 05:01:48,307 INFO [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42289,1691729979868; all regions closed. 2023-08-11 05:01:48,313 DEBUG [RS:0;jenkins-hbase4:42289] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/oldWALs 2023-08-11 05:01:48,313 INFO [RS:0;jenkins-hbase4:42289] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42289%2C1691729979868.meta:.meta(num 1691729980391) 2023-08-11 05:01:48,317 DEBUG [RS:0;jenkins-hbase4:42289] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/oldWALs 2023-08-11 05:01:48,317 INFO [RS:0;jenkins-hbase4:42289] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42289%2C1691729979868:(num 1691730107982) 2023-08-11 05:01:48,317 DEBUG [RS:0;jenkins-hbase4:42289] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:01:48,317 INFO [RS:0;jenkins-hbase4:42289] regionserver.LeaseManager(133): Closed leases 2023-08-11 05:01:48,317 INFO [RS:0;jenkins-hbase4:42289] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-08-11 05:01:48,317 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 05:01:48,318 INFO [RS:0;jenkins-hbase4:42289] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42289 2023-08-11 05:01:48,321 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): regionserver:42289-0x101f2656ca10001, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42289,1691729979868 2023-08-11 05:01:48,321 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): regionserver:42289-0x101f2656ca10001, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 05:01:48,321 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 05:01:48,323 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42289,1691729979868] 2023-08-11 05:01:48,323 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42289,1691729979868; numProcessing=1 2023-08-11 05:01:48,326 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42289,1691729979868 already deleted, retry=false 2023-08-11 05:01:48,326 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42289,1691729979868 expired; onlineServers=0 2023-08-11 05:01:48,326 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46565,1691729979824' ***** 2023-08-11 05:01:48,326 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-11 05:01:48,326 DEBUG [M:0;jenkins-hbase4:46565] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b774ef1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 05:01:48,326 INFO [M:0;jenkins-hbase4:46565] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46565,1691729979824 2023-08-11 05:01:48,326 INFO [M:0;jenkins-hbase4:46565] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46565,1691729979824; all regions closed. 2023-08-11 05:01:48,326 DEBUG [M:0;jenkins-hbase4:46565] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:01:48,326 DEBUG [M:0;jenkins-hbase4:46565] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-11 05:01:48,326 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-11 05:01:48,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691729980031] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691729980031,5,FailOnTimeoutGroup] 2023-08-11 05:01:48,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691729980031] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691729980031,5,FailOnTimeoutGroup] 2023-08-11 05:01:48,326 DEBUG [M:0;jenkins-hbase4:46565] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-11 05:01:48,327 INFO [M:0;jenkins-hbase4:46565] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-11 05:01:48,327 INFO [M:0;jenkins-hbase4:46565] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-11 05:01:48,327 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-11 05:01:48,327 INFO [M:0;jenkins-hbase4:46565] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-11 05:01:48,328 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:01:48,328 DEBUG [M:0;jenkins-hbase4:46565] master.HMaster(1512): Stopping service threads 2023-08-11 05:01:48,328 INFO [M:0;jenkins-hbase4:46565] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-11 05:01:48,328 ERROR [M:0;jenkins-hbase4:46565] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-08-11 05:01:48,328 INFO [M:0;jenkins-hbase4:46565] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-11 05:01:48,328 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-11 05:01:48,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 05:01:48,328 DEBUG [M:0;jenkins-hbase4:46565] zookeeper.ZKUtil(398): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-11 05:01:48,328 WARN [M:0;jenkins-hbase4:46565] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-11 05:01:48,328 INFO [M:0;jenkins-hbase4:46565] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-11 05:01:48,329 INFO [M:0;jenkins-hbase4:46565] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-11 05:01:48,329 DEBUG [M:0;jenkins-hbase4:46565] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 05:01:48,329 INFO [M:0;jenkins-hbase4:46565] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:01:48,329 DEBUG [M:0;jenkins-hbase4:46565] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:01:48,329 DEBUG [M:0;jenkins-hbase4:46565] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 05:01:48,329 DEBUG [M:0;jenkins-hbase4:46565] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:01:48,329 INFO [M:0;jenkins-hbase4:46565] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=64.71 KB heapSize=78.42 KB 2023-08-11 05:01:48,340 INFO [M:0;jenkins-hbase4:46565] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=64.71 KB at sequenceid=160 (bloomFilter=true), to=hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f02ac077108d4822bfc52d6e39adc35f 2023-08-11 05:01:48,344 INFO [M:0;jenkins-hbase4:46565] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f02ac077108d4822bfc52d6e39adc35f 2023-08-11 05:01:48,345 DEBUG [M:0;jenkins-hbase4:46565] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f02ac077108d4822bfc52d6e39adc35f as hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f02ac077108d4822bfc52d6e39adc35f 2023-08-11 05:01:48,349 INFO [M:0;jenkins-hbase4:46565] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f02ac077108d4822bfc52d6e39adc35f 2023-08-11 05:01:48,349 INFO [M:0;jenkins-hbase4:46565] regionserver.HStore(1080): Added hdfs://localhost:35167/user/jenkins/test-data/dac04312-7c05-188b-050a-b9f993821935/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f02ac077108d4822bfc52d6e39adc35f, entries=18, sequenceid=160, filesize=6.9 K 2023-08-11 05:01:48,350 INFO [M:0;jenkins-hbase4:46565] regionserver.HRegion(2948): Finished flush of dataSize ~64.71 KB/66268, heapSize ~78.41 KB/80288, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=160, compaction requested=false 2023-08-11 05:01:48,351 INFO [M:0;jenkins-hbase4:46565] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:01:48,351 DEBUG [M:0;jenkins-hbase4:46565] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 05:01:48,354 INFO [M:0;jenkins-hbase4:46565] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-11 05:01:48,354 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 05:01:48,354 INFO [M:0;jenkins-hbase4:46565] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46565 2023-08-11 05:01:48,356 DEBUG [M:0;jenkins-hbase4:46565] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46565,1691729979824 already deleted, retry=false 2023-08-11 05:01:48,423 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): regionserver:42289-0x101f2656ca10001, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:01:48,423 INFO [RS:0;jenkins-hbase4:42289] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42289,1691729979868; zookeeper connection closed. 2023-08-11 05:01:48,423 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): regionserver:42289-0x101f2656ca10001, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:01:48,424 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@135502f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@135502f 2023-08-11 05:01:48,424 INFO [Listener at localhost/35889] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-11 05:01:48,523 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:01:48,523 INFO [M:0;jenkins-hbase4:46565] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46565,1691729979824; zookeeper connection closed. 2023-08-11 05:01:48,523 DEBUG [Listener at localhost/35889-EventThread] zookeeper.ZKWatcher(600): master:46565-0x101f2656ca10000, quorum=127.0.0.1:59265, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:01:48,524 WARN [Listener at localhost/35889] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 05:01:48,528 INFO [Listener at localhost/35889] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:01:48,634 WARN [BP-423063888-172.31.14.131-1691729979227 heartbeating to localhost/127.0.0.1:35167] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 05:01:48,634 WARN [BP-423063888-172.31.14.131-1691729979227 heartbeating to localhost/127.0.0.1:35167] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-423063888-172.31.14.131-1691729979227 (Datanode Uuid 79487b76-b43e-4255-8722-5cf2b79d818b) service to localhost/127.0.0.1:35167 2023-08-11 05:01:48,634 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/cluster_b7ba7f60-a909-7143-c633-bbf530f8bdf6/dfs/data/data3/current/BP-423063888-172.31.14.131-1691729979227] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:01:48,635 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/cluster_b7ba7f60-a909-7143-c633-bbf530f8bdf6/dfs/data/data4/current/BP-423063888-172.31.14.131-1691729979227] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:01:48,636 WARN [Listener at localhost/35889] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 05:01:48,639 INFO [Listener at localhost/35889] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:01:48,672 WARN [BP-423063888-172.31.14.131-1691729979227 heartbeating to localhost/127.0.0.1:35167] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-423063888-172.31.14.131-1691729979227 (Datanode Uuid 79614b21-abb9-4e98-87ab-c0356c6fe860) service to localhost/127.0.0.1:35167 2023-08-11 05:01:48,673 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/cluster_b7ba7f60-a909-7143-c633-bbf530f8bdf6/dfs/data/data1/current/BP-423063888-172.31.14.131-1691729979227] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:01:48,673 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/cluster_b7ba7f60-a909-7143-c633-bbf530f8bdf6/dfs/data/data2/current/BP-423063888-172.31.14.131-1691729979227] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:01:48,756 INFO [Listener at localhost/35889] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:01:48,872 INFO [Listener at localhost/35889] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-11 05:01:48,905 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-11 05:01:48,915 INFO [Listener at localhost/35889] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=75 (was 64) - Thread LEAK? -, OpenFileDescriptor=469 (was 436) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=112 (was 94) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=2624 (was 2972) 2023-08-11 05:01:48,923 INFO [Listener at localhost/35889] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=76, OpenFileDescriptor=469, MaxFileDescriptor=60000, SystemLoadAverage=112, ProcessCount=171, AvailableMemoryMB=2623 2023-08-11 05:01:48,923 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-11 05:01:48,923 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/hadoop.log.dir so I do NOT create it in target/test-data/9854e6c8-e230-6245-ff03-982417f27e82 2023-08-11 05:01:48,923 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f375e6df-aa47-c80f-4709-c147b7a67726/hadoop.tmp.dir so I do NOT create it in target/test-data/9854e6c8-e230-6245-ff03-982417f27e82 2023-08-11 05:01:48,923 INFO [Listener at localhost/35889] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/cluster_4cfe48b6-c531-0fbd-fbae-52d8da43b8f1, deleteOnExit=true 2023-08-11 05:01:48,923 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-11 05:01:48,924 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/test.cache.data in system properties and HBase conf 2023-08-11 05:01:48,924 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/hadoop.tmp.dir in system properties and HBase conf 2023-08-11 05:01:48,924 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/hadoop.log.dir in system properties and HBase conf 2023-08-11 05:01:48,924 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-11 05:01:48,924 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-11 05:01:48,924 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-11 05:01:48,924 DEBUG [Listener at localhost/35889] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-11 05:01:48,924 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-11 05:01:48,924 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-11 05:01:48,925 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-11 05:01:48,925 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 05:01:48,925 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-11 05:01:48,925 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-11 05:01:48,925 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 05:01:48,925 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 05:01:48,925 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-11 05:01:48,925 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/nfs.dump.dir in system properties and HBase conf 2023-08-11 05:01:48,925 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/java.io.tmpdir in system properties and HBase conf 2023-08-11 05:01:48,925 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 05:01:48,925 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-11 05:01:48,926 INFO [Listener at localhost/35889] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-11 05:01:48,931 WARN [Listener at localhost/35889] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 05:01:48,932 WARN [Listener at localhost/35889] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 05:01:48,971 WARN [Listener at localhost/35889] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:01:48,973 INFO [Listener at localhost/35889] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:01:48,977 INFO [Listener at localhost/35889] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/java.io.tmpdir/Jetty_localhost_43361_hdfs____.gk1ypz/webapp 2023-08-11 05:01:49,070 INFO [Listener at localhost/35889] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43361 2023-08-11 05:01:49,075 WARN [Listener at localhost/35889] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 05:01:49,076 WARN [Listener at localhost/35889] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 05:01:49,122 WARN [Listener at localhost/35443] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:01:49,132 WARN [Listener at localhost/35443] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 05:01:49,134 WARN [Listener at localhost/35443] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:01:49,136 INFO [Listener at localhost/35443] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:01:49,142 INFO [Listener at localhost/35443] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/java.io.tmpdir/Jetty_localhost_33269_datanode____.7ihldw/webapp 2023-08-11 05:01:49,237 INFO [Listener at localhost/35443] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33269 2023-08-11 05:01:49,243 WARN [Listener at localhost/45923] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:01:49,255 WARN [Listener at localhost/45923] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 05:01:49,258 WARN [Listener at localhost/45923] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:01:49,259 INFO [Listener at localhost/45923] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:01:49,263 INFO [Listener at localhost/45923] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/java.io.tmpdir/Jetty_localhost_44257_datanode____ohn6bf/webapp 2023-08-11 05:01:49,380 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd25546c5324e1e2e: Processing first storage report for DS-e7ae7d72-0498-43bf-a5d7-c2cc903b7339 from datanode f919fc0e-c3cd-4990-9cb2-6a4316eae383 2023-08-11 05:01:49,380 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd25546c5324e1e2e: from storage DS-e7ae7d72-0498-43bf-a5d7-c2cc903b7339 node DatanodeRegistration(127.0.0.1:39327, datanodeUuid=f919fc0e-c3cd-4990-9cb2-6a4316eae383, infoPort=36237, infoSecurePort=0, ipcPort=45923, storageInfo=lv=-57;cid=testClusterID;nsid=2092813763;c=1691730108934), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:01:49,380 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd25546c5324e1e2e: Processing first storage report for DS-4ffb73c8-1cc0-4ca4-8373-ab45303e9aee from datanode f919fc0e-c3cd-4990-9cb2-6a4316eae383 2023-08-11 05:01:49,380 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd25546c5324e1e2e: from storage DS-4ffb73c8-1cc0-4ca4-8373-ab45303e9aee node DatanodeRegistration(127.0.0.1:39327, datanodeUuid=f919fc0e-c3cd-4990-9cb2-6a4316eae383, infoPort=36237, infoSecurePort=0, ipcPort=45923, storageInfo=lv=-57;cid=testClusterID;nsid=2092813763;c=1691730108934), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:01:49,406 INFO [Listener at localhost/45923] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44257 2023-08-11 05:01:49,413 WARN [Listener at localhost/41321] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:01:49,511 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x63473b9cf6fc4bc5: Processing first storage report for DS-ba6da311-7c6c-4911-bfac-1834c95a15d1 from datanode ddf2581c-f912-4af7-ba10-507b8cddce6a 2023-08-11 05:01:49,511 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x63473b9cf6fc4bc5: from storage DS-ba6da311-7c6c-4911-bfac-1834c95a15d1 node DatanodeRegistration(127.0.0.1:36179, datanodeUuid=ddf2581c-f912-4af7-ba10-507b8cddce6a, infoPort=35493, infoSecurePort=0, ipcPort=41321, storageInfo=lv=-57;cid=testClusterID;nsid=2092813763;c=1691730108934), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:01:49,511 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x63473b9cf6fc4bc5: Processing first storage report for DS-3ed51118-7583-45c6-9c6b-b96bb3803279 from datanode ddf2581c-f912-4af7-ba10-507b8cddce6a 2023-08-11 05:01:49,511 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x63473b9cf6fc4bc5: from storage DS-3ed51118-7583-45c6-9c6b-b96bb3803279 node DatanodeRegistration(127.0.0.1:36179, datanodeUuid=ddf2581c-f912-4af7-ba10-507b8cddce6a, infoPort=35493, infoSecurePort=0, ipcPort=41321, storageInfo=lv=-57;cid=testClusterID;nsid=2092813763;c=1691730108934), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:01:49,519 DEBUG [Listener at localhost/41321] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82 2023-08-11 05:01:49,521 INFO [Listener at localhost/41321] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/cluster_4cfe48b6-c531-0fbd-fbae-52d8da43b8f1/zookeeper_0, clientPort=58328, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/cluster_4cfe48b6-c531-0fbd-fbae-52d8da43b8f1/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/cluster_4cfe48b6-c531-0fbd-fbae-52d8da43b8f1/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-11 05:01:49,522 INFO [Listener at localhost/41321] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58328 2023-08-11 05:01:49,523 INFO [Listener at localhost/41321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:01:49,523 INFO [Listener at localhost/41321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:01:49,536 INFO [Listener at localhost/41321] util.FSUtils(471): Created version file at hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09 with version=8 2023-08-11 05:01:49,536 INFO [Listener at localhost/41321] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:44477/user/jenkins/test-data/d153cbd6-a5b8-5dd1-33ad-a694400c4256/hbase-staging 2023-08-11 05:01:49,537 INFO [Listener at localhost/41321] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 05:01:49,538 INFO [Listener at localhost/41321] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:01:49,538 INFO [Listener at localhost/41321] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 05:01:49,538 INFO [Listener at localhost/41321] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 05:01:49,538 INFO [Listener at localhost/41321] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:01:49,538 INFO [Listener at localhost/41321] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 05:01:49,538 INFO [Listener at localhost/41321] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 05:01:49,539 INFO [Listener at localhost/41321] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42847 2023-08-11 05:01:49,540 INFO [Listener at localhost/41321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:01:49,540 INFO [Listener at localhost/41321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:01:49,541 INFO [Listener at localhost/41321] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42847 connecting to ZooKeeper ensemble=127.0.0.1:58328 2023-08-11 05:01:49,548 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:428470x0, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 05:01:49,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42847-0x101f26767540000 connected 2023-08-11 05:01:49,563 DEBUG [Listener at localhost/41321] zookeeper.ZKUtil(164): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 05:01:49,563 DEBUG [Listener at localhost/41321] zookeeper.ZKUtil(164): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:01:49,563 DEBUG [Listener at localhost/41321] zookeeper.ZKUtil(164): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 05:01:49,564 DEBUG [Listener at localhost/41321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42847 2023-08-11 05:01:49,564 DEBUG [Listener at localhost/41321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42847 2023-08-11 05:01:49,564 DEBUG [Listener at localhost/41321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42847 2023-08-11 05:01:49,564 DEBUG [Listener at localhost/41321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42847 2023-08-11 05:01:49,565 DEBUG [Listener at localhost/41321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42847 2023-08-11 05:01:49,565 INFO [Listener at localhost/41321] master.HMaster(444): hbase.rootdir=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09, hbase.cluster.distributed=false 2023-08-11 05:01:49,577 INFO [Listener at localhost/41321] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 05:01:49,577 INFO [Listener at localhost/41321] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:01:49,578 INFO [Listener at localhost/41321] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 05:01:49,578 INFO [Listener at localhost/41321] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 05:01:49,578 INFO [Listener at localhost/41321] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:01:49,578 INFO [Listener at localhost/41321] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 05:01:49,578 INFO [Listener at localhost/41321] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 05:01:49,580 INFO [Listener at localhost/41321] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45335 2023-08-11 05:01:49,580 INFO [Listener at localhost/41321] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-11 05:01:49,581 DEBUG [Listener at localhost/41321] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-11 05:01:49,581 INFO [Listener at localhost/41321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:01:49,582 INFO [Listener at localhost/41321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:01:49,583 INFO [Listener at localhost/41321] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45335 connecting to ZooKeeper ensemble=127.0.0.1:58328 2023-08-11 05:01:49,586 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): regionserver:453350x0, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 05:01:49,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45335-0x101f26767540001 connected 2023-08-11 05:01:49,587 DEBUG [Listener at localhost/41321] zookeeper.ZKUtil(164): regionserver:45335-0x101f26767540001, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 05:01:49,588 DEBUG [Listener at localhost/41321] zookeeper.ZKUtil(164): regionserver:45335-0x101f26767540001, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:01:49,588 DEBUG [Listener at localhost/41321] zookeeper.ZKUtil(164): regionserver:45335-0x101f26767540001, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 05:01:49,589 DEBUG [Listener at localhost/41321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45335 2023-08-11 05:01:49,589 DEBUG [Listener at localhost/41321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45335 2023-08-11 05:01:49,589 DEBUG [Listener at localhost/41321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45335 2023-08-11 05:01:49,589 DEBUG [Listener at localhost/41321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45335 2023-08-11 05:01:49,590 DEBUG [Listener at localhost/41321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45335 2023-08-11 05:01:49,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42847,1691730109537 2023-08-11 05:01:49,593 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 05:01:49,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42847,1691730109537 2023-08-11 05:01:49,595 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): regionserver:45335-0x101f26767540001, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 05:01:49,595 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 05:01:49,595 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:01:49,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 05:01:49,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42847,1691730109537 from backup master directory 2023-08-11 05:01:49,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 05:01:49,597 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42847,1691730109537 2023-08-11 05:01:49,597 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 05:01:49,597 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 05:01:49,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42847,1691730109537 2023-08-11 05:01:49,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/hbase.id with ID: 1ac07bc7-80d6-43ee-87fb-2d3444eab380 2023-08-11 05:01:49,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:01:49,624 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:01:49,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3ed9e193 to 127.0.0.1:58328 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 05:01:49,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47c925e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 05:01:49,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-11 05:01:49,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-11 05:01:49,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 05:01:49,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/MasterData/data/master/store-tmp 2023-08-11 05:01:49,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:01:49,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 05:01:49,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:01:49,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:01:49,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 05:01:49,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:01:49,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:01:49,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 05:01:49,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/MasterData/WALs/jenkins-hbase4.apache.org,42847,1691730109537 2023-08-11 05:01:49,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42847%2C1691730109537, suffix=, logDir=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/MasterData/WALs/jenkins-hbase4.apache.org,42847,1691730109537, archiveDir=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/MasterData/oldWALs, maxLogs=10 2023-08-11 05:01:49,663 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36179,DS-ba6da311-7c6c-4911-bfac-1834c95a15d1,DISK] 2023-08-11 05:01:49,663 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39327,DS-e7ae7d72-0498-43bf-a5d7-c2cc903b7339,DISK] 2023-08-11 05:01:49,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/MasterData/WALs/jenkins-hbase4.apache.org,42847,1691730109537/jenkins-hbase4.apache.org%2C42847%2C1691730109537.1691730109649 2023-08-11 05:01:49,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36179,DS-ba6da311-7c6c-4911-bfac-1834c95a15d1,DISK], DatanodeInfoWithStorage[127.0.0.1:39327,DS-e7ae7d72-0498-43bf-a5d7-c2cc903b7339,DISK]] 2023-08-11 05:01:49,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-11 05:01:49,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:01:49,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:01:49,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:01:49,669 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:01:49,670 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-11 05:01:49,670 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-11 05:01:49,671 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:01:49,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:01:49,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:01:49,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:01:49,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 05:01:49,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=849501, jitterRate=0.08019724488258362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 05:01:49,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 05:01:49,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-11 05:01:49,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-11 05:01:49,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-11 05:01:49,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-11 05:01:49,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-11 05:01:49,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-11 05:01:49,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-11 05:01:49,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-11 05:01:49,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-11 05:01:49,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-11 05:01:49,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-11 05:01:49,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-11 05:01:49,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-11 05:01:49,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-11 05:01:49,693 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:01:49,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-11 05:01:49,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-11 05:01:49,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-11 05:01:49,696 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): regionserver:45335-0x101f26767540001, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 05:01:49,696 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 05:01:49,696 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:01:49,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42847,1691730109537, sessionid=0x101f26767540000, setting cluster-up flag (Was=false) 2023-08-11 05:01:49,700 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:01:49,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-11 05:01:49,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42847,1691730109537 2023-08-11 05:01:49,708 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:01:49,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-11 05:01:49,713 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42847,1691730109537 2023-08-11 05:01:49,713 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/.hbase-snapshot/.tmp 2023-08-11 05:01:49,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-11 05:01:49,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:01:49,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:01:49,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:01:49,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:01:49,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-11 05:01:49,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:01:49,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 05:01:49,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:01:49,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1691730139716 2023-08-11 05:01:49,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-11 05:01:49,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-11 05:01:49,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-11 05:01:49,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-11 05:01:49,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-11 05:01:49,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-11 05:01:49,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 05:01:49,718 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 05:01:49,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-11 05:01:49,718 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-11 05:01:49,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-11 05:01:49,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-11 05:01:49,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-11 05:01:49,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-11 05:01:49,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691730109718,5,FailOnTimeoutGroup] 2023-08-11 05:01:49,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691730109718,5,FailOnTimeoutGroup] 2023-08-11 05:01:49,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 05:01:49,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-11 05:01:49,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-11 05:01:49,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-11 05:01:49,719 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 05:01:49,728 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 05:01:49,729 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 05:01:49,729 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09 2023-08-11 05:01:49,736 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:01:49,737 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 05:01:49,739 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/info 2023-08-11 05:01:49,739 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 05:01:49,740 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:01:49,740 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 05:01:49,741 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/rep_barrier 2023-08-11 05:01:49,741 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 05:01:49,741 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:01:49,741 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 05:01:49,742 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/table 2023-08-11 05:01:49,743 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 05:01:49,743 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:01:49,744 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740 2023-08-11 05:01:49,744 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740 2023-08-11 05:01:49,746 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 05:01:49,747 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 05:01:49,749 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 05:01:49,749 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=748923, jitterRate=-0.04769636690616608}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 05:01:49,749 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 05:01:49,749 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 05:01:49,749 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 05:01:49,750 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 05:01:49,750 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 05:01:49,750 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 05:01:49,750 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 05:01:49,750 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 05:01:49,751 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 05:01:49,751 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-11 05:01:49,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-11 05:01:49,752 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-11 05:01:49,753 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-11 05:01:49,791 INFO [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(951): ClusterId : 1ac07bc7-80d6-43ee-87fb-2d3444eab380 2023-08-11 05:01:49,792 DEBUG [RS:0;jenkins-hbase4:45335] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-11 05:01:49,794 DEBUG [RS:0;jenkins-hbase4:45335] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-11 05:01:49,794 DEBUG [RS:0;jenkins-hbase4:45335] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-11 05:01:49,796 DEBUG [RS:0;jenkins-hbase4:45335] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-11 05:01:49,797 DEBUG [RS:0;jenkins-hbase4:45335] zookeeper.ReadOnlyZKClient(139): Connect 0x75017dc2 to 127.0.0.1:58328 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 05:01:49,800 DEBUG [RS:0;jenkins-hbase4:45335] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bc68d12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 05:01:49,801 DEBUG [RS:0;jenkins-hbase4:45335] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ff916b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 05:01:49,810 DEBUG [RS:0;jenkins-hbase4:45335] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45335 2023-08-11 05:01:49,810 INFO [RS:0;jenkins-hbase4:45335] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-11 05:01:49,810 INFO [RS:0;jenkins-hbase4:45335] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-11 05:01:49,810 DEBUG [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(1022): About to register with Master. 2023-08-11 05:01:49,810 INFO [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42847,1691730109537 with isa=jenkins-hbase4.apache.org/172.31.14.131:45335, startcode=1691730109577 2023-08-11 05:01:49,810 DEBUG [RS:0;jenkins-hbase4:45335] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-11 05:01:49,813 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34613, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-08-11 05:01:49,814 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42847] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45335,1691730109577 2023-08-11 05:01:49,814 DEBUG [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09 2023-08-11 05:01:49,814 DEBUG [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35443 2023-08-11 05:01:49,814 DEBUG [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-11 05:01:49,816 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 05:01:49,816 DEBUG [RS:0;jenkins-hbase4:45335] zookeeper.ZKUtil(162): regionserver:45335-0x101f26767540001, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45335,1691730109577 2023-08-11 05:01:49,817 WARN [RS:0;jenkins-hbase4:45335] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 05:01:49,817 INFO [RS:0;jenkins-hbase4:45335] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 05:01:49,817 DEBUG [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/WALs/jenkins-hbase4.apache.org,45335,1691730109577 2023-08-11 05:01:49,817 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45335,1691730109577] 2023-08-11 05:01:49,820 DEBUG [RS:0;jenkins-hbase4:45335] zookeeper.ZKUtil(162): regionserver:45335-0x101f26767540001, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45335,1691730109577 2023-08-11 05:01:49,821 DEBUG [RS:0;jenkins-hbase4:45335] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-11 05:01:49,821 INFO [RS:0;jenkins-hbase4:45335] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-11 05:01:49,822 INFO [RS:0;jenkins-hbase4:45335] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-11 05:01:49,822 INFO [RS:0;jenkins-hbase4:45335] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-11 05:01:49,822 INFO [RS:0;jenkins-hbase4:45335] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 05:01:49,822 INFO [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-11 05:01:49,823 INFO [RS:0;jenkins-hbase4:45335] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-11 05:01:49,824 DEBUG [RS:0;jenkins-hbase4:45335] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:01:49,824 DEBUG [RS:0;jenkins-hbase4:45335] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:01:49,824 DEBUG [RS:0;jenkins-hbase4:45335] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:01:49,824 DEBUG [RS:0;jenkins-hbase4:45335] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:01:49,824 DEBUG [RS:0;jenkins-hbase4:45335] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:01:49,824 DEBUG [RS:0;jenkins-hbase4:45335] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 05:01:49,824 DEBUG [RS:0;jenkins-hbase4:45335] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:01:49,824 DEBUG [RS:0;jenkins-hbase4:45335] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:01:49,824 DEBUG [RS:0;jenkins-hbase4:45335] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:01:49,824 DEBUG [RS:0;jenkins-hbase4:45335] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:01:49,825 INFO [RS:0;jenkins-hbase4:45335] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 05:01:49,825 INFO [RS:0;jenkins-hbase4:45335] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 05:01:49,825 INFO [RS:0;jenkins-hbase4:45335] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-11 05:01:49,836 INFO [RS:0;jenkins-hbase4:45335] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-11 05:01:49,836 INFO [RS:0;jenkins-hbase4:45335] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45335,1691730109577-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 05:01:49,846 INFO [RS:0;jenkins-hbase4:45335] regionserver.Replication(203): jenkins-hbase4.apache.org,45335,1691730109577 started 2023-08-11 05:01:49,847 INFO [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45335,1691730109577, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45335, sessionid=0x101f26767540001 2023-08-11 05:01:49,847 DEBUG [RS:0;jenkins-hbase4:45335] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-11 05:01:49,847 DEBUG [RS:0;jenkins-hbase4:45335] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45335,1691730109577 2023-08-11 05:01:49,847 DEBUG [RS:0;jenkins-hbase4:45335] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45335,1691730109577' 2023-08-11 05:01:49,847 DEBUG [RS:0;jenkins-hbase4:45335] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 05:01:49,847 DEBUG [RS:0;jenkins-hbase4:45335] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 05:01:49,847 DEBUG [RS:0;jenkins-hbase4:45335] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-11 05:01:49,847 DEBUG [RS:0;jenkins-hbase4:45335] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-11 05:01:49,847 DEBUG [RS:0;jenkins-hbase4:45335] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45335,1691730109577 2023-08-11 05:01:49,847 DEBUG [RS:0;jenkins-hbase4:45335] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45335,1691730109577' 2023-08-11 05:01:49,847 DEBUG [RS:0;jenkins-hbase4:45335] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-11 05:01:49,848 DEBUG [RS:0;jenkins-hbase4:45335] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-11 05:01:49,848 DEBUG [RS:0;jenkins-hbase4:45335] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-11 05:01:49,848 INFO [RS:0;jenkins-hbase4:45335] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-11 05:01:49,848 INFO [RS:0;jenkins-hbase4:45335] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-11 05:01:49,903 DEBUG [jenkins-hbase4:42847] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-11 05:01:49,904 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45335,1691730109577, state=OPENING 2023-08-11 05:01:49,905 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-11 05:01:49,906 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:01:49,907 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 05:01:49,907 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45335,1691730109577}] 2023-08-11 05:01:49,950 INFO [RS:0;jenkins-hbase4:45335] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45335%2C1691730109577, suffix=, logDir=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/WALs/jenkins-hbase4.apache.org,45335,1691730109577, archiveDir=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/oldWALs, maxLogs=32 2023-08-11 05:01:49,966 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36179,DS-ba6da311-7c6c-4911-bfac-1834c95a15d1,DISK] 2023-08-11 05:01:49,966 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39327,DS-e7ae7d72-0498-43bf-a5d7-c2cc903b7339,DISK] 2023-08-11 05:01:49,968 INFO [RS:0;jenkins-hbase4:45335] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/WALs/jenkins-hbase4.apache.org,45335,1691730109577/jenkins-hbase4.apache.org%2C45335%2C1691730109577.1691730109951 2023-08-11 05:01:49,968 DEBUG [RS:0;jenkins-hbase4:45335] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36179,DS-ba6da311-7c6c-4911-bfac-1834c95a15d1,DISK], DatanodeInfoWithStorage[127.0.0.1:39327,DS-e7ae7d72-0498-43bf-a5d7-c2cc903b7339,DISK]] 2023-08-11 05:01:50,060 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45335,1691730109577 2023-08-11 05:01:50,061 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-11 05:01:50,063 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-11 05:01:50,066 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-11 05:01:50,067 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 05:01:50,068 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45335%2C1691730109577.meta, suffix=.meta, logDir=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/WALs/jenkins-hbase4.apache.org,45335,1691730109577, archiveDir=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/oldWALs, maxLogs=32 2023-08-11 05:01:50,083 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36179,DS-ba6da311-7c6c-4911-bfac-1834c95a15d1,DISK] 2023-08-11 05:01:50,084 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39327,DS-e7ae7d72-0498-43bf-a5d7-c2cc903b7339,DISK] 2023-08-11 05:01:50,086 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/WALs/jenkins-hbase4.apache.org,45335,1691730109577/jenkins-hbase4.apache.org%2C45335%2C1691730109577.meta.1691730110069.meta 2023-08-11 05:01:50,086 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36179,DS-ba6da311-7c6c-4911-bfac-1834c95a15d1,DISK], DatanodeInfoWithStorage[127.0.0.1:39327,DS-e7ae7d72-0498-43bf-a5d7-c2cc903b7339,DISK]] 2023-08-11 05:01:50,086 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-11 05:01:50,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-11 05:01:50,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-11 05:01:50,087 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-11 05:01:50,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-11 05:01:50,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:01:50,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-11 05:01:50,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-11 05:01:50,088 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 05:01:50,089 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/info 2023-08-11 05:01:50,089 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/info 2023-08-11 05:01:50,090 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 05:01:50,090 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:01:50,090 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 05:01:50,091 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/rep_barrier 2023-08-11 05:01:50,091 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/rep_barrier 2023-08-11 05:01:50,091 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 05:01:50,092 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:01:50,092 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 05:01:50,093 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/table 2023-08-11 05:01:50,093 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/table 2023-08-11 05:01:50,093 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 05:01:50,093 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:01:50,094 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740 2023-08-11 05:01:50,095 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740 2023-08-11 05:01:50,097 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 05:01:50,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 05:01:50,099 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=871178, jitterRate=0.10776032507419586}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 05:01:50,099 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 05:01:50,100 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1691730110060 2023-08-11 05:01:50,104 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-11 05:01:50,104 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-11 05:01:50,104 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45335,1691730109577, state=OPEN 2023-08-11 05:01:50,106 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-11 05:01:50,106 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 05:01:50,107 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-11 05:01:50,107 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45335,1691730109577 in 199 msec 2023-08-11 05:01:50,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-11 05:01:50,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-08-11 05:01:50,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 395 msec 2023-08-11 05:01:50,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1691730110110, completionTime=-1 2023-08-11 05:01:50,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-11 05:01:50,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-11 05:01:50,113 DEBUG [hconnection-0xe18556e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 05:01:50,114 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 05:01:50,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-11 05:01:50,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1691730170115 2023-08-11 05:01:50,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1691730230115 2023-08-11 05:01:50,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 4 msec 2023-08-11 05:01:50,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42847,1691730109537-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 05:01:50,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42847,1691730109537-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 05:01:50,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42847,1691730109537-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 05:01:50,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42847, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 05:01:50,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-11 05:01:50,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-11 05:01:50,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 05:01:50,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-11 05:01:50,123 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-11 05:01:50,124 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-11 05:01:50,125 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-11 05:01:50,126 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/.tmp/data/hbase/namespace/6bcf3379ff7c928a2403bc7261a18ddc 2023-08-11 05:01:50,127 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/.tmp/data/hbase/namespace/6bcf3379ff7c928a2403bc7261a18ddc empty. 2023-08-11 05:01:50,127 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/.tmp/data/hbase/namespace/6bcf3379ff7c928a2403bc7261a18ddc 2023-08-11 05:01:50,127 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-11 05:01:50,137 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-11 05:01:50,138 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6bcf3379ff7c928a2403bc7261a18ddc, NAME => 'hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/.tmp 2023-08-11 05:01:50,146 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:01:50,146 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 6bcf3379ff7c928a2403bc7261a18ddc, disabling compactions & flushes 2023-08-11 05:01:50,146 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc. 2023-08-11 05:01:50,146 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc. 2023-08-11 05:01:50,146 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc. after waiting 0 ms 2023-08-11 05:01:50,146 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc. 2023-08-11 05:01:50,146 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc. 2023-08-11 05:01:50,146 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 6bcf3379ff7c928a2403bc7261a18ddc: 2023-08-11 05:01:50,148 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-11 05:01:50,149 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691730110149"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691730110149"}]},"ts":"1691730110149"} 2023-08-11 05:01:50,151 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-11 05:01:50,152 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-11 05:01:50,152 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691730110152"}]},"ts":"1691730110152"} 2023-08-11 05:01:50,153 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-11 05:01:50,159 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6bcf3379ff7c928a2403bc7261a18ddc, ASSIGN}] 2023-08-11 05:01:50,161 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6bcf3379ff7c928a2403bc7261a18ddc, ASSIGN 2023-08-11 05:01:50,162 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6bcf3379ff7c928a2403bc7261a18ddc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45335,1691730109577; forceNewPlan=false, retain=false 2023-08-11 05:01:50,313 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6bcf3379ff7c928a2403bc7261a18ddc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45335,1691730109577 2023-08-11 05:01:50,313 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691730110313"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691730110313"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691730110313"}]},"ts":"1691730110313"} 2023-08-11 05:01:50,314 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6bcf3379ff7c928a2403bc7261a18ddc, server=jenkins-hbase4.apache.org,45335,1691730109577}] 2023-08-11 05:01:50,470 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc. 2023-08-11 05:01:50,470 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6bcf3379ff7c928a2403bc7261a18ddc, NAME => 'hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc.', STARTKEY => '', ENDKEY => ''} 2023-08-11 05:01:50,470 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6bcf3379ff7c928a2403bc7261a18ddc 2023-08-11 05:01:50,470 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:01:50,470 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6bcf3379ff7c928a2403bc7261a18ddc 2023-08-11 05:01:50,470 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6bcf3379ff7c928a2403bc7261a18ddc 2023-08-11 05:01:50,472 INFO [StoreOpener-6bcf3379ff7c928a2403bc7261a18ddc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6bcf3379ff7c928a2403bc7261a18ddc 2023-08-11 05:01:50,473 DEBUG [StoreOpener-6bcf3379ff7c928a2403bc7261a18ddc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/namespace/6bcf3379ff7c928a2403bc7261a18ddc/info 2023-08-11 05:01:50,473 DEBUG [StoreOpener-6bcf3379ff7c928a2403bc7261a18ddc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/namespace/6bcf3379ff7c928a2403bc7261a18ddc/info 2023-08-11 05:01:50,473 INFO [StoreOpener-6bcf3379ff7c928a2403bc7261a18ddc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bcf3379ff7c928a2403bc7261a18ddc columnFamilyName info 2023-08-11 05:01:50,474 INFO [StoreOpener-6bcf3379ff7c928a2403bc7261a18ddc-1] regionserver.HStore(310): Store=6bcf3379ff7c928a2403bc7261a18ddc/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:01:50,475 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/namespace/6bcf3379ff7c928a2403bc7261a18ddc 2023-08-11 05:01:50,475 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/namespace/6bcf3379ff7c928a2403bc7261a18ddc 2023-08-11 05:01:50,478 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6bcf3379ff7c928a2403bc7261a18ddc 2023-08-11 05:01:50,481 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/namespace/6bcf3379ff7c928a2403bc7261a18ddc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 05:01:50,481 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6bcf3379ff7c928a2403bc7261a18ddc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=753882, jitterRate=-0.04138953983783722}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 05:01:50,481 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6bcf3379ff7c928a2403bc7261a18ddc: 2023-08-11 05:01:50,482 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc., pid=6, masterSystemTime=1691730110466 2023-08-11 05:01:50,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc. 2023-08-11 05:01:50,483 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc. 2023-08-11 05:01:50,484 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6bcf3379ff7c928a2403bc7261a18ddc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45335,1691730109577 2023-08-11 05:01:50,484 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691730110484"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691730110484"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691730110484"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691730110484"}]},"ts":"1691730110484"} 2023-08-11 05:01:50,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-11 05:01:50,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6bcf3379ff7c928a2403bc7261a18ddc, server=jenkins-hbase4.apache.org,45335,1691730109577 in 171 msec 2023-08-11 05:01:50,488 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-11 05:01:50,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6bcf3379ff7c928a2403bc7261a18ddc, ASSIGN in 328 msec 2023-08-11 05:01:50,489 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-11 05:01:50,489 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691730110489"}]},"ts":"1691730110489"} 2023-08-11 05:01:50,490 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-11 05:01:50,492 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-11 05:01:50,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 370 msec 2023-08-11 05:01:50,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-11 05:01:50,526 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-11 05:01:50,526 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:01:50,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-11 05:01:50,537 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 05:01:50,539 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-08-11 05:01:50,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-11 05:01:50,547 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 05:01:50,551 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-08-11 05:01:50,556 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-11 05:01:50,559 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-11 05:01:50,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.961sec 2023-08-11 05:01:50,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-11 05:01:50,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-11 05:01:50,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-11 05:01:50,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42847,1691730109537-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-11 05:01:50,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42847,1691730109537-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-11 05:01:50,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-11 05:01:50,592 DEBUG [Listener at localhost/41321] zookeeper.ReadOnlyZKClient(139): Connect 0x038a2de2 to 127.0.0.1:58328 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 05:01:50,598 DEBUG [Listener at localhost/41321] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cd2b09b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 05:01:50,600 DEBUG [hconnection-0x9299623-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 05:01:50,602 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 05:01:50,603 INFO [Listener at localhost/41321] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42847,1691730109537 2023-08-11 05:01:50,603 INFO [Listener at localhost/41321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:01:50,607 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-11 05:01:50,608 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:01:50,608 INFO [Listener at localhost/41321] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-11 05:01:50,608 INFO [Listener at localhost/41321] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 05:01:50,611 INFO [Listener at localhost/41321] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=test.com%2C8080%2C1, suffix=, logDir=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/WALs/test.com,8080,1, archiveDir=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/oldWALs, maxLogs=32 2023-08-11 05:01:50,626 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36179,DS-ba6da311-7c6c-4911-bfac-1834c95a15d1,DISK] 2023-08-11 05:01:50,626 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39327,DS-e7ae7d72-0498-43bf-a5d7-c2cc903b7339,DISK] 2023-08-11 05:01:50,628 INFO [Listener at localhost/41321] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/WALs/test.com,8080,1/test.com%2C8080%2C1.1691730110611 2023-08-11 05:01:50,628 DEBUG [Listener at localhost/41321] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36179,DS-ba6da311-7c6c-4911-bfac-1834c95a15d1,DISK], DatanodeInfoWithStorage[127.0.0.1:39327,DS-e7ae7d72-0498-43bf-a5d7-c2cc903b7339,DISK]] 2023-08-11 05:01:50,642 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39327,DS-e7ae7d72-0498-43bf-a5d7-c2cc903b7339,DISK] 2023-08-11 05:01:50,643 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36179,DS-ba6da311-7c6c-4911-bfac-1834c95a15d1,DISK] 2023-08-11 05:01:50,644 INFO [Listener at localhost/41321] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/WALs/test.com,8080,1/test.com%2C8080%2C1.1691730110611 with entries=0, filesize=83 B; new WAL /user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/WALs/test.com,8080,1/test.com%2C8080%2C1.1691730110629 2023-08-11 05:01:50,645 DEBUG [Listener at localhost/41321] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39327,DS-e7ae7d72-0498-43bf-a5d7-c2cc903b7339,DISK], DatanodeInfoWithStorage[127.0.0.1:36179,DS-ba6da311-7c6c-4911-bfac-1834c95a15d1,DISK]] 2023-08-11 05:01:50,645 DEBUG [Listener at localhost/41321] wal.AbstractFSWAL(716): hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/WALs/test.com,8080,1/test.com%2C8080%2C1.1691730110611 is not closed yet, will try archiving it next time 2023-08-11 05:01:50,652 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/WALs/test.com,8080,1/test.com%2C8080%2C1.1691730110611 to hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/oldWALs/test.com%2C8080%2C1.1691730110611 2023-08-11 05:01:50,655 DEBUG [Listener at localhost/41321] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/oldWALs 2023-08-11 05:01:50,655 INFO [Listener at localhost/41321] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL test.com%2C8080%2C1:(num 1691730110629) 2023-08-11 05:01:50,655 INFO [Listener at localhost/41321] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-11 05:01:50,655 DEBUG [Listener at localhost/41321] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x038a2de2 to 127.0.0.1:58328 2023-08-11 05:01:50,655 DEBUG [Listener at localhost/41321] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:01:50,656 DEBUG [Listener at localhost/41321] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-11 05:01:50,656 DEBUG [Listener at localhost/41321] util.JVMClusterUtil(257): Found active master hash=1368235317, stopped=false 2023-08-11 05:01:50,656 INFO [Listener at localhost/41321] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42847,1691730109537 2023-08-11 05:01:50,659 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): regionserver:45335-0x101f26767540001, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 05:01:50,659 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 05:01:50,659 INFO [Listener at localhost/41321] procedure2.ProcedureExecutor(629): Stopping 2023-08-11 05:01:50,659 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:01:50,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45335-0x101f26767540001, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:01:50,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:01:50,660 DEBUG [Listener at localhost/41321] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ed9e193 to 127.0.0.1:58328 2023-08-11 05:01:50,660 DEBUG [Listener at localhost/41321] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:01:50,660 INFO [Listener at localhost/41321] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45335,1691730109577' ***** 2023-08-11 05:01:50,660 INFO [Listener at localhost/41321] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-11 05:01:50,660 INFO [RS:0;jenkins-hbase4:45335] regionserver.HeapMemoryManager(220): Stopping 2023-08-11 05:01:50,660 INFO [RS:0;jenkins-hbase4:45335] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-11 05:01:50,660 INFO [RS:0;jenkins-hbase4:45335] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-11 05:01:50,660 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-11 05:01:50,660 INFO [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(3305): Received CLOSE for 6bcf3379ff7c928a2403bc7261a18ddc 2023-08-11 05:01:50,661 INFO [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45335,1691730109577 2023-08-11 05:01:50,661 DEBUG [RS:0;jenkins-hbase4:45335] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75017dc2 to 127.0.0.1:58328 2023-08-11 05:01:50,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6bcf3379ff7c928a2403bc7261a18ddc, disabling compactions & flushes 2023-08-11 05:01:50,662 DEBUG [RS:0;jenkins-hbase4:45335] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:01:50,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc. 2023-08-11 05:01:50,662 INFO [RS:0;jenkins-hbase4:45335] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-11 05:01:50,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc. 2023-08-11 05:01:50,662 INFO [RS:0;jenkins-hbase4:45335] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-11 05:01:50,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc. after waiting 0 ms 2023-08-11 05:01:50,662 INFO [RS:0;jenkins-hbase4:45335] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-11 05:01:50,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc. 2023-08-11 05:01:50,662 INFO [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-11 05:01:50,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6bcf3379ff7c928a2403bc7261a18ddc 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-11 05:01:50,662 INFO [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-08-11 05:01:50,662 DEBUG [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(1478): Online Regions={6bcf3379ff7c928a2403bc7261a18ddc=hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc., 1588230740=hbase:meta,,1.1588230740} 2023-08-11 05:01:50,662 DEBUG [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(1504): Waiting on 1588230740, 6bcf3379ff7c928a2403bc7261a18ddc 2023-08-11 05:01:50,663 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 05:01:50,663 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 05:01:50,663 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 05:01:50,663 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 05:01:50,663 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 05:01:50,663 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=1.26 KB heapSize=2.89 KB 2023-08-11 05:01:50,687 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.17 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/.tmp/info/7852b6f7b51b4013b5f987887d35ef7d 2023-08-11 05:01:50,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/namespace/6bcf3379ff7c928a2403bc7261a18ddc/.tmp/info/2ab5536c1ca24009a406ab8173f3005f 2023-08-11 05:01:50,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/namespace/6bcf3379ff7c928a2403bc7261a18ddc/.tmp/info/2ab5536c1ca24009a406ab8173f3005f as hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/namespace/6bcf3379ff7c928a2403bc7261a18ddc/info/2ab5536c1ca24009a406ab8173f3005f 2023-08-11 05:01:50,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/namespace/6bcf3379ff7c928a2403bc7261a18ddc/info/2ab5536c1ca24009a406ab8173f3005f, entries=2, sequenceid=6, filesize=4.8 K 2023-08-11 05:01:50,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6bcf3379ff7c928a2403bc7261a18ddc in 47ms, sequenceid=6, compaction requested=false 2023-08-11 05:01:50,712 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=94 B at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/.tmp/table/8db1d6cc78da4d09ab91ddb11af12f2c 2023-08-11 05:01:50,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/namespace/6bcf3379ff7c928a2403bc7261a18ddc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-11 05:01:50,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc. 2023-08-11 05:01:50,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6bcf3379ff7c928a2403bc7261a18ddc: 2023-08-11 05:01:50,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1691730110122.6bcf3379ff7c928a2403bc7261a18ddc. 2023-08-11 05:01:50,718 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/.tmp/info/7852b6f7b51b4013b5f987887d35ef7d as hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/info/7852b6f7b51b4013b5f987887d35ef7d 2023-08-11 05:01:50,722 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/info/7852b6f7b51b4013b5f987887d35ef7d, entries=10, sequenceid=9, filesize=5.9 K 2023-08-11 05:01:50,723 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/.tmp/table/8db1d6cc78da4d09ab91ddb11af12f2c as hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/table/8db1d6cc78da4d09ab91ddb11af12f2c 2023-08-11 05:01:50,727 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/table/8db1d6cc78da4d09ab91ddb11af12f2c, entries=2, sequenceid=9, filesize=4.7 K 2023-08-11 05:01:50,728 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.26 KB/1290, heapSize ~2.61 KB/2672, currentSize=0 B/0 for 1588230740 in 65ms, sequenceid=9, compaction requested=false 2023-08-11 05:01:50,733 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/data/hbase/meta/1588230740/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-08-11 05:01:50,734 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-11 05:01:50,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 05:01:50,734 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 05:01:50,734 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-11 05:01:50,863 INFO [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45335,1691730109577; all regions closed. 2023-08-11 05:01:50,868 DEBUG [RS:0;jenkins-hbase4:45335] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/oldWALs 2023-08-11 05:01:50,868 INFO [RS:0;jenkins-hbase4:45335] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45335%2C1691730109577.meta:.meta(num 1691730110069) 2023-08-11 05:01:50,872 DEBUG [RS:0;jenkins-hbase4:45335] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/oldWALs 2023-08-11 05:01:50,872 INFO [RS:0;jenkins-hbase4:45335] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45335%2C1691730109577:(num 1691730109951) 2023-08-11 05:01:50,872 DEBUG [RS:0;jenkins-hbase4:45335] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:01:50,872 INFO [RS:0;jenkins-hbase4:45335] regionserver.LeaseManager(133): Closed leases 2023-08-11 05:01:50,873 INFO [RS:0;jenkins-hbase4:45335] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-08-11 05:01:50,873 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 05:01:50,873 INFO [RS:0;jenkins-hbase4:45335] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45335 2023-08-11 05:01:50,877 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): regionserver:45335-0x101f26767540001, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45335,1691730109577 2023-08-11 05:01:50,877 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 05:01:50,877 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): regionserver:45335-0x101f26767540001, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 05:01:50,879 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45335,1691730109577] 2023-08-11 05:01:50,879 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45335,1691730109577; numProcessing=1 2023-08-11 05:01:50,880 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45335,1691730109577 already deleted, retry=false 2023-08-11 05:01:50,880 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45335,1691730109577 expired; onlineServers=0 2023-08-11 05:01:50,880 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42847,1691730109537' ***** 2023-08-11 05:01:50,880 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-11 05:01:50,880 DEBUG [M:0;jenkins-hbase4:42847] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55b203dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 05:01:50,880 INFO [M:0;jenkins-hbase4:42847] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42847,1691730109537 2023-08-11 05:01:50,880 INFO [M:0;jenkins-hbase4:42847] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42847,1691730109537; all regions closed. 2023-08-11 05:01:50,881 DEBUG [M:0;jenkins-hbase4:42847] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:01:50,881 DEBUG [M:0;jenkins-hbase4:42847] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-11 05:01:50,881 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-11 05:01:50,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691730109718] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691730109718,5,FailOnTimeoutGroup] 2023-08-11 05:01:50,881 DEBUG [M:0;jenkins-hbase4:42847] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-11 05:01:50,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691730109718] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691730109718,5,FailOnTimeoutGroup] 2023-08-11 05:01:50,882 INFO [M:0;jenkins-hbase4:42847] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-11 05:01:50,882 INFO [M:0;jenkins-hbase4:42847] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-11 05:01:50,882 INFO [M:0;jenkins-hbase4:42847] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-11 05:01:50,882 DEBUG [M:0;jenkins-hbase4:42847] master.HMaster(1512): Stopping service threads 2023-08-11 05:01:50,882 INFO [M:0;jenkins-hbase4:42847] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-11 05:01:50,883 ERROR [M:0;jenkins-hbase4:42847] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-7,5,PEWorkerGroup] 2023-08-11 05:01:50,883 INFO [M:0;jenkins-hbase4:42847] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-11 05:01:50,883 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-11 05:01:50,883 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-11 05:01:50,883 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:01:50,883 DEBUG [M:0;jenkins-hbase4:42847] zookeeper.ZKUtil(398): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-11 05:01:50,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 05:01:50,883 WARN [M:0;jenkins-hbase4:42847] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-11 05:01:50,883 INFO [M:0;jenkins-hbase4:42847] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-11 05:01:50,884 INFO [M:0;jenkins-hbase4:42847] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-11 05:01:50,884 DEBUG [M:0;jenkins-hbase4:42847] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 05:01:50,884 INFO [M:0;jenkins-hbase4:42847] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:01:50,884 DEBUG [M:0;jenkins-hbase4:42847] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:01:50,884 DEBUG [M:0;jenkins-hbase4:42847] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 05:01:50,884 DEBUG [M:0;jenkins-hbase4:42847] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:01:50,884 INFO [M:0;jenkins-hbase4:42847] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=24.07 KB heapSize=29.55 KB 2023-08-11 05:01:50,894 INFO [M:0;jenkins-hbase4:42847] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24.07 KB at sequenceid=66 (bloomFilter=true), to=hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7578280de32a4dc6a6d817202707100b 2023-08-11 05:01:50,899 DEBUG [M:0;jenkins-hbase4:42847] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7578280de32a4dc6a6d817202707100b as hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7578280de32a4dc6a6d817202707100b 2023-08-11 05:01:50,904 INFO [M:0;jenkins-hbase4:42847] regionserver.HStore(1080): Added hdfs://localhost:35443/user/jenkins/test-data/f81fe42f-8c09-c7da-2465-2dc24b7f9d09/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7578280de32a4dc6a6d817202707100b, entries=8, sequenceid=66, filesize=6.3 K 2023-08-11 05:01:50,904 INFO [M:0;jenkins-hbase4:42847] regionserver.HRegion(2948): Finished flush of dataSize ~24.07 KB/24646, heapSize ~29.54 KB/30248, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=66, compaction requested=false 2023-08-11 05:01:50,906 INFO [M:0;jenkins-hbase4:42847] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:01:50,906 DEBUG [M:0;jenkins-hbase4:42847] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 05:01:50,908 INFO [M:0;jenkins-hbase4:42847] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-11 05:01:50,908 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 05:01:50,909 INFO [M:0;jenkins-hbase4:42847] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42847 2023-08-11 05:01:50,912 DEBUG [M:0;jenkins-hbase4:42847] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42847,1691730109537 already deleted, retry=false 2023-08-11 05:01:51,061 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:01:51,061 INFO [M:0;jenkins-hbase4:42847] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42847,1691730109537; zookeeper connection closed. 2023-08-11 05:01:51,061 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): master:42847-0x101f26767540000, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:01:51,161 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): regionserver:45335-0x101f26767540001, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:01:51,161 INFO [RS:0;jenkins-hbase4:45335] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45335,1691730109577; zookeeper connection closed. 2023-08-11 05:01:51,161 DEBUG [Listener at localhost/41321-EventThread] zookeeper.ZKWatcher(600): regionserver:45335-0x101f26767540001, quorum=127.0.0.1:58328, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:01:51,162 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@72ba470a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@72ba470a 2023-08-11 05:01:51,163 INFO [Listener at localhost/41321] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-11 05:01:51,163 WARN [Listener at localhost/41321] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 05:01:51,166 INFO [Listener at localhost/41321] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:01:51,269 WARN [BP-103299520-172.31.14.131-1691730108934 heartbeating to localhost/127.0.0.1:35443] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 05:01:51,269 WARN [BP-103299520-172.31.14.131-1691730108934 heartbeating to localhost/127.0.0.1:35443] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-103299520-172.31.14.131-1691730108934 (Datanode Uuid ddf2581c-f912-4af7-ba10-507b8cddce6a) service to localhost/127.0.0.1:35443 2023-08-11 05:01:51,270 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/cluster_4cfe48b6-c531-0fbd-fbae-52d8da43b8f1/dfs/data/data3/current/BP-103299520-172.31.14.131-1691730108934] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:01:51,270 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/cluster_4cfe48b6-c531-0fbd-fbae-52d8da43b8f1/dfs/data/data4/current/BP-103299520-172.31.14.131-1691730108934] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:01:51,271 WARN [Listener at localhost/41321] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 05:01:51,274 INFO [Listener at localhost/41321] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:01:51,378 WARN [BP-103299520-172.31.14.131-1691730108934 heartbeating to localhost/127.0.0.1:35443] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 05:01:51,378 WARN [BP-103299520-172.31.14.131-1691730108934 heartbeating to localhost/127.0.0.1:35443] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-103299520-172.31.14.131-1691730108934 (Datanode Uuid f919fc0e-c3cd-4990-9cb2-6a4316eae383) service to localhost/127.0.0.1:35443 2023-08-11 05:01:51,379 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/cluster_4cfe48b6-c531-0fbd-fbae-52d8da43b8f1/dfs/data/data1/current/BP-103299520-172.31.14.131-1691730108934] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:01:51,379 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9854e6c8-e230-6245-ff03-982417f27e82/cluster_4cfe48b6-c531-0fbd-fbae-52d8da43b8f1/dfs/data/data2/current/BP-103299520-172.31.14.131-1691730108934] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:01:51,390 INFO [Listener at localhost/41321] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:01:51,501 INFO [Listener at localhost/41321] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-11 05:01:51,515 INFO [Listener at localhost/41321] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-11 05:01:51,525 INFO [Listener at localhost/41321] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=102 (was 76) - Thread LEAK? -, OpenFileDescriptor=495 (was 469) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=112 (was 112), ProcessCount=171 (was 171), AvailableMemoryMB=2494 (was 2623)